About the Role: 

We seek a Senior Data Scientist to play a pivotal role in advancing Tubi’s Experimentation platform. You will contribute to the company’s data-driven experimentation process, supporting continuous improvements to the user experience and the organization’s strategies. You will be involved in designing, analyzing, and interpreting our testing calendar, which includes A/B, holdout, MMT, and switchback tests. You will advance our technical infrastructure to improve test velocity and statistical rigor. Finally, you will provide insights and recommendations to inform data-driven decisions across all departments.

Responsibilities:

• Plan and execute experimentation strategies, fostering a culture of innovation
• Enhance statistical rigor, metric alignment, transparency, and effectiveness of Tubi’s experiment frameworks
• Research advanced features and methods to add to the experimentation pipeline, aiming to reduce test duration, increase sensitivity, accurately determine sample size, etc
• Define and select experiment proxy metrics that align with the company’s North Star objectives
• Provide expert evaluation of experiment design, including pre-test planning, in-flight monitoring, and post-experiment analysis for graduation decisions
• Collaborate with cross-functional teams to define and execute domain-specific and global holdout tests, measuring the individual and collective impact of the company’s initiatives

Your Background:

• Strong technical experience in a data science role, with emphasis on A/B testing and experimentation in a technology-focused organization
• Deep knowledge of experimental design, statistical methods, and best practices in A/B testing and causal inference
• Advanced proficiency in programming and data manipulation using SQL, Python, and Spark
• Strong analytical skills with proficiency in statistical analysis and the ability to derive insights from large datasets
• Excellent communication skills with the ability to present complex findings in a structured and transparent manner to non-technical stakeholders

Bonus:

• Video streaming industry experience is a plus.

Pursuant to state and local pay disclosure requirements, the pay range for this role, with final offer amount dependent on education, skills, experience, and location is listed annually below. This role is also eligible for an annual discretionary bonus, long-term incentive plan, and various benefits including medical/dental/vision, insurance, a 401(k) plan, paid time off, and other benefits in accordance with applicable plan documents.

California, New York City, Westchester County, NY, and Seattle, WA Compensation

Base ($134,000 to $191,000/year) + Bonus + Long-Term Incentive Plan + Benefits

Colorado and Washington (excluding Seattle, WA) Compensation

Base ($120,000 to $172,000/year) + Bonus + Long-Term Incentive Plan + Benefits

#LI-MQ1