Scientist / Senior Scientist, Ads Systems

The Data Science & Analytics organization's mission is to increase our speed, frequency, and acumen of our business decisions and to empower and scale product innovations. We cover a wide area of the data spectrum, including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling, economics, and machine learning. Aligned and partnering with product groups, we use this vast tool belt to discover new opportunities and unmet use cases, influence and shape the product roadmap and prioritization, build data products and measure the impact / incrementality on our community of players, developers, and advertisers.

Advertising at Roblox is new, facing critical scale, effectiveness, and implementation challenges, while operating in our civility and user focused experiences. As a new strategic area, work will be innovative and impactful. Scientific rigor will be critical in success as we organize our data model, design principled measurement systems, and architect the future of incrementality measurement and actioning, to enable our communities.

In this role, you will contribute to the new Ads Science team within the broader Economy DSA team, collaborating with engineers and product managers to innovate our advertising systems and operations. Work will include data pipeline design and ownership, modeling for ad delivery and targeting, modeling for user segmentation / experimentation, and experimental design and analysis. We are early in this multi-year journey, and seek a dedicated and passionate scientist to help design this vision and execute the innovation to achieve it.

• Design and lead offline model evaluation end-to-end (pipelines, frameworks, analysis).
• Contribute to ads ML feature and model improvements, collaborating with engineering to put these in production.
• Build offline evaluation and simulation models for our ads marketplace.
• Accelerate product development through your understanding of the underlying data and your ability to partner with product and technical leaders to provide insights.
• Lead experimental design and analysis for your ads domain.
• Design science roadmaps and experimentation agendas to determine success of product feature launches.

• Domain experience in digital ads systems, including ownership of critical analytic or production pipelines.
• 4+ years of industry or academic experience in data science, economics, analytics, or machine learning engineering.
• Expertise in data transformation and programming, and proficiency in developing data pipelines through use of Spark, Hive, and Airflow.
• Experience with auctions and experimentation in market settings.
• Graduate education in a technical field (preferred: rigorous applied training including a graduate degree in economics, statistics, bioinformatics, cognitive science, physics, or similar).

• Candid on relative opportunities for impact, and evidence-seeking to update beliefs.
• Passionate about Roblox’s mission to connect a billion people every day with optimism and civility, including through increasing earnings for our creator community.
• A strong communicator. You understand that analysis must be presented in meaningful ways and lead spirited discussions about the findings. You can explain technical concepts to non-technical audiences and discuss appropriate tradeoffs.
• Effective in a collaborative work environment with a track record of simplifying complex and ambiguous problems.