7mo ago

Member of Technical Staff, Reinforcement Learning

Bay Areafull-timelead

OtherMember Of Technical Staff

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

The Role We seek experienced scientists and engineers with deep expertise in post-training large language models through reinforcement learning.

Technical Tools

OtherMember Of Technical Staff

The Role

We seek experienced scientists and engineers with deep expertise in post-training large language models through reinforcement learning. You will design and implement RL training pipelines for our diffusion LLMs, develop reward modeling strategies, and build the algorithms that align model behavior with human intent at scale.

Key Responsibilities

Design, develop, and optimize RL training pipelines (PPO, DPO, RLHF, and novel approaches) for diffusion-based LLMs.
Build and iterate on reward models, reward shaping strategies, and evaluation of reward quality.
Implement innovative approaches for fine-tuning and scaling generative AI models.
Work on data preprocessing pipelines, model evaluation, and alignment to enterprise use cases.
Research and implement techniques for controlled text generation and constraint satisfaction.
Improve training stability, efficiency, and reproducibility of RL workloads.

Qualifications

BS/MS/PhD in Computer Science or a related field (or equivalent experience).
At least 2 years of experience working on ML projects in PyTorch (or equivalent), preferably in a research lab or engineering role.
Excellent familiarity with transformers and core LLM concepts (autoregressive pretraining, instruction tuning, in-context learning, KV caching).
Hands-on experience with reinforcement learning from human feedback (RLHF), PPO, DPO, or related post-training methods.
Familiarity with training and inference in diffusion models.
Experience training deep learning models at scale in distributed computing environments.

Preferred Skills

Extensive experience training transformer-based language models from scratch.
Experience designing and implementing reward models or preference learning systems.
Knowledge of advanced training techniques (mixed precision, gradient accumulation, etc.).
Background in optimization theory and neural network architecture design.
Experience with LLM serving frameworks like vLLM, SGLang, or TensorRT.

What We Offer

~1 min read

The annual base salary range for this role is $200,000 – $350,000 USD. Final compensation is determined based on experience, skills, and qualifications. Equity and benefits are included in the total package.