Research Engineer - Oversight Foundations

United States·San Franciscofull-timemid

OtherResearch EngineerSoftware EngineeringSearch Engineer

2 views0 saves0 applied

Apply Now

Quick Summary

Overview

Salary range: $250,000 - $500,000/year + benefits Description: Transluce is a non-profit research lab building tools for scalable, end-to-end oversight of AI systems. We build world-class,

Technical Tools

OtherResearch EngineerSoftware EngineeringSearch Engineer

Salary range: $250,000 - $500,000/year + benefits

Description: Transluce is a non-profit research lab building tools for scalable, end-to-end oversight of AI systems. We build world-class, AI-backed analysis tools and use these to set industry standards for evaluation. Our tools are integrated with core agent benchmarks like SWE-bench, while our evaluations are directly underpinning regulation, including our role as EU AI Office’s main evaluation developer for harmful manipulation risks.

About the role: We are looking for strong scientists and engineers to help advance our vision of oversight foundation models: AI systems that formalize, test, and answer questions about the behavior of other AI systems. As part of our highly collaborative team, you will learn and grow quickly, creating technology at the frontier of AI research and with high direct impact.

Core responsibility: Help us develop and train scalable oversight assistants that can predict and detect unexpected and subtle behaviors in AI systems. This includes:

Creating diverse evaluations that range in difficulty. This involves finding naturally occurring interesting and undesirable behaviors exhibited by open-source models.
Developing novel architectures and objectives for training oversight assistants.
Scaling up the training and inference pipelines to support up to 1T-scale models.

Qualities of a strong candidate:

Experience with fine-tuning language models, designing new architectures, and creating evaluations.
Reliable results: good experimental design, epistemic self-awareness and transparency
Generativeness: coming up with original, productive ideas for unblocking progress
Curiosity: a desire to understand ML systems and how they work
Strong programming ability, including navigating trade-offs between prototyping speed and maintainability
Strong communication skills, low ego, openness to giving and receiving feedback

We are located in San Francisco and enthusiastic to work together in-person. We are open to sponsoring international visas.

Location & Eligibility

Where is the job

San Francisco, United States

On-site at the office

Who can apply

About this job

Pay per year: $250,000–$500,000 a year; 53% above the $245,000 median for Search Engineer jobs on Jobera (87 salaries).
Who can apply: United States
Posted: 131 days ago
Employer: has 12 open jobs on Jobera.