~17m ago
New

Member of Technical Staff - Evals Research Engineer

United StatesUnited States·San Franciscolead
Software EngineerSoftware Engineering
0 views0 saves0 applied

Quick Summary

Key Responsibilities

Design and build evaluation frameworks for agentic systems Research methods for agent evaluation, reward modeling, reward-hacking, post-training, and self-improving systems Develop rubrics, verifiers,

Technical Tools
Software EngineerSoftware Engineering

NeoSigma is a product-driven research lab building the intelligence layer that helps close the feedback loop between your customers, products, and AI systems.

We are a small, intensely technical team of researchers and engineers who have trained frontier-scale models and widely used AI products and agents at Parallel Web, Essential AI, MIT, Apple, and Amazon.

We are backed by world-class investors and leaders from Google DeepMind, OpenAI, Decagon and others.

We are looking for a Backend Engineer to own the systems that ingest, evaluate, and serve agent behavior data at production scale. You will work across telemetry ingestion, platform reliability, sandbox infrastructure, and the API surface that customers and integrations build on. Some weeks you will be deep in distributed systems and query performance. Other weeks you will ship a customer-facing feature across backend, APIs, and the data layer.
What you'll do:

  • Design and build evaluation frameworks for agentic systems
  • Research methods for agent evaluation, reward modeling, reward-hacking, post-training, and self-improving systems
  • Develop rubrics, verifiers, reward signals, and benchmarks to measure agent performance, reliability, and generalisation
  • Own research streams end-to-end and building infrastructure to ship working systems
  • Publish research findings through technical blogs, papers, and open-source contributions
  • Moving fast with high agency
  • Strong foundations in machine learning, deep learning, and computer science
  • Hands-on experience with LLM evaluation, agentic systems, reinforcement learning, or post-training
  • Strong programming skills in Python and experience building reliable ML research infrastructure
  • Strong research taste and the ability to identify and solve complex and meaningful problems 
  • Comfortable navigating open-ended research problems and quickly translating ideas into working implementations
  • High standards for experimental rigor, engineering quality, and clear technical communication
  • Customer Obsession - We start with the customer and work backwards. We aim to earn trust through consistent delivery, thoughtful listening, and by obsessing over customers.
  • Intellectual Honesty - We operate with high trust and low ego. Ideas matter more than titles, and we communicate openly and directly while assuming good intent, even in strong disagreement.
  • Bias for Action - We set high standards and move quickly to meet them. We prefer building and learning with customers over debating in the abstract, and we iterate based on real feedback.
  • Extreme Ownership - We take responsibility for outcomes, not just tasks. Ownership means seeing problems through to completion and ensuring solutions truly work in practice.

What We Offer

~1 min read
✓Competitive salary plus meaningful equity package
✓Comprehensive medical benefits and generous PTO
✓Flexible work arrangements
✓Direct impact on company direction and technical decisions
✓High ownership and the opportunity to make a career-defining impact
✓Visa sponsorship

Location & Eligibility

Where is the job
San Francisco, United States
On-site at the office
Who can apply
US

About this job

Who can apply
United States
Posted
Today
Employer
has 12 open jobs on Jobera in 2 countries.

Listing Details

First seen
November 16, 2026
Last seen
November 16, 2026

Posting Health

Days active
0
Repost count
0
Trust Level
57%
Scored at
November 16, 2026

Signal breakdown

freshnesssource trustcontent trustemployer trust
Newsletter

Stay ahead of the market

Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

A
B
C
D
Join 12,000+ marketers

No spam. Unsubscribe at any time.

Member of Technical Staff - Evals Research Engineer