Member of Technical Staff - Evals Research Engineer
Quick Summary
Design and build evaluation frameworks for agentic systems Research methods for agent evaluation, reward modeling, reward-hacking, post-training, and self-improving systems Develop rubrics, verifiers,
NeoSigma is a product-driven research lab building the intelligence layer that helps close the feedback loop between your customers, products, and AI systems.
We are a small, intensely technical team of researchers and engineers who have trained frontier-scale models and widely used AI products and agents at Parallel Web, Essential AI, MIT, Apple, and Amazon.
We are backed by world-class investors and leaders from Google DeepMind, OpenAI, Decagon and others.
We are looking for a Backend Engineer to own the systems that ingest, evaluate, and serve agent behavior data at production scale. You will work across telemetry ingestion, platform reliability, sandbox infrastructure, and the API surface that customers and integrations build on. Some weeks you will be deep in distributed systems and query performance. Other weeks you will ship a customer-facing feature across backend, APIs, and the data layer.
What you'll do:
- Design and build evaluation frameworks for agentic systems
- Research methods for agent evaluation, reward modeling, reward-hacking, post-training, and self-improving systems
- Develop rubrics, verifiers, reward signals, and benchmarks to measure agent performance, reliability, and generalisation
- Own research streams end-to-end and building infrastructure to ship working systems
- Publish research findings through technical blogs, papers, and open-source contributions
- Moving fast with high agency
- Strong foundations in machine learning, deep learning, and computer science
- Hands-on experience with LLM evaluation, agentic systems, reinforcement learning, or post-training
- Strong programming skills in Python and experience building reliable ML research infrastructure
- Strong research taste and the ability to identify and solve complex and meaningful problems
- Comfortable navigating open-ended research problems and quickly translating ideas into working implementations
- High standards for experimental rigor, engineering quality, and clear technical communication
- Customer Obsession - We start with the customer and work backwards. We aim to earn trust through consistent delivery, thoughtful listening, and by obsessing over customers.
- Intellectual Honesty - We operate with high trust and low ego. Ideas matter more than titles, and we communicate openly and directly while assuming good intent, even in strong disagreement.
- Bias for Action - We set high standards and move quickly to meet them. We prefer building and learning with customers over debating in the abstract, and we iterate based on real feedback.
- Extreme Ownership - We take responsibility for outcomes, not just tasks. Ownership means seeing problems through to completion and ensuring solutions truly work in practice.
What We Offer
~1 min readLocation & Eligibility
About this job
- Who can apply
- United States
- Posted
- Today
Listing Details
- First seen
- November 16, 2026
- Last seen
- November 16, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 57%
- Scored at
- November 16, 2026
Signal breakdown
Similar Software Engineer jobs
View all →Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.