Member of Technical Staff (ML Infrastructure & Research)

United States·Mountain View

Software EngineerSoftware Engineering

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

Responsibilities Measure and improve how fast and efficiently specialized language models run in real production use, including response time, throughput, GPU usage, memory caching, batching,

Technical Tools

Software EngineerSoftware Engineering

Responsibilities

~1 min read

→Measure and improve how fast and efficiently specialized language models run in real production use, including response time, throughput, GPU usage, memory caching, batching, and model compression (quantization).
→Build testing setups, scoring tools, and reinforcement learning environments from real customer AI-agent activity, so that day-to-day usage feeds a steady cycle of model improvement.
→Work directly with the founders and business partners to put improved models into important customer workflows that have strict reliability targets.
→Turn successful research experiments into reusable building blocks that teammates, customer agents, and production systems can use.
→Build and maintain the tools that manage GPU allocation across model training and live serving.

Requirements

~1 min read

1–8 years of hands-on experience in ML infrastructure, inference optimization, or applied LLM research engineering, at a fast-growing AI startup or a leading AI lab.
Strong skills in Python and PyTorch, plus at least some of C++/CUDA, Triton, or JAX.
Proven experience speeding up LLM serving tools such as vLLM, SGLang, or TensorRT-LLM.
Self-driven and comfortable taking high ownership.
Able to work in person 5 days a week in the Bay Area.