AI Inference Optimization Engineer

United States·Burlingamefull-timemid

Optimization EngineerData & AI

0 views0 saves0 applied

Apply Now

Quick Summary

Key Responsibilities

Deploy 5 new models on GPNPU independently, meeting accuracy targets Deliver a 2x speedup on a model through kernel,

Technical Tools

Optimization EngineerData & AI

Quadric is redefining edge AI with the industry's first General Purpose Neural Processing Unit (GPNPU), enabling developers to run both neural network inference and conventional C++ code on a single programmable architecture. Our technology powers intelligent edge devices across automotive, industrial, robotics, and embedded systems.

Founded in 2016 and based in downtown Burlingame, California, Quadric is building the world's first supercomputer designed for the real-time needs of edge devices. Quadric aims to empower developers in every industry with superpowers to create tomorrow's technology, today. The company was co-founded by technologists from MIT and Carnegie Mellon, who were previously the technical co-founders of the Bitcoin computing company 21.

As a member of our AI Application team, you'll own getting the latest AI models running fast and accurately on the GPNPU, from CNN perception models to LLMs and VLAs for automotive, robotics and AI-PC. You'll profile real workloads, write and tune kernels, choose quantization strategies, and build the tools that make model deployment repeatable.

Responsibilities

~1 min read

Analyze and optimize performance on GPNPU

→
Deploy and profile models on GPNPU, from vision/perception to LLM/VLM/VLA
→
Analyze the accuracy and choose the best quantization scheme
→
Write and tune kernels and optimize model compute graphs on GPNPU, balance speed and accuracy

Create efficient flows to convert and deploy models on GPNPU

→
Develop efficient tools and flows to speed up the model deployment, including profiling, tracing, visualization tools to find bottlenecks and agentic automation
→
Customize open-source model optimization/quantization tools
→
Integrate and automate model pruning, sparsification, quantization in the workflow

Within your first 6-12 months, you’ll:

Deploy 5 new models on GPNPU independently, meeting accuracy targets
Deliver a 2x speedup on a model through kernel, model compression or dispatch work
Ship a deployment or an optimization tool the team uses every day

3+ years experience in AI model deployment or kernel optimization
BS/MS in CS/CE or related fields
Strong C/C++ and Python
Hands-on performance analysis: profilers, roofline/bandwidth reasoning, finding compute vs memory bottlenecks
Hands-on experience with quantization (PTQ/QAT, int8/int4) and debugging accuracy loss
Has written performance-critical kernels (CUDA, Triton, OpenCL, SIMD intrinsics or DSP)

Fluent with AI coding agents (e.g. Claude Code, Cursor), and interested in building agent-driven workflows for kernel and model bring-up

Nice to Have

~1 min read

Hands-on experience in pruning and sparsification
Solid understanding of accelerator microarchitecture (memory hierarchy, DMA)
Solid understanding of fixed-point and numerics, mixed precision
Understanding of compiler code generation and kernel scheduling

What We Offer

~2 min read

The base salary range for this position is $160,000 to $195,000. This range reflects the full span of levels and geographies at which Quadric hires for this role. The actual base salary offered will depend on a number of factors, including the specific level of the role, years and depth of relevant experience, technical skills and competencies, the criticality of the role to the business, internal equity, and work location. In addition to base salary, this role is eligible for equity and a discretionary annual performance bonus as applicable to the role and level.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings; for roles in other locations, benefits vary and are shared during the hiring process. These include:

✓Medical, dental, and vision insurance from day one - Premiums covered at 99% for Employees

✓Company-paid life Insurance

✓Voluntary supplemental life insurance

✓STD + LTD insurance

✓Commuter support including parking or Caltrain reimbursement. Our office is conveniently located within walking distance of the Caltrain station

✓FSA + HSA

✓Equity with the business

✓Paid Parental Leave

✓401(k) Retirement Plan

✓Flexible PTO

✓Winter holiday shutdown

✓Catered lunch each day in our office

✓Downtown Burlingame office location, close to shops, cafes, and local amenities

✓Collaborative, low-ego culture with significant ownership and impact

✓A work culture focused on innovative disruption

Quadric is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, marital status, medical condition, or any other characteristic protected by applicable federal, state, or local law

Quadric participates in the E-Verify program to confirm employment eligibility for U.S.-based roles. As part of this process, applicants may review the following notices, which explain your rights and our participation in E-Verify. These notices are provided in English and Spanish.

No action is required from candidates during the application process. These notices are provided for informational purposes only.

By submitting an application, you acknowledge that Quadric will collect and process your personal information as part of the hiring process. Please review our Privacy Policy to understand how we handle your data