Senior Technical Program Manager, AI Inference

NVIDIA’s AI Platform Inference team builds the inference technology that powers AI applications worldwide. We’re hiring a Senior Technical Program Manager to lead critical programs across software, hardware, and tooling — helping our engineering teams move from roadmap to reality with speed and precision. Leading inference programs at NVIDIA means owning the full program lifecycle — from initial planning through delivery. We value clear thinking, strong execution, and people who thrive in technically complex environments where no two days look the same.

• →Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs.
• →Partner with hardware and software engineering leads to align library development with new and upcoming hardware timelines.
• →Coach teams on agile practices and run the rituals that keep programs on track.
• →Build and maintain metrics that surface risks early and support decisions with real data.
• →Communicate program status and technical context clearly to engineering teams and senior leadership alike.
• →Align global, cross-disciplinary teams spanning hardware, software, and product.
• →Identify process gaps and implement improvements that increase delivery quality and team efficiency.
• →Moderate complex technical discussions and drive them to clear, documented conclusions.

• BS degree in Computer Science, Artificial Intelligence, or equivalent experience plus 10 years of experience leading global technical programs.
• Solid knowledge of software engineering standard methodologies, hardware bring-up processes, and enterprise quality standards.
• Proficiency with Scaled Agile frameworks and program tracking tools.
• Demonstrated ability to resolve resource conflicts, unblock teams, and drive alignment at every level of the organization.
• Clear, compelling communication skills across both technical and business audiences.

• Proven experience in machine learning, deep learning, GPU technology, or AI infrastructure.
• Experience shipping production AI software or co-managing software-hardware programs end to end.
• A record of building scalable program management practices in growing engineering organizations.
• Mentorship instincts — the kind of person who invests in the teams around them.
• Familiarity with open-source inference frameworks or model optimization tooling.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.