AI Runtime & Performance Lead

We are looking for a Principal AI Runtime & Performance Lead to define the architecture and performance strategy for AI workloads across HP PCs. You will establish how software should use compute engines, memory, hardware capabilities, and different model types to deliver responsive, efficient, and reliable AI experiences. As a senior technical leader, you will translate product goals into system-level performance requirements and architectural direction. You will guide decisions about model execution, resource allocation, and runtime behavior across CPUs, GPUs, and NPUs, considering the constraints of different device configurations. The role emphasizes architectural planning and technical leadership. You will set the direction for implementation and optimization teams, establish how performance should be measured, and use evidence from prototypes, benchmarks, and telemetry to refine the architecture.

• →

  Own the technical direction for AI runtime architecture and performance across supported PC platforms and hardware configurations.

• →

  Define model execution strategies across CPU, GPU, and NPU resources, balancing responsiveness, throughput, memory use, power consumption, and thermal constraints.

• →

  Determine how different model types and workload patterns should influence runtime design, hardware utilization, and resource allocation.

• →

  Establish architectural approaches for concurrent agents and models, including resource coordination and behavior under system pressure.

• →

  Translate customer experience goals into performance budgets, system requirements, and design principles that engineering teams can implement.

• →

  Define benchmark methodology and representative workload scenarios to evaluate architectural choices and measure progress against performance goals.

• →

  Guide cross-functional teams through design reviews, resolve technical trade-offs, and prioritize improvements based on system-level impact.

• →

  Partner with hardware, firmware, operating system, platform, and AI engineering teams to align capabilities and dependencies across the stack.

• →

  Shape engineering roadmaps, evaluate emerging technologies through proofs of concept, and mentor engineers on runtime architecture and performance design.

• 10+ years of experience in software engineering, systems architecture, runtime systems, or a related field, including technical leadership of complex engineering initiatives.

• Demonstrated experience defining architecture and performance strategy for AI runtimes, inference platforms, or hardware-aware software systems.

• Strong understanding of heterogeneous computing, including CPU, GPU, and NPU execution and the implications for model placement and resource utilization.

• Deep knowledge of memory behavior, concurrency, scheduling, and the interaction among applications, operating systems, runtimes, and hardware.

• Strong Linux and Windows expertise, with the ability to assess how operating system capabilities and constraints affect runtime design.

• Experience establishing performance requirements, benchmark methodologies, and validation approaches that guide engineering decisions.

• Proven ability to lead cross-functional engineering teams through influence, communicate architectural trade-offs, and drive alignment across organizations.

• Bachelor’s degree in computer science, software engineering, information technology, a related field, or equivalent practical experience.

• Experience with edge AI platforms, on-device inference, and performance planning for commercial PCs.

• Familiarity with inference frameworks such as ONNX Runtime, TensorRT, and OpenVINO and their hardware execution backends.

• Knowledge of model architectures, quantization, and the relationship between model characteristics, memory footprint, and execution performance.

• Experience using device telemetry to understand workload behavior and inform architectural decisions.

• Familiarity with firmware integration, hardware resource controls, and power and thermal management.

• Strong C++ and Python background to support technical reviews, architectural prototyping, and collaboration with implementation teams.

The pay range for this role is $147,050 to $230,850 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience.

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.