Alluxio
Alluxio8mo ago

Technical Product Manager

Product ManagementProduct ManagerTechnical Product Manager
0 views0 saves0 applied

Quick Summary

Overview

About Alluxio: Alluxio powers the data layer for modern AI and analytics. Proven in production at eight of the top ten internet companies and seven of the ten highest-valued enterprises globally,

Technical Tools
Product ManagementProduct ManagerTechnical Product Manager
About Alluxio:
Alluxio powers the data layer for modern AI and analytics. Proven in production at eight of the top ten internet companies and seven of the ten highest-valued enterprises globally, Alluxio’s open-source data-orchestration platform unifies data across storage systems, regions, and clouds — enabling memory-speed access for large-scale AI and analytics workloads.

Spun out of UC Berkeley’s AMPLab and backed by Andreessen Horowitz, Hillhouse Capital, and Seven Seas Partners, Alluxio sits at the intersection of data, distributed systems, and AI infrastructure.

Our technology is deployed at scale by Meta, Uber, TikTok, Alibaba, Microsoft, and Salesforce, orchestrating data for billions of operations per day.

Learn more at alluxio.io or on Wikipedia.

The Role
We’re hiring a Technical Product Manager to define and execute Alluxio’s AI systems strategy — spanning inference, training, and emerging agentic workloads.

This role bridges the worlds of AI infrastructure and distributed data systems, guiding how Alluxio evolves to serve next-generation model architectures and large-scale data flows.

You’ll partner with engineering, research, and enterprise AI teams to build features that improve latency, throughput, and GPU efficiency for model inference and training — and design the data layer powering the shift toward autonomous, agentic AI systems.
  • AI Product Strategy — define the long-term vision and roadmap for Alluxio’s AI data platform, covering inference, training, and agentic workloads.
  • Systems Optimization for AI — collaborate with engineering to design features that deliver high-throughput, low-latency data access (e.g., GPU-aware caching, streaming reads, tiered prefetching).
  • AI Ecosystem Integration — ensure seamless integration with frameworks like PyTorch, TensorFlow, Ray, and Triton; evolve Alluxio’s APIs for AI-native workloads.
  • Customer & Partner Collaboration — engage directly with enterprise AI teams to understand workload patterns, validate impact, and prioritize roadmap direction.
  • Market Awareness & Foresight — stay ahead of trends in multi-model serving, retrieval-augmented generation (RAG), and agentic orchestration; translate them into actionable product plans.
  • 5–9 years of experience in product management or technical leadership within AI infrastructure, ML platforms, or distributed systems.
  • Strong understanding of AI/ML workflows — from model training and deployment to inference and data-access pipelines.
  • Proven track record of delivering infrastructure features that improve latency, GPU utilization, or total cost of ownership.
  • Technical fluency with distributed systems, caching, and cloud orchestration (Kubernetes, AWS/GCP/Azure).
  • Familiarity with AI frameworks such as PyTorch, TensorFlow, Triton, Ray, or LangChain.
  • Exceptional communication and strategic thinking — ability to translate complex systems work into clear, prioritized roadmaps.
  • Shape how the world’s most advanced AI systems access and process data.
  • Work at the intersection of distributed systems, AI acceleration, and open source.
  • Collaborate with world-class engineers, researchers, and customers driving the AI frontier.
  • Competitive compensation and equity package with comprehensive benefits.
  • A culture built on curiosity, empathy, and deep technical rigor.
  • Location & Eligibility

    Where is the job
    Foster City, United States
    Hybrid — some on-site time required
    Who can apply
    US
    Listed under
    United States

    Listing Details

    Posted
    August 22, 2025
    First seen
    March 26, 2026
    Last seen
    April 28, 2026

    Posting Health

    Days active
    32
    Repost count
    0
    Trust Level
    33%
    Scored at
    April 28, 2026

    Signal breakdown

    freshnesssource trustcontent trustemployer trust
    Alluxio
    Alluxio
    lever
    Employees
    125
    Founded
    2015
    View company profile
    Newsletter

    Stay ahead of the market

    Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

    A
    B
    C
    D
    Join 12,000+ marketers

    No spam. Unsubscribe at any time.

    AlluxioTechnical Product Manager