Full-Time

Technical Product Manager

Alluxio

Alluxio

51-200 employees

Data management platform for AI workloads

Compensation Overview

$190k - $240k/yr

+ Equity

San Mateo, CA, USA

Hybrid

Hybrid role; on-site presence in Foster City, CA.

Category
Product (1)
Requirements
  • 5–9 years of experience in product management or technical leadership within AI infrastructure, ML platforms, or distributed systems.
  • Strong understanding of AI/ML workflows — from model training and deployment to inference and data-access pipelines.
  • Proven track record of delivering infrastructure features that improve latency, GPU utilization, or total cost of ownership.
  • Technical fluency with distributed systems, caching, and cloud orchestration (Kubernetes, AWS/GCP/Azure).
  • Familiarity with AI frameworks such as PyTorch, TensorFlow, Triton, Ray, or LangChain.
  • Exceptional communication and strategic thinking — ability to translate complex systems work into clear, prioritized roadmaps.
Responsibilities
  • AI Product Strategy — define the long-term vision and roadmap for Alluxio’s AI data platform, covering inference, training, and agentic workloads.
  • Systems Optimization for AI — collaborate with engineering to design features that deliver high-throughput, low-latency data access (e.g., GPU-aware caching, streaming reads, tiered prefetching).
  • AI Ecosystem Integration — ensure seamless integration with frameworks like PyTorch, TensorFlow, Ray, and Triton; evolve Alluxio’s APIs for AI-native workloads.
  • Customer & Partner Collaboration — engage directly with enterprise AI teams to understand workload patterns, validate impact, and prioritize roadmap direction.
  • Market Awareness & Foresight — stay ahead of trends in multi-model serving, retrieval-augmented generation (RAG), and agentic orchestration; translate them into actionable product plans.

Alluxio provides a data management platform that sits between compute and storage to optimize AI and ML workloads. Its two products, Alluxio Enterprise Data and Alluxio Enterprise AI, offer a single interface to manage data and AI tasks across clouds, regions, and storage systems. This helps remove data silos, reduces data movement and copies, and improves data access with low latency. The goal is to simplify data engineering, cut infrastructure costs, and speed up model training and serving for enterprises.

Company Size

51-200

Company Stage

Series C

Total Funding

$81.5M

Headquarters

San Mateo, California

Founded

2015

Simplify Jobs

Simplify's Take

What believers are saying

  • Dyna Robotics boosted foundation model training 35% using Alluxio caching in 2026.
  • NetApp partnership enhances analytics and AI performance across clouds and regions.
  • Alluxio powers nine of top ten internet companies with AI Acceleration Platform.

What critics are saying

  • JuiceFS v1.2 erodes differentiation with superior S3 compatibility in 6-12 months.
  • Weka captures trading clients via 10x GPU utilization in 12-18 months.
  • Dremio Arctic bypasses Alluxio with 15x faster lakehouse queries in 3-9 months.

What makes Alluxio unique

  • Alluxio provides memory-speed caching between compute and storage for AI workloads.
  • Alluxio Enterprise AI accelerates model training 20x and serving 10x with 90% GPU utilization.
  • Alluxio unifies multi-cloud data access without code changes or data replication.

Help us improve and share your feedback! Did you find this helpful?

Your Connections

People at Alluxio who can refer or advise you

Benefits

Unlimited PTO

Amazing Medical, Dental, and Vision Plans

Commuter Benefits ($50+)

Everyday Catered Lunch and Dinner

Boba Thursday

Relaxation/Massage Room Onsite

Gym Access

Frequent Company Outings and Trips

Growth & Insights and Company News

Headcount

6 month growth

2%

1 year growth

4%

2 year growth

1%
Alluxio
Jan 9th, 2024
Setting the Stage for Alluxio Community to Soar in the Year of the Dragon: 2023 Recap and 2024 Outlook

Alluxio kicked off 2023 strong by being named one of the Best Open Source Projects.

DZone
Nov 2nd, 2023
Alluxio Launches AI-Optimized Data Platform for Faster ML Pipelines

Alluxio launches ai-optimized data platform for faster ML pipelines.

The New Stack
Oct 20th, 2023
Alluxio Launches Enterprise Platform for Generative AI Apps

Alluxio launches enterprise platform for generative AI apps.

Database Trends and Applications
Oct 19th, 2023
Alluxio Enterprise AI Simplifies and Enhances AI and ML Workload Enablement

Alluxio, the data platform company for data-driven workloads, is unveiling Alluxio Enterprise AI, a high-performance data platform designed to unify performance, data accessibility, scalability, and cost efficiency in powering AI and machine learning (ML) workloads.

Alluxio
Oct 17th, 2023
Alluxio Unveils New Data Platform for AI: Accelerating AI Products' Time-to-Value and Maximizing Infrastructure ROI

Alluxio unveils new Data Platform for AI: accelerating AI products' time-to-value and maximizing infrastructure ROI.