Director of AI Workload Intelligence

Job Title: Director of AI Workload Intelligence
Office Location: San Jose, CA
Job Type: Full-Time
Work Model: Onsite 

Job Summary:

Focused on bridging AI intelligence with memory strategy, this Director-level position leads global initiatives to analyze LLM and multimodal workloads for HBF applicability. The leader will define data placement criteria, develop HBF-aware benchmark suites, and guide product strategy by translating model behaviors into concrete memory system values.

Responsibilities:

• Lead global collaboration and drive AI workload-based HBF technology development from research to PoC and productization.
• Analyze AI models, algorithms, and workload trends for HBF applicability.
• Classify HBF-relevant memory objects such as weights, KV cache, activations, embeddings, adapters, and MoE experts.
• Define model-level criteria for data placement, caching, prefetching, and offload decisions.
• Analyze HBF integration points in vLLM, SGLang, TensorRT-LLM, PyTorch, and ONNX Runtime.
• Identify HBF-applicable AI model families and inference data objects.
• Develop memory-use taxonomy and HBF applicability criteria.
• Provide model-driven inputs to Compiler/Runtime and AI Inference SW Stack teams.

Qualifications:

• Proven experience leading global AI system architecture initiatives and cross-functional teams.
• Hands-on experience in AI inference systems, ML systems, LLM serving, AI model analysis, AI framework/runtime analysis, or heterogeneous accelerator software.
• Strong understanding of Transformers, LLMs, MoE, recommendation models, embedding/retrieval workloads, and multimodal inference.
• Experience with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, ONNX Runtime, Triton Inference Server, or equivalent AI inference stacks.
• Experience in latency, throughput, token throughput, memory footprint, bandwidth, and data movement analysis.

Benefits:       

• Top Tier health insurance at no employee cost
• Paid day offs: Paid Time Off, Company Holidays, Parental Leave, Happy Fridays
• 401k Matching
• Flexible Spending Account (FSA) for Health Care & Dependent Care
• Educational reimbursement up to $10,000 per year
• Donation Matching and volunteering opportunities
• Corporate discount programs
• Free Breakfast/Lunch/Dinner provided to employees

Pay Range 250000 - 300000 USD