S

SambaNova Systems

Enterprise AI platform with hardware stack

Senior AI Performance Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeSan Jose, CA, USAIn-person

About the Job

Requirements

  • A bachelor's degree or higher in computer science, electrical engineering, or a related field such as applied mathematics, physics, or statistics.
  • At least 3 years of experience in deep learning model development and performance optimization, compiler, runtime, or kernel-level optimization, or software–hardware co-design or systems performance tuning.
  • Proficiency in Python or C++, with strong foundations in algorithms, data structures, and numerical computing.
  • Experience with at least one major machine learning framework: PyTorch, TensorFlow, or JAX.
  • Demonstrated ability to analyze and optimize performance in real-world machine learning pipelines.

Responsibilities

  • Bring up and optimize cutting-edge foundation models, including DeepSeek, Llama, and Qwen, on the SambaNova platform through its software stack.
  • Profile and enhance model performance across compiler, runtime, and hardware layers to achieve state-of-the-art throughput and latency.
  • Collaborate with machine learning, compiler, runtime, and hardware teams to deliver co-designed, high-performance artificial intelligence applications.
  • Integrate advances in model architecture, quantization, scheduling, and memory optimization from academia and industry.
  • Develop robust, scalable, and efficient end-to-end inference solutions aligned with customer needs.
  • Identify performance bottlenecks and propose dataflow or scheduling optimizations for single-node and distributed systems.

Desired Qualifications

  • Hands-on experience with large language model or multimodal model training and inference.
  • Background in large-scale distributed training, continuous batching, and high-throughput inference systems.
  • Familiarity with quantization, graph optimization, kernel fusion, and model partitioning.
  • Experience with frameworks such as DeepSpeed, Megatron, vLLM, or TensorRT.
  • Strong GPU programming skills using CUDA, Triton, or OpenCL; experience with cuDNN, cuBLAS, or similar libraries is a plus.
  • Knowledge of memory hierarchy optimization, caching, and scheduling for large-scale model execution.
  • Publication record or open-source contributions in machine learning systems or performance optimization.

About the Company

SambaNova Systems

Enterprise AI platform with hardware stack

Generating company summary.

Company size
201-500
Company stage
Series F
Total funding
$2.5B
Headquarters
Palo Alto, CA
Founded
2017

Recently Posted Jobs

Explore more opportunities at SambaNova Systems

See more jobs