A

AMD

Designs chips for computers and AI systems

Senior Software Engineer - AI Triton Kernels

Systems Software EngineeringConfirmed live in the last 24 hours
Full-timeSan Jose, CA, USANo salary listedIn-person

About the Job

Requirements

  • Deep expertise in SIMT programming, parallel algorithms, GPU architecture, and performance engineering.
  • Comfort working across the full stack to drive end-to-end model performance, from vLLM/SGL down to ISA-level performance tuning.
  • Ability to perform rigorous quantitative analysis to drive measurable improvements.

Responsibilities

  • Design, research, implement, and rigorously optimize high-performance matmul, attention (flash, paged, grouped-query), MoE, and fully fused transformer kernels using Triton, targeting large-scale LLM and multimodal workloads.
  • Own and productionize critical Triton/Gluon kernels within vLLM and SGL, such as paged attention, extend attention, MoE, and quantized kernels, ensuring correctness, scalability, and peak throughput.
  • Partner closely with compiler engineers to develop and maintain the Triton AMD backend across ROCm and the LLVM AMDGPU stack, targeting CDNA and next-generation architectures.
  • Drive kernel-level optimizations across the AMD memory hierarchy (LDS, L2, HBM), wavefront execution (wave32/wave64), vectorization, MFMA utilization, occupancy tuning, and instruction scheduling to maximize hardware efficiency.
  • Perform profiling and microbenchmarking-led optimization on AMD Instinct GPUs using hardware counters and tracing tools; root-cause bottlenecks in memory bandwidth, latency hiding, synchronization, and register pressure.
  • Debug and resolve performance and correctness issues end-to-end across PyTorch, vLLM/SGL runtimes, Triton IR/MLIR, ROCm runtime, and the LLVM AMDGPU backend.
  • Contribute to open-source Triton, LLVM, and ROCm ecosystems.

Desired Qualifications

  • Deep experience in GPU kernel development, compiler backends, or performance engineering focused on AI/ML workloads.
  • Strong hands-on expertise with Triton, including writing custom matmul, attention, and fused transformer kernels and understanding Triton IR lowering to GPU backends.
  • Deep understanding of modern GPU architectures, including wavefront execution, memory hierarchy, scheduling, and occupancy.
  • Meaningful contributions to open-source projects such as Triton, Torch, vLLM, SGLang, IREE, MLIR, LLVM, or ROCm.

About the Company

AMD

Designs chips for computers and AI systems

AMD designs processors, graphics chips and AI accelerators for computer makers, cloud operators and businesses that build electronic devices. Its Ryzen processors power personal computers, while EPYC processors handle work in data centers and Radeon chips render graphics. Instinct accelerators run AI models, paired with software that developers use to train models and put them into production. AMD sells chips and related computing systems through equipment makers, distributors and retail channels, and contracts with outside foundries to fabricate its semiconductor designs. It was founded in 1969 and has its headquarters in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1969

Recently Posted Jobs

Explore more opportunities at AMD

See more jobs