A

AMD

Designs chips for computers and AI systems

Advanced AI Workloads Performance and Scalability Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeSan Jose, CA, USANo salary listedIn-person

About the Job

Requirements

  • Deep software development experience in GPU computing, high-performance computing, or AI systems.
  • Deep understanding of GPU micro-architecture, memory hierarchy, instruction scheduling, and performance tradeoffs.
  • Deep understanding of end-to-end AI systems, including model architectures, inference paradigms, and system/rack-level design.
  • Understanding of multi-GPU communication, including scale-up (NVLink, xGMI, Infinity Fabric) and scale-out (RDMA, RCCL/NCCL) topologies and performance characteristics.
  • Experience designing and optimizing across the full stack, from low-level GPU kernels to frameworks and distributed serving systems.
  • Strong background in performance engineering, including profiling, roofline analysis, and bottleneck diagnosis at scale.
  • Strong proficiency in C++ (C++17 or later) and Python.
  • Experience leading small technical teams while remaining a hands-on contributor.
  • Track record of influencing technical direction across teams and organizations.
  • Strong Linux systems knowledge.
  • Excellent written and verbal English communication skills.
  • Master's or PhD in Computer Science, Computer Engineering, or Electrical Engineering, or equivalent.

Responsibilities

  • Lead a small team of engineers by setting technical direction, prioritizing work, and ensuring delivery while remaining deeply hands-on.
  • Define and drive the long-term technical strategy for AI workload performance on AMD GPUs.
  • Own complex cross-stack performance challenges, from kernel optimization to framework-level architecture decisions.
  • Lead the design and implementation of novel GPU kernels, compiler optimizations, and framework features.
  • Establish performance methodology and roofline analysis practices for the team.
  • Influence upstream roadmaps in major open-source AI frameworks, such as vLLM, SGLang, and PyTorch.
  • Drive architecture decisions for emerging inference paradigms, including prefill-decode disaggregation, speculative decoding, and distributed serving.
  • Identify and close fundamental performance gaps between AMD and competitor platforms.
  • Serve as a technical authority across the organization, advising leadership on technical direction and feasibility.
  • Mentor engineers and raise the technical bar across the broader engineering organization.
  • Represent AMD externally through publications, conference talks, and open-source contributions.

Desired Qualifications

  • Experience with one or more of HIP, CUDA, OpenCL, Triton/Gluon, CUTLASS, or CK.
  • Experience with GPU compiler toolchains such as LLVM and intermediate representations such as MLIR, LLVM IR, or Triton IR.
  • Hands-on experience contributing to or architecting major open-source AI frameworks, such as vLLM, SGLang, xDiT, Megatron LM, or PyTorch.
  • Published research or significant open-source contributions in GPU computing, high-performance computing, or AI systems.
  • A PhD is strongly preferred.

About the Company

AMD

Designs chips for computers and AI systems

AMD designs processors, graphics chips and AI accelerators for computer makers, cloud operators and businesses that build electronic devices. Its Ryzen processors power personal computers, while EPYC processors handle work in data centers and Radeon chips render graphics. Instinct accelerators run AI models, paired with software that developers use to train models and put them into production. AMD sells chips and related computing systems through equipment makers, distributors and retail channels, and contracts with outside foundries to fabricate its semiconductor designs. It was founded in 1969 and has its headquarters in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1969

Recently Posted Jobs

Explore more opportunities at AMD

See more jobs