N

NVIDIA

Designs the chips and software that power AI

Senior Inference Engineer - GPU Kernel Optimization

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeIn-person

About the Job

Requirements

  • A Master's or PhD in Computer Science, Computer Engineering, or a related field, or equivalent experience.
  • At least 6 years of relevant industry experience.
  • Experience building or directing agentic artificial intelligence systems, including code generation, automated optimization, or multi-step reasoning workflows.
  • Strong Python and C++ skills, with proven software engineering fundamentals.
  • Hands-on GPU profiling with CUPTI, NSYS, and NCU, and the ability to attribute bottlenecks across kernel execution, compiler decisions, and runtime scheduling.
  • Direct experience with LLM inference frameworks such as TRT-LLM, SGLang, or vLLM, and a clear understanding of how kernel selection drives model-level throughput and latency.
  • Working knowledge of GPU kernel optimization using CUDA, CUTLASS, Triton, or equivalent, and the ability to read PTX or SASS output.

Responsibilities

  • Build GPU kernel microbenchmarking systems that measure competing implementations at real-silicon fidelity across production LLM deployment configurations.
  • Perform end-to-end model performance analysis, connect performance evidence to model-level serving economics, identify high-value optimization opportunities, and produce optimization policies for production inference deployments.
  • Apply AI-driven analysis to diagnose performance gaps, explore optimization opportunities across the kernel ecosystem, and validate findings with silicon measurements.
  • Collaborate with compiler, hardware, kernel, and framework teams to deliver upstream improvements and production-grade performance gains.

Desired Qualifications

  • Deep knowledge of SASS/PTX-level kernel analysis, compiler middle-end optimization, or GPU code-generation pipelines such as LLVM, MLIR, and ptxas.
  • A track record of shipping agentic systems end-to-end, including tool invention, multi-agent orchestration, and silicon-verified validation, in a performance engineering or kernel optimization context.
  • Active contributions to open-source LLM inference or GPU kernel libraries such as FlashInfer, Triton, or CUTLASS.

About the Company

NVIDIA

Designs the chips and software that power AI

NVIDIA designs the chips and software that power artificial intelligence and sells complete data center systems to cloud providers, AI labs, and other businesses, along with GeForce graphics cards for gamers. Its GPUs, chips that perform thousands of calculations at once, became the main hardware for AI after researchers used them to train the AlexNet image-recognition model in 2012. NVIDIA connects many GPUs with its own processors and networking gear into servers and rack-sized computers, and developers program them through its CUDA software. These systems bring in most of its sales, and it also makes chips for cars and robots. Jensen Huang co-founded NVIDIA in 1993, and it is based in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1993

Recently Posted Jobs

Explore more opportunities at NVIDIA

See more jobs