N

NVIDIA

Designs the chips and software that power AI

Senior Deep Learning Solution Architect

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • Over 5 years of working experience in the technology industry, with a master's degree or above in computer science, mathematics, electrical engineering, automation, or related fields.
  • Strong interest in accelerated computing, parallel computing, and heterogeneous computing, with motivation to explore these areas in depth.
  • Solid programming skills and a good understanding of data structures and computer systems fundamentals.
  • Ability to analyze, define, and independently explore technical problems.

Responsibilities

  • Contribute to the development of open-source inference frameworks such as SGLang and vLLM, including feature and operator development, performance optimization, and model support, in collaboration with the community.
  • Develop and optimize KV cache offloading frameworks for large language model workloads, supporting multi-level cache offloading and reuse across CPU, SSD, and remote storage to improve inference efficiency.
  • Drive research and development on compute performance in distributed training, and explore methods and technologies for performance optimization.
  • Study computational challenges in machine learning systems, identify common needs and bottlenecks, and build example code, acceleration libraries, or frameworks accordingly.

Desired Qualifications

  • Familiarity with heterogeneous computing, distributed training, parallel computing, or other areas related to high-performance computing.
  • Experience in performance analysis, performance modeling, or performance optimization; contributions to open-source frameworks are a plus.
  • Ability to define new problems and explore solutions; independent PhD-level research experience is preferred.
  • Proficiency with AI coding tools.

About the Company

NVIDIA

Designs the chips and software that power AI

NVIDIA designs the chips and software that power artificial intelligence and sells complete data center systems to cloud providers, AI labs, and other businesses, along with GeForce graphics cards for gamers. Its GPUs, chips that perform thousands of calculations at once, became the main hardware for AI after researchers used them to train the AlexNet image-recognition model in 2012. NVIDIA connects many GPUs with its own processors and networking gear into servers and rack-sized computers, and developers program them through its CUDA software. These systems bring in most of its sales, and it also makes chips for cars and robots. Jensen Huang co-founded NVIDIA in 1993, and it is based in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1993

Recently Posted Jobs

Explore more opportunities at NVIDIA

See more jobs