N

NVIDIA

Designs the chips and software that power AI

Senior Software Architect - Deep Learning and HPC Communications

Systems Software EngineeringConfirmed live in the last 24 hours
Full-timeRemote

About the Job

Requirements

  • An M.S. or Ph.D. in Computer Science or Computer Engineering, or equivalent experience.
  • At least 5 years of relevant experience.
  • Excellent C/C++ programming and debugging skills.
  • Experience with parallel programming models such as MPI and SHMEM, and at least one communication runtime such as MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, or UCC.
  • Deep understanding of operating systems, computer architecture, and system architecture.
  • Solid fundamentals in network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
  • Strong experience with Linux.
  • Ability and flexibility to work and communicate effectively in a multinational, multitime-zone corporate environment.

Responsibilities

  • Investigate opportunities to improve communication performance by identifying bottlenecks in current systems.
  • Design and implement new communication technologies to accelerate AI and HPC workloads.
  • Explore innovative hardware and software solutions for next-generation platforms as part of co-design efforts involving GPU, networking, and software architects.
  • Build proofs of concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.
  • Use simulation to explore the performance of large GPU clusters at scales of hundreds of thousands of GPUs.

Desired Qualifications

  • Expertise in related technology and a passion for the work.
  • Experience with CUDA programming and NVIDIA GPUs.
  • Knowledge of high-performance networks such as InfiniBand, RoCE, and NVLink.
  • Experience with deep learning frameworks such as PyTorch and TensorFlow.
  • Knowledge of deep learning parallelisms and mapping them to the communication subsystem.
  • Experience with HPC applications.
  • Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic, multifunctional environment.

About the Company

NVIDIA

Designs the chips and software that power AI

NVIDIA designs the chips and software that power artificial intelligence and sells complete data center systems to cloud providers, AI labs, and other businesses, along with GeForce graphics cards for gamers. Its GPUs, chips that perform thousands of calculations at once, became the main hardware for AI after researchers used them to train the AlexNet image-recognition model in 2012. NVIDIA connects many GPUs with its own processors and networking gear into servers and rack-sized computers, and developers program them through its CUDA software. These systems bring in most of its sales, and it also makes chips for cars and robots. Jensen Huang co-founded NVIDIA in 1993, and it is based in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1993

Recently Posted Jobs

Explore more opportunities at NVIDIA

See more jobs