Facebook pixel

Senior Software Engineer - Gpu Communication, Deep Learning and Hpc
Posted on 3/19/2022
INACTIVE
Locations
Washington, USA • Urbana, IL, USA • San Jose, CA, USA • Redmond, WA...
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
CUDA
Linux/Unix
Operating Systems
Pytorch
Tensorflow
Requirements
  • M.S./Ph.D. degree in CS/CE or equivalent experience
  • 5+ years of relevant experience
  • Excellent C/C++ programming and debugging skills
  • Strong experience with Linux
  • Expert understanding of computer system architecture and operating systems
  • Experience with parallel programming interfaces and communication runtimes
  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment
Responsibilities
  • Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and parallel programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters
  • Participating in and contributing to parallel programming interface specifications like MPI/OpenSHMEM
  • Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components
  • Creating proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware
Desired Qualifications
  • Deep understanding of technology and passionate about what you do
  • Experience with CUDA programming and NVIDIA GPUs
  • Knowledge of high-performance networks like InfiniBand, iWARP etc
  • Experience with parallel scientific applications
  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment
NVIDIA

10,001+ employees

Designer & manufacturer of computer chips & graphics processors
Company Overview
NVIDIA is on a mission to solve the world's most stimulating technology problems – in industries ranging from gaming to scientific exploration.
Company Values
  • Innovation
  • Speed & Agility
  • Intellectual Honesty
  • Excellence
  • One Team