Full-Time

Senior Site Reliability Engineer

GPU Clusters

Updated on 3/14/2025

NVIDIA

NVIDIA

10,001+ employees

Designs GPUs and AI computing solutions

Compensation Overview

$184k - $356.5kAnnually

+ Equity

Senior, Expert

Company Historically Provides H1B Sponsorship

Austin, TX, USA + 3 more

More locations: Santa Clara, CA, USA | Durham, NC, USA | Westford, MA, USA

Category
DevOps & Infrastructure
Site Reliability Engineering
Required Skills
TCP/IP
Kubernetes
Microsoft Azure
Python
Ruby
Docker
AWS
Go
Terraform
Ansible
Linux/Unix
Google Cloud Platform
Requirements
  • Minimum BS degree in Computer Science (or equivalent experience)
  • 7+ years of software engineering experience
  • At least 3+ years managing GPU clusters or similar high-performance computing environments
  • Expertise in designing, deploying, and running production-level cloud services
  • Proficiency with orchestration and containerization tools like Kubernetes, Docker, or similar
  • Experience coding/scripting in at least two high-level programming languages (e.g., Python, Go, Ruby)
  • Strong proficiency with Linux operating systems and TCP/IP fundamentals
  • Proficient in modern CI/CD techniques, GitOps, and Infrastructure as Code (IaC) using tools such as Terraform or Ansible
  • Diligent with strong communication and documentation skills
Responsibilities
  • Design, deploy and support large-scale, distributed GPU clusters to run high-performance AI and machine learning workloads
  • Continuously improve infrastructure provisioning, management, and monitoring through automation
  • Ensure the highest level of uptime and quality of service (QoS) through operational excellence, proactive monitoring, and incident resolution
  • Support a globally distributed, cloud environment like AWS, GCP, Azure or OCI as well as on prem
  • Define and implement service level objectives (SLOs) and service level indicators (SLIs) to measure and ensure infrastructure quality
  • Write high-quality Root Cause Analysis (RCA) reports for production-level incidents and work towards preventing future occurrences
  • Participate in the team's on-call rotation to support critical infrastructure
  • Drive the evaluation and integration of new GPU - like GB200 - and cloud technologies to improve system performance
Desired Qualifications
  • Experience managing large-scale Slurm and/or BCM deployments in production environments
  • Expertise in modern container networking and storage architectures
  • Proven track record to define and drive operational excellence in highly distributed, high-performance environments

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a highly competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Company Size

10,001+

Company Stage

IPO

Headquarters

Santa Clara, California

Founded

1993

Simplify Jobs

Simplify's Take

What believers are saying

  • Acquisition of Augtera Networks boosts NVIDIA's networking capabilities and Spectrum-X portfolio.
  • Growing demand for NVIDIA GPUs in AI acceleration suggests potential market growth.
  • NVIDIA's support for AI-driven robotics solutions opens new market opportunities.

What critics are saying

  • Increased competition from Lambda's AI Cloud Platform challenges NVIDIA's market position.
  • Edge AI technologies may reduce demand for NVIDIA's cloud-based AI solutions.
  • Regulatory challenges in robot delivery services could impact NVIDIA's investment returns.

What makes NVIDIA unique

  • NVIDIA leads in AI and HPC with cutting-edge GPU technology.
  • The company excels in diverse markets: gaming, data centers, and autonomous vehicles.
  • NVIDIA's Omniverse platform enhances industrial AI applications and digital twin technology.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Company Equity

401(k) Company Match

Growth & Insights and Company News

Headcount

6 month growth

0%

1 year growth

0%

2 year growth

-1%
Data Center Dynamics
Mar 4th, 2025
Nvidia quietly acquires AIOps firm Augtera Networks

GPU giant rolls networking monitoring firm into Spectrum-X portfolio

Business Wire
Feb 21st, 2025
Lambda Raises $480M to Expand AI Cloud Platform

Lambda, the AI Developer Cloud, today announced it has raised a $480 million Series D, bringing the total equity capital raised to date to $863 millio

PR Newswire
Feb 20th, 2025
Together AI Secures $305M Series B Funding

Together AI announced a $305 million Series B funding round led by General Catalyst and Prosperity7, valuing the company at $3.3 billion. The investment will enhance its AI Acceleration Cloud, focusing on open source models and NVIDIA Blackwell GPU deployment. Together AI supports over 450,000 developers and partners with major firms like Salesforce and Zoom. The platform offers enterprise-grade AI solutions with advanced infrastructure and research innovations for improved efficiency and cost-effectiveness.

CoinCentral
Feb 19th, 2025
NVIDIA-Backed Edge AI Startup ClustroAI Raises $12M to Bring AI Processing to Local Devices - CoinCentral

San Francisco-based ClustroAI raised $12M in Series A funding to advance its edge AI technology that enables local device AI processing without cloud computing

Alexa Blockchain
Feb 12th, 2025
GamerBoom Raises $9M with NVIDIA Backing

GamerBoom, an AI-powered gaming data analytics protocol on Solana, raised $9M in a funding round, totaling over $11M. Investors include Bing Ventures, SKY Ventures, and NVIDIA, enhancing its AI capabilities. The funding will scale AI-driven gaming data solutions for Web3. GamerBoom is part of Binance’s MVB Accelerator Program and plans to launch a rewards program and NFT sales.