N

NVIDIA

Designs the chips and software that power AI

Senior Solutions Architect - First Time Deployment Validation

Implementation & Technical Account ManagementConfirmed live in the last 24 hours
Full-timeRemote

About the Job

Requirements

  • A bachelor's degree or equivalent experience in Computer Science, Mathematics, Engineering, Physics, or a related field.
  • More than 6 years of experience managing Linux-based systems in HPC, distributed systems, or extensive AI/ML settings.
  • Hands-on experience running AI/ML workloads on multi-GPU and/or multi-node clusters, with practical knowledge of NCCL.
  • A solid grasp of collective communication patterns, particularly AllReduce and AllToAll, and their application in contemporary ML/LLM training.
  • Familiarity with LLM training and/or inference workflows using frameworks such as PyTorch or TensorFlow.
  • Proficiency with Python and Shell/Bash for scripting, automation, and tooling.
  • Experience crafting, executing, and interpreting performance benchmarks.
  • Comfort working with observability data, including metrics, logs, and dashboards, to troubleshoot and optimize complex distributed workloads.
  • Strong communication skills and the ability to work effectively with cross-functional teams.

Responsibilities

  • Set up, adjust, and verify AI factory environments across multi-GPU and multi-node Linux clusters.
  • Ensure configurations align with guidelines for NCCL, collectives, and distributed training frameworks.
  • Own execution of key AI/LLM benchmarks, including setup, orchestration, result collection, and analysis.
  • Investigate and resolve issues when training jobs or benchmarks fail, hang, or underperform.
  • Build and improve observability for AI factories, including metrics, logs, traces, and dashboards, to understand workload behavior and system health.
  • Develop automation using Python and Shell for running benchmarks, collecting results, and performing regression checks.
  • Examine communication patterns and NCCL usage for AI/LLM workloads, concentrating on collectives such as AllReduce and AllToAll.
  • Recommend changes to job configuration, parallelism strategies, and cluster settings to improve throughput, latency, and scaling efficiency.
  • Work closely with hardware, software, networking, datacenter, and product teams to prepare AI factories for customer use.
  • Contribute to documentation, guidelines, and readiness collateral that support internal collaborators and customer-facing teams.

Desired Qualifications

  • Experience with AI factory or large-scale AI infrastructure build, deployment, or operations.
  • A background in HPC performance engineering, SRE, or systems performance analysis for GPU-accelerated environments.
  • Familiarity with observability stacks, such as metrics/monitoring, logging, and tracing systems used for large distributed systems.
  • Experience building automation and CI-style pipelines for running and validating benchmarks at scale.
  • A demonstrated desire to use AI to solve practical problems, improve workflows, and guide data-driven decisions.

About the Company

NVIDIA

Designs the chips and software that power AI

NVIDIA designs the chips and software that power artificial intelligence and sells complete data center systems to cloud providers, AI labs, and other businesses, along with GeForce graphics cards for gamers. Its GPUs, chips that perform thousands of calculations at once, became the main hardware for AI after researchers used them to train the AlexNet image-recognition model in 2012. NVIDIA connects many GPUs with its own processors and networking gear into servers and rack-sized computers, and developers program them through its CUDA software. These systems bring in most of its sales, and it also makes chips for cars and robots. Jensen Huang co-founded NVIDIA in 1993, and it is based in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1993

Recently Posted Jobs

Explore more opportunities at NVIDIA

See more jobs