N

NVIDIA

Designs the chips and software that power AI

Senior Software Engineer - AI Frameworks

Backend EngineeringConfirmed live in the last 24 hours
Full-timeRemote

About the Job

Requirements

  • A BS, MS, or PhD in Computer Science, Electrical Engineering, or a related field, or equivalent experience.
  • At least 5 years of experience in a related field.
  • Hands-on experience integrating with at least one major AI framework or runtime, such as PyTorch, Ray, the Triton Inference Server ecosystem, distributed runtimes, or model-serving stacks.
  • Understanding of AI workloads, including model-development basics, training-versus-inference tradeoffs, and performance considerations such as throughput, latency, batching, and memory.
  • Experience with distributed-systems concepts, including remote procedure calls, scheduling, fault tolerance, and resource management.
  • Practical Kubernetes experience deploying and operating services and jobs, and debugging clusters; Helm/Kustomize and operators/controllers are nice to have.
  • Familiarity with containers and cloud-native tooling, including Docker, container registries, and continuous integration/continuous delivery pipelines.
  • Software engineering experience in Go, C++, and/or Python, with a track record of shipping reliable systems.
  • Ability to collaborate across teams and with open-source communities.
  • Strong collaboration, communication, and documentation habits.

Responsibilities

  • Design and implement end-to-end integrations of Grove with open-source AI frameworks such as Dynamo, llm-d, Ray, PyTorch, and related ecosystem projects.
  • Build and maintain adapters, plugins, operators, and/or runtime components that enable Grove features across training and inference stacks.
  • Partner with framework owners to upstream changes, contribute patches, and ensure integrations remain maintainable over time.
  • Develop reference workflows, sample applications, and best-practice guides to accelerate adoption by users and partners.
  • Optimize performance, scalability, and reliability for distributed training and inference, including multi-node and multi-GPU environments.
  • Improve observability and operational readiness for Kubernetes-based deployments through metrics, logging, tracing, and debugging tools.
  • Participate in technical design reviews, define APIs and contracts, and ensure compatibility across framework and dependency versions.
  • Diagnose complex issues involving containers, networking, scheduling, CUDA/GPU utilization, and framework runtime behavior.

Desired Qualifications

  • Open-source contributions to Dynamo, PyTorch, Ray, llm-d, the Kubernetes ecosystem, or related machine-learning infrastructure projects.
  • Experience with large-scale model serving, distributed inference, or multi-tenant AI platforms.
  • Experience building SDKs, APIs, or developer tooling that improves integration usability.
  • Knowledge of GPU performance profiling and optimization using Nsight tools or similar, and/or kernel-level performance tuning.
  • Experience with reproducibility, packaging, versioning, and compatibility testing across fast-moving dependencies.
  • Experience with Kubernetes operators/controllers.

About the Company

NVIDIA

Designs the chips and software that power AI

NVIDIA designs the chips and software that power artificial intelligence and sells complete data center systems to cloud providers, AI labs, and other businesses, along with GeForce graphics cards for gamers. Its GPUs, chips that perform thousands of calculations at once, became the main hardware for AI after researchers used them to train the AlexNet image-recognition model in 2012. NVIDIA connects many GPUs with its own processors and networking gear into servers and rack-sized computers, and developers program them through its CUDA software. These systems bring in most of its sales, and it also makes chips for cars and robots. Jensen Huang co-founded NVIDIA in 1993, and it is based in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1993

Recently Posted Jobs

Explore more opportunities at NVIDIA

See more jobs