A

AMD

Designs chips for computers and AI systems

Software Development Engineer - GPU Fleet Management & AI Infrastructure

Platform EngineeringConfirmed live in the last 24 hours
Full-timeSan Jose, CA, USANo salary listedIn-person

About the Job

Requirements

  • Strong systems-software development experience in Rust, C++, Go, or a comparable language.
  • Experience designing and operating distributed systems, control planes, schedulers, or cloud infrastructure.
  • Strong understanding of concurrency, asynchronous programming, state machines, and failure recovery.
  • Experience building reliable services using REST, streaming, WebSocket, or gRPC APIs.
  • Experience with Kubernetes internals, controllers, operators, scheduling, resource management, or custom resources.
  • Familiarity with workload scheduling technologies such as Kueue, JobSet, Slurm, or other batch and cluster schedulers.
  • Experience with PostgreSQL-backed services, schema evolution, transactions, leader election, and optimistic concurrency.
  • Experience developing command-line tools and stable, user-focused APIs.
  • Understanding of container security, multi-tenant isolation, authentication, authorization, and secrets management.
  • Experience with production observability, including metrics, structured logging, tracing, alerting, and incident diagnosis.
  • Ability to write high-quality, maintainable code with careful attention to correctness, testing, and operational behavior.
  • Experience with source control, continuous integration, automated testing, profiling, and debugging tools.
  • Demonstrated ability to lead technically challenging projects and collaborate across organizational boundaries.
  • Effective written and verbal communication skills.

Responsibilities

  • Design and develop Fleet Manager’s distributed control-plane services, APIs, schedulers, inference gateway, and command-line tools.
  • Build reliable orchestration for GPU training, inference, custom jobs, and interactive development workloads.
  • Develop scalable scheduling and admission-control capabilities, including priority, fairness, topology-aware placement, quotas, backfilling, and multi-node workload coordination.
  • Implement durable reconciliation, lifecycle management, retries, idempotency, and recovery across PostgreSQL and external execution systems.
  • Integrate Fleet Manager with Kubernetes and technologies such as Kueue, JobSet, container runtimes, storage systems, and observability platforms.
  • Help evolve Fleet Manager into a portable orchestration layer capable of supporting Kubernetes, Slurm, Spur, and future execution environments.
  • Develop GPU health, diagnostics, quarantine, and controlled-remediation capabilities using ROCm and AMD hardware telemetry.
  • Build secure multi-tenant infrastructure with strong authentication, authorization, workload isolation, auditing, rate limiting, and least-privilege defaults.
  • Improve the reliability and performance of AI inference services, including routing, streaming, load shedding, health detection, and usage metering.
  • Define and maintain stable APIs, data models, compatibility contracts, and operational procedures.
  • Diagnose complex failures across distributed services, Kubernetes, networking, storage, GPU runtimes, drivers, and hardware.
  • Develop automated unit, integration, failure-injection, and production-readiness tests.
  • Work with AMD architecture, driver, platform, security, and machine-learning software teams to enable current and future GPU products.
  • Participate in new GPU, system, cluster, and software-stack bring-up.
  • Provide technical leadership through design reviews, code reviews, mentoring, and cross-functional problem solving.

Desired Qualifications

  • Production Rust experience is highly desirable.
  • AMD GPU architecture, ROCm, HIP, amd-smi, RCCL, or GPU device plugins.
  • Distributed AI training and multi-node collective communication.
  • Large-model inference using platforms such as vLLM, SGLang, PyTorch, or similar runtimes.
  • GPU topology, capacity management, performance analysis, and hardware diagnostics.
  • Kubernetes networking, storage, admission control, and workload isolation.
  • OpenAI-compatible inference APIs, request routing, streaming, and rate limiting.
  • High-performance shared storage and large model or checkpoint management.
  • Bare-metal, virtualized, and cloud GPU infrastructure.
  • Production security and threat modeling for multi-tenant compute platforms.

About the Company

AMD

Designs chips for computers and AI systems

AMD designs processors, graphics chips and AI accelerators for computer makers, cloud operators and businesses that build electronic devices. Its Ryzen processors power personal computers, while EPYC processors handle work in data centers and Radeon chips render graphics. Instinct accelerators run AI models, paired with software that developers use to train models and put them into production. AMD sells chips and related computing systems through equipment makers, distributors and retail channels, and contracts with outside foundries to fabricate its semiconductor designs. It was founded in 1969 and has its headquarters in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
1969

Recently Posted Jobs

Explore more opportunities at AMD

See more jobs