C

CoreWeave

Rents GPU cloud computing for AI developers

Senior Software Engineer 2 - AI Workload Orchestration

Backend EngineeringUpdated on Nov 13
Full-timeIn-person

About the Job

Requirements

  • 5–8 years of professional software engineering experience in distributed systems, cloud infrastructure, or platform engineering.
  • Strong experience building production systems in Go; Python or C++ is a plus.
  • Solid understanding of Kubernetes fundamentals, APIs, controllers, and operating services in production.
  • Experience working with scheduling, resource management, or quota-based systems.
  • Ability to improve system reliability and performance using data and operational metrics.
  • Ability to own production services and participate in on-call rotations.
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field.

Responsibilities

  • Design, build, and operate Kubernetes-native services for AI workload orchestration and scheduling.
  • Own one or more platform components end-to-end, including design, implementation, testing, and on-call support.
  • Improve scheduling latency, cluster utilization, and workload reliability through metrics-driven engineering.
  • Contribute to architectural discussions across services and influence design decisions within the platform.
  • Work with adjacent teams, including CKS, infrastructure, and managed inference, to ensure clean interfaces and integrations.
  • Mentor junior engineers and raise the quality bar for code, design, and operations.

Desired Qualifications

  • Experience with Kubernetes-native orchestration frameworks such as Kueue, Volcano, Ray, Kubeflow, or Argo Workflows.
  • Familiarity with GPU-based workloads, ML training, or inference pipelines.
  • Knowledge of scheduling concepts such as quota enforcement, pre-emption, and backfilling.
  • Experience with reliability practices including SLOs, alerting, and incident response.
  • Exposure to AI infrastructure, HPC, or large-scale distributed compute environments.

About the Company

CoreWeave

Rents GPU cloud computing for AI developers

CoreWeave rents cloud computing to AI labs and businesses that train models and run them in production for research and commercial applications. Its platform combines NVIDIA graphics chips, storage, networking, and software built for demanding AI workloads across connected clusters scaled to fit each project. CoreWeave Forge connects tools for tracking experiments, testing models, and improving AI systems using feedback from production. Customers rent computing capacity through committed contracts or usage charges, while managed services handle the infrastructure needed to keep large workloads running. CoreWeave was founded in 2017 and is headquartered in Livingston, New Jersey.

Company size
1,001-5,000
Company stage
IPO
Headquarters
Livingston, NJ
Founded
2017

Recently Posted Jobs

Explore more opportunities at CoreWeave

See more jobs