C

CoreWeave

Rents GPU cloud computing for AI developers

Senior Hardware Engineer - Server Infrastructure

Hardware Systems IntegrationUpdated on Nov 13
Full-timeNo salary listedIn-person

About the Job

Requirements

  • Four years of experience working with server hardware, components, and management technologies.
  • A bachelor's degree in Computer Engineering, Electrical Engineering, Computer Science, or a related field.
  • Proficiency in Ansible or Python and hands-on experience programmatically interacting with server baseboard management controllers (BMCs) using Redfish or IPMI; Redfish is preferred.
  • Experience collaborating with hardware vendors and original equipment manufacturers (OEMs) to evaluate, qualify, and deploy server solutions.
  • Demonstrated experience supporting and troubleshooting production infrastructure, participating in on-call or escalation rotations, and driving incidents through root-cause resolution.
  • Ability to build and automate systems while also supporting infrastructure already in production.
  • Ability to stay current with technologies and trends in server and data center hardware.
  • Strong interest in automation and infrastructure scalability, with a commitment to continuous improvement.
  • Technical documentation skills and attention to detail.
  • Analytical and problem-solving abilities, with a systematic, data-driven approach.
  • Written and verbal communication skills in English, and ability to work effectively with technical teams and cross-functional stakeholders.

Responsibilities

  • Design and develop server hardware infrastructure to support high-performance workloads.
  • Automate all aspects of the server hardware lifecycle, from provisioning and configuration through firmware management, monitoring, and decommissioning.
  • Develop and maintain hardware and firmware management services to ensure reliability at scale.
  • Develop and implement monitoring and alerting for server hardware health, improving alert quality to support reliable on-call response.
  • Serve as a senior point of contact for hardware escalations, perform deep troubleshooting and root-cause analysis across hardware and firmware, and drive long-term fixes.
  • Participate in an on-call rotation for hardware escalations and improve the runbooks, alerts, and tooling that make the rotation sustainable.
  • Collaborate with cross-functional teams to define hardware requirements, specifications, and system architecture.
  • Work with server vendors and OEMs to evaluate, qualify, and deploy new platforms and resolve firmware, quality, and return merchandise authorization (RMA) issues.
  • Support new data center region bring-up and hardware qualification.
  • Analyze hardware system performance, identify bottlenecks, and implement improvements to efficiency and resilience.
  • Establish and refine processes for internal hardware testing, deployment, and performance optimization.
  • Create and maintain documentation of hardware designs, specifications, test procedures, and results.
  • Support data center operations teams and hardware technicians with troubleshooting guidance, runbooks, and training so common issues can be resolved without engineering escalation.
  • Turn recurring production failures into automation, improved telemetry, and improvements to platform design and vendor solutions.
  • Communicate status, trade-offs, and risks to engineering, operations, and customer-facing stakeholders, including during active incidents.

Desired Qualifications

  • Experience bringing up new data center regions or establishing infrastructure in a new geography.
  • Experience with graphics processing unit (GPU) platforms and rack-scale systems such as NVIDIA GB200 or GB300.
  • Experience with BMC technologies and management interfaces such as Redfish or IPMI at fleet scale.
  • Experience with firmware lifecycle management or hardware qualification programs in large-scale environments.
  • Linux systems administration and debugging skills at fleet scale.
  • Familiarity with Kubernetes-based services, observability tools such as Prometheus and Grafana, and distributed production environments.
  • Experience designing alerting, runbooks, and self-service tooling that enable operations teams to resolve common hardware failures without engineering escalation.
  • Experience supporting external customers or partners in a technical troubleshooting capacity.

About the Company

CoreWeave

Rents GPU cloud computing for AI developers

CoreWeave rents cloud computing to AI labs and businesses that train models and run them in production for research and commercial applications. Its platform combines NVIDIA graphics chips, storage, networking, and software built for demanding AI workloads across connected clusters scaled to fit each project. CoreWeave Forge connects tools for tracking experiments, testing models, and improving AI systems using feedback from production. Customers rent computing capacity through committed contracts or usage charges, while managed services handle the infrastructure needed to keep large workloads running. CoreWeave was founded in 2017 and is headquartered in Livingston, New Jersey.

Company size
1,001-5,000
Company stage
IPO
Headquarters
Livingston, NJ
Founded
2017

Recently Posted Jobs

Explore more opportunities at CoreWeave

See more jobs