X

xAI

Generative AI chatbot leveraging real-time data

Manager – Supercomputer Site Reliability Engineering

Engineering LeadershipUpdated on Nov 15
Full-timeNo salary listed

About the Job

Requirements

  • A bachelor's degree and 3+ years of experience working in large-scale operations, with 2+ years leading people leaders of technical teams; alternatively, 10+ years of experience working in large-scale operations, with 5+ years leading people leaders of technical teams.
  • Deep expertise in server hardware, cluster reliability, and data center technologies, from deployment through lifecycle management.
  • Experience supporting compute-heavy environments such as artificial intelligence, machine learning, or high-performance computing at scale.
  • Experience owning uptime, Service Level Agreements, or reliability metrics for large compute clusters.
  • Experience leading site reliability engineering or equivalent reliability-focused teams, including root cause analysis and procedure ownership.
  • Strong analytical skills and the ability to explain technical concepts clearly to technicians, executive audiences, and tenant partners.
  • Experience partnering with vendors at scale, reducing mean time to repair, and scaling operations across multiple sites.
  • Familiarity with Jira, Python, and Bash for monitoring cluster health and improving team efficiency.
  • Willingness to travel frequently to data center locations across sites.
  • Physical capability to handle data center tasks, including lifting up to 50 pounds unassisted, standing for long periods, and occasional ladder use.
  • Willingness to work extended hours and/or weekends as needed.

Responsibilities

  • Serve as the senior operational authority for the SRE organization and represent production reliability concerns in engineering and leadership discussions.
  • Lead an integrated supercomputer systems engineering reliability team responsible for reactive and increasingly proactive cluster and facilities health and reliability initiatives.
  • Build site reliability engineering sub-teams for compute hardware failure analysis, software tools, cluster monitoring, and integrated site reliability engineering.
  • Drive operational superiority.
  • Define the SRE organizational structure and develop a culture of 24/7 operational excellence.
  • Reduce anomaly response times to physical limits and establish robust proactive health processes.
  • Define on-call responsibilities, incident management protocols, leadership structure, and communication discipline.
  • Develop training schemes for monitoring and response teams.
  • Establish operational interfaces with data center operations, engineering teams, vendors, and other service owners.
  • Own vendor oversight and accountability mechanisms.
  • Drive mean time to repair toward physical limits.
  • Define and continuously improve operational procedures and analysis documentation mechanisms, emphasizing intelligent automation.
  • Improve documentation workflows.
  • Ensure efficient signal-to-noise ratio in execution.
  • Define operational targets, health indicators, alerting standards, and incident severity definitions to provide measurable team performance insights and accountability.
  • Drive high technical standards for hardware root cause analysis and remediation teams, ensuring strong hardware failure diagnostic expertise.
  • Integrate with platform engineering teams to develop hardware and system understanding that improves operational reliability.
  • Minimize repeat hardware issues and lead automation efforts to eliminate manual overhead for unavoidable remediation.

Desired Qualifications

  • Proven ability to lead large, multi-site, 24/7 operations organizations in fast-paced, high-responsibility settings.
  • Enthusiasm for SpaceXSI's mission to accelerate human discovery and unravel the universe.
  • Ability to thrive in a dynamic, mission-focused environment with on-call ownership of cluster-impacting events.

About the Company

xAI

Generative AI chatbot leveraging real-time data

xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.

Company size
1,001-5,000
Company stage
Series E
Total funding
$42.1B
Headquarters
Palo Alto, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at xAI

See more jobs