X

xAI

Generative AI chatbot leveraging real-time data

Director, Site Operations

Site Reliability EngineeringConfirmed live in the last 24 hours
Full-timeMemphis, TN, USANo salary listed

About the Job

Requirements

  • A bachelor's degree and 7+ years of experience working in large-scale operations, with 5+ years leading people leaders of technical teams; alternatively, 10+ years of experience working in large-scale operations, with 5+ years leading people leaders of technical teams.
  • Proven ability to lead large, multi-site, 24/7 operations organizations in fast-paced, high-responsibility settings.
  • Deep expertise in server hardware, cluster reliability, and data center technologies, from deployment through lifecycle management.
  • Experience supporting compute-heavy environments such as artificial intelligence, machine learning, or high-performance computing at scale.
  • A track record of owning uptime, Service Level Agreements, or reliability metrics for large compute clusters.
  • Experience leading site reliability engineering or equivalent reliability-focused teams, including root cause analysis and procedure ownership.
  • Strong analytical skills and the ability to explain technical concepts clearly to technicians, executives, and tenant partners.
  • A history of partnering with vendors at scale, reducing mean time to repair, and scaling operations across multiple sites.
  • Familiarity with Jira, Python, and Bash tooling and automation used to monitor cluster health and improve team efficiency.
  • Willingness to travel frequently to data center locations to support operations across sites.
  • Physical capability to handle data center tasks, including lifting up to 50 pounds unassisted, standing for long periods, and occasional ladder use.
  • Must be willing to work extended hours and/or weekends as needed.

Responsibilities

  • Own node, rack, and cluster health across 5+ sites operating 24/7, remain accountable for customer Service Level Agreements, and maintain exceptional uptime on the supercompute cluster.
  • Lead a 250+ person operations organization spanning site managers, shift supervisors, and technicians across four 24/7 shifts, building a culture of excellence and accountability.
  • Ensure systematic recovery of failed nodes and racks through command-line and physical intervention, reducing mean time to repair to the feasible minimum.
  • Coordinate with facilities operations to limit downtime from power and cooling faults and proactive maintenance; coordinate with network engineering on cluster upgrades; and work with tenant representatives on node remediation and planned and unplanned downtime.
  • Direct vendors through hardware rework and field operations so repairs, replacements, and capacity work meet cluster needs.
  • Lead the site reliability engineering organization responsible for proactive cluster health monitoring, reactive fault mitigation at scale, root cause analyses for node, rack, and cluster issues, and site-wide reliability procedures and fault documentation.
  • Lead continual improvement and efficiency initiatives using operational data to balance team resources and improve uptime, repair time, and Service Level Agreement performance across sites.
  • Set the standard for incident response during cluster-impacting events, providing clear direction, fast recovery, and communication with internal and external partners.
  • Standardize best practices across sites and grow the organization in step with cluster expansion to maintain consistent operations as the footprint scales.

Desired Qualifications

  • Enthusiasm for SpaceXSI's mission to accelerate human discovery and unravel the universe.
  • Ability to thrive in a dynamic, mission-focused environment with on-call ownership of cluster-impacting events.

About the Company

xAI

Generative AI chatbot leveraging real-time data

xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.

Company size
1,001-5,000
Company stage
Series E
Total funding
$42.1B
Headquarters
Palo Alto, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at xAI

See more jobs