X

xAI

Generative AI chatbot leveraging real-time data

Senior Software Engineer - Data Engineering, X

Data EngineeringConfirmed live in the last 24 hours
Full-timePalo Alto, CA, USAIn-person

About the Job

Requirements

  • At least 5 years of professional software engineering experience.
  • Experience with Python, Rust, Scala, Go, or Java, as well as data pipeline tooling and distributed systems.
  • Software engineering experience in data engineering or distributed systems is preferred.
  • Knowledge of real-time and batch data-processing tools such as Spark, Kafka, Flink, SQL, and storage systems in RDBMS or NoSQL is preferred.
  • Experience solving large-scale problems and doing incremental quality work while building new systems to enable future quality improvements is preferred.
  • A proven record of interpreting product requirements into engineering implementation plans and communicating effectively with AI, product, marketing and sales, and engineering groups is preferred.

Responsibilities

  • Design, build, and operate production-grade real-time and batch pipelines that ingest, process, validate, and deliver data for user-behavior insights and product decisions.
  • Create shared datasets, fact tables, and internal data products that enable other teams to analyze, debug, and improve product performance.
  • Prototype and build tools that automate and accelerate internal data workflows, including backfills, dashboards, report generation, and self-service data access.
  • Own data correctness end to end by validating output invariants, reconciling denominators, independently recomputing results, and leading root-cause investigations when key metrics move unexpectedly.
  • Work across query engines and frameworks, including BigQuery, Trino, ClickHouse, Flink, Kafka, Spark, and Scalding, selecting appropriate tools and adapting to new infrastructure and environments.
  • Partner with product and business teams to identify data gaps and prioritize high-impact opportunities for new data acquisition and improvement.
  • Iterate on feedback and ship useful increments with a focus on efficient, accurate, and reliable solutions.

About the Company

xAI

Generative AI chatbot leveraging real-time data

xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.

Company size
1,001-5,000
Company stage
Series E
Total funding
$42.1B
Headquarters
Palo Alto, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at xAI

See more jobs