X

xAI

Generative AI chatbot leveraging real-time data

Human Data Engineer

Natural Language Processing & LLMsUpdated on Nov 10
Full-timePalo Alto, CA, USA

About the Job

Requirements

  • At least 2 years of professional software engineering experience building and shipping production tools or data systems used by others, such as annotation, data quality, evaluation, or human-in-the-loop tooling.
  • A bachelor's degree in engineering, computer science, or a STEM discipline, or at least 4 years of experience in lieu of a degree.
  • Experience collaborating with cross-functional teams, including engineering, research, product, or annotation and operations groups.
  • Experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems.

Responsibilities

  • Partner with model and engineering teams to understand needs and translate them into high-value data projects and evaluation strategies.
  • Own end-to-end delivery of critical data and evaluation projects that capture meaningful training signals and support rapid model development.
  • Build tools and systems to measure data effectiveness, including data yield, evaluation lift, and usage, and run evaluations to continuously improve quality.
  • Maintain rigorous data integrity and truthfulness, including validation processes for factual accuracy, prioritizing quality over quantity.
  • Research, implement, and evaluate techniques for data collection, annotation, generation, and multimodal integration.
  • Shape Grok’s behavior and domain performance through targeted data work.
  • Design and improve annotation workflows, labeling interfaces, and related tools with a focus on data quality and integrity.
  • Act as a liaison between engineering, technical staff, and tutoring and Human Data teams to drive alignment and knowledge sharing.
  • Collaborate with Human Data Ops and stakeholders to scale projects, share learnings, contribute to demand forecasting, and report status, insights, and blockers for rapid decisions.

Desired Qualifications

  • A master's degree or higher in a relevant technical field.
  • Direct experience curating, evaluating, or improving training or evaluation datasets for large language models or other AI/ML systems.
  • Experience designing, supporting, or optimizing annotation tools, labeling interfaces, or data workflows that prioritize factual accuracy and data integrity.
  • Familiarity with multimodal data, such as text, images, or code, or domain-specific data such as science, mathematics, programming, or recent events.
  • Experience conducting model or dataset evaluations focused on quality, truthfulness, or alignment with product goals.
  • Experience in a scripting language such as Python.
  • Experience in SQL or other data analysis tools.
  • Weekend work may be required.
  • Travel to other SpaceXSI sites may be required.

About the Company

xAI

Generative AI chatbot leveraging real-time data

xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.

Company size
1,001-5,000
Company stage
Series E
Total funding
$42.1B
Headquarters
Palo Alto, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at xAI

See more jobs