X

xAI

Generative AI chatbot leveraging real-time data

Human Data Manager

AI & Machine LearningUpdated on Nov 10
Full-timePalo Alto, CA, USA

About the Job

Requirements

  • A bachelor's degree, or at least 4 years of relevant experience in lieu of a degree.
  • At least 2 years of professional experience owning and running human data, annotation, data quality, or evaluation programs that deliver training data used by research or engineering teams.
  • Experience collaborating with cross-functional teams, including engineering, research, product, or annotation and operations groups.
  • Experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems.

Responsibilities

  • Partner with model and engineering teams to understand needs and translate them into high-value data projects and evaluation strategies.
  • Own end-to-end delivery of critical data and evaluation projects that capture meaningful training signals and support rapid model development.
  • Leverage AI agents and existing platforms to measure data effectiveness and quantify impact, including data yield, evaluation lift, and usage.
  • Maintain rigorous data integrity and truthfulness, including validation processes for factual accuracy, and prioritize quality over quantity.
  • Research and apply techniques for data collection, annotation, generation, and multimodal integration.
  • Shape Grok’s behavior and domain performance through targeted data work, and improve annotation workflows using agents and no-code or low-code approaches where helpful.
  • Manage plans that shape model behavior through data management, optimization, and analysis, including resources and timelines.
  • Act as a liaison between engineering, technical staff, and tutoring and Human Data teams to drive alignment and knowledge sharing.
  • Collaborate with Human Data Ops and stakeholders to scale projects, share learnings, and contribute to demand forecasting; report status, insights, and blockers to support rapid decisions.

Desired Qualifications

  • A bachelor's degree or higher in engineering, computer science, data analysis, or a related STEM discipline.
  • Direct experience curating, evaluating, or improving training or evaluation datasets for large language models or other AI/ML systems.
  • Experience designing, supporting, or optimizing annotation workflows or data processes that prioritize factual accuracy and data integrity.
  • Familiarity with multimodal data, such as text, images, or code, or domain-specific data such as science, mathematics, programming, or recent events.
  • Experience with model or dataset evaluations focused on quality, truthfulness, or alignment with product goals.
  • Comfort using AI agents, no-code or low-code tools, or light scripting such as Python to prototype workflows and measurement.
  • Experience with SQL or other data analysis tools.

About the Company

xAI

Generative AI chatbot leveraging real-time data

xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.

Company size
1,001-5,000
Company stage
Series E
Total funding
$42.1B
Headquarters
Palo Alto, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at xAI

See more jobs