Software Engineer - Evals
About the job
- Software engineering proficiency and at least 3 years of experience actively writing code.
- A track record of shipping high-quality projects.
- The ability to translate notions of quality, helpfulness, truthfulness, and safety into concrete, measurable criteria.
- Strong attention to detail.
- Own and elevate the mission-critical research platform that accelerates frontier research.
- Design, build, and ship systems for engineers to use.
- Create and execute instruments for measuring model capabilities and behaviors.
- Use evaluation instruments to clean datasets, provide feedback for experiments, and track growth throughout training.
- Diagnose why agents fail and determine short- and long-term improvements.
- Manage execution infrastructure and design datasets and grading schemes.
- Previous experience founding a startup or joining a fast-growing early-stage startup.
- Familiarity with artificial intelligence and machine learning workflows, annotation tools, or evaluations.
- Experience creating and maintaining component libraries, design systems, or internal tools.
About the company
xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.
Company Size
1,001-5,000
Company Stage
Series E
Total Funding
$42.1B
Headquarters
Palo Alto, California
Founded
2023
Get referred to xAI
See people who can refer or advise you
Simplify's Take
What believers are saying
- On October 2, 2026, the Eighth Circuit paused Minnesota's anti-nudification law.
- Grok 4.7 reached Cursor, Grok Build, and the Grok API on September 21.
- January 2026's $20 billion round and public SpaceXAI listing funded massive expansion.
What critics are saying
- The NAACP and SELC keep suing over unpermitted Colossus turbines and toxic emissions.
- A June 2026 lawsuit alleges xAI fired engineer Devin Kim for safety complaints.
- Colossus 2 depends on giant power, networking, and chip deliveries; delays starve Grok.
What makes xAI unique
- Grok plugs into X's live feed, giving real-time social context competitors still lack.
- Musk's October 2026 Colossus 2 buildout targets 1.21 million Nvidia GPUs by year-end.
- xAI ships rapidly: Grok 4.5, 4.6, and 4.7 all landed in 2026.
Help us improve and share your feedback! Did you find this helpful?
Benefits
- Health Insurance
- Remote Work Options