Z

Zoox

Fully electric autonomous ride-hailing service platform

Contract Student Worker - AI Validation and Benchmarking Engineer

Manual & Functional QAConfirmed live in the last 24 hours
Part-timeFoster City, CA, USA$30 /hr

About the Job

Requirements

  • Currently enrolled in a Bachelor's or Master's program in Computer Science, Data Science, Engineering, or a related field.
  • Available to commit to a minimum three-month assignment.
  • Able to commit to a minimum of 20 hours per week.
  • Able to work on-site at one of the office locations.
  • Must adhere to confidentiality requirements, including refraining from using or sharing proprietary company information outside the company, such as in academic research, theses, publications, or presentations.
  • Familiarity with Cursor or Claude.
  • Familiarity with Python.
  • Familiarity with evaluation concepts, including precision, recall, F1 score, and confusion matrices.
  • Comfort working with structured data such as CSV and JSON.
  • Experience modifying or writing reproducible analysis scripts.

Responsibilities

  • Run and maintain the benchmark pipeline, analyzing results to identify routing errors and regressions across agent variants.
  • Build and expand ground-truth datasets used to evaluate agent outputs against known-correct answers.
  • Identify and address gaps in benchmark validation and support building more comprehensive evaluation infrastructure to improve validation prior to release.
  • Develop new evaluation dimensions, such as label accuracy and structured output correctness, beyond existing team classification benchmarks.
  • Investigate failure modes in agent outputs and work with engineers to surface actionable improvements.
  • Write scripts and tooling to automate data collection, result parsing, and metric reporting.
  • Document findings, track benchmark trends over time, and present results to the team.

Desired Qualifications

  • Prior exposure to LLM-based systems, prompt engineering, or AI agent evaluation.
  • Experience with Jira or Slack, such as ticketing systems or messaging apps.

About the Company

Zoox

Fully electric autonomous ride-hailing service platform

Zoox designs and operates an autonomous ride-hailing service built around a purpose-built, fully electric vehicle designed specifically for autonomous operation. The vehicle uses advanced sensors, cameras, and AI to navigate complex urban environments, offering a four-passenger interior for comfort. Unlike competitors that retrofit existing cars, Zoox engineers both the vehicle and the service from the ground up, enabling optimized safety, efficiency, and passenger experience through integrated software that optimizes routing and reduces wait times. The company emphasizes safety through extensive testing and regulatory collaboration, and sustainability via electric mobility. The ultimate goal is to provide a smarter, safer, and more efficient urban transportation system that improves city life while reducing emissions.

Company size
5,001-10,000
Company stage
Acquired
Total funding
$1.2B
Headquarters
Menlo Park, CA
Founded
2014

Recently Posted Jobs

Explore more opportunities at Zoox

See more jobs