A

Abaka AI

AI data lifecycle and annotation platform

Quality Project Associate

Manual & Functional QAPosted on Nov 12
Full-timeMountain View, CA, USAHybrid

About the Job

Requirements

  • Have 0 to 2 years of experience in quality assurance, data annotation, evaluation, research, project operations, or a related field; relevant internships and academic projects count.
  • Apply rubrics consistently, explain scores using task evidence, and identify ambiguous instructions.
  • Communicate clearly in writing and provide constructive feedback to trainers and reviewers from diverse backgrounds.
  • Use spreadsheets to filter review results, calculate basic quality metrics, and identify patterns.
  • Manage review deadlines and adapt when client requirements change.

Responsibilities

  • Review samples of trainer submissions against campaign rubrics and approved examples, recording each issue, its severity, and supporting evidence.
  • Give trainers actionable feedback identifying needed changes and relevant guidelines, then review corrected submissions to confirm resolution.
  • Support screener and pilot reviews by scoring sample tasks, checking scores against approved reference answers, and flagging ambiguous criteria before production.
  • Prepare examples for reviewer calibration sessions, compare reviewers’ scores on the same work, and document decisions for consistent application.
  • Track pass rates, rework rates, and recurring errors in Airtable or spreadsheets; summarize trends for project leads and distinguish isolated mistakes from issues affecting multiple trainers.
  • Escalate quality issues that could affect delivery; work with Training and Project Operations to update guidance, share examples, and check whether errors recur in later batches.

Desired Qualifications

  • Familiarity with Airtable, Slack, or annotation platforms.
  • Experience with AI data evaluation.
  • Proficiency in an additional language.

About the Company

Abaka AI

AI data lifecycle and annotation platform

Abaka AI helps companies build AI by handling data and infrastructure for large-scale AI systems. It offers end-to-end data processing across the AI data lifecycle, including data collection, cleaning, annotation, training support, and model evaluation for multimodal data. Its Abaka Forge Platform uses AI-driven pre-labeling and automation, plus a network of over one million annotators and multi-tier verification to ensure quality, and it also provides embedded data professionals to support client workflows. The company aims to deliver scalable, well-labeled training data for models like large language models and other AI systems, serving sectors such as automotive AI, generative AI, and embodied AI.

Company size
201-500
Company stage
Early VC
Total funding
$8M
Headquarters
Palo Alto, CA
Founded
2019

Recently Posted Jobs

Explore more opportunities at Abaka AI

See more jobs