Lead - Annotation Quality & Performance

Frontera Health is seeking a Clinical QA & Performance Lead to build and lead the quality systems behind our clinical annotation function. This team is responsible for labeling high-fidelity behavioral health data (video, audio, and text) that directly powers our AI models and clinical product insights.

This role is equal parts quality architect, measurement analyst, and clinical systems thinker. You’ll define what “good” looks like, build processes to track it, and ensure that the work we produce meets our clinical and scientific bar. You’ll work closely with our Ops, ML, and Clinical teams to ensure that ambiguity is resolved quickly, feedback is integrated thoughtfully, and performance continuously improves.

This is a hands-on leadership role with room to shape the future of clinical data quality at Frontera.

What You’ll Do

• Own definition and implementation of quality metrics (IOA / inter-rater agreement, audit scores, reviewer calibration)
• Build and maintain gold-standard datasets to serve as training and validation anchors
• Design QA workflows that balance precision, scale, and reviewer experience
• Lead reviewer onboarding and training systems, including calibration exercises and ongoing development
• Track performance across annotators and reviewers; flag drift and recommend coaching or retraining
• Partner closely with Ops Manager to align QA expectations with throughput goals
  Serve as a bridge between clinical subject matter experts, ML teams, and annotators to clarify labeling standards
• Monitor quality trends over time and drive continuous process improvement
• Facilitate periodic audits and synthesize findings into actionable recommendations
  
  

What You’ll Bring

• 4+ years experience in clinical QA, annotation QA, clinical operations, or healthcare analytics
• Familiarity with behavioral health, healthcare research, or human-annotated datasets
• Strong understanding of IOA/IRR concepts and metrics (e.g., Cohen’s or Fleiss’ kappa)
• Experience building or managing QA systems in data labeling, research, or clinical settings
• Analytical mindset with comfort using tools to track trends, measure performance, and drive change
• Excellent communication and training skills—able to support both junior annotators and senior stakeholders
• Thoughtful, systems-oriented approach to ambiguity, edge cases, and clinical nuance
• Bonus: Experience with tools like Label Studio or working in an ML-adjacent environment
  
  

Why Frontera 

At Frontera, you’ll be part of a mission-driven team using structured clinical data to reimagine pediatric therapy. Your work will directly shape the quality and reliability of the data behind our models—and by extension, the care we deliver to families.

Join us in building the future of developmental healthcare!