K

Kinetic Systems

Reinforcement learning datasets for healthcare automation

Member of Clinical Staff

Medical ResearchUpdated on Nov 11
Full-timeSan Francisco, CA, USA$150k - $250k /yr

About the Job

Requirements

  • Must have one of the following medical degrees: MD, DO, MBBS, NP, or PA.
  • Must have at least 2 years of experience working in a real clinical environment.
  • Must have serious experience in the human data space at a frontier AI lab or human data company.
  • Must have personally built reinforcement learning environments, evaluations, or graders.
  • Must understand how data quality shapes model training, including preference data, rubric design, and rater agreement.
  • Must understand healthcare data, including electronic health record data structures, interoperability, and HIPAA considerations.
  • Must be comfortable reading and modifying environment and grader code, writing scripts to build and analyze datasets, and examining model outputs.

Responsibilities

  • Design and build evaluations that reflect real clinical work.
  • Identify gaps in frontier models' performance on real clinical workflows and turn those gaps into environments, evaluations, and benchmarks.
  • Write rubrics and guidelines that capture expert clinical judgment, especially for subjective or high-stakes answers.
  • Build gold-standard datasets, pilot new tasks, and set the quality bar for the clinician network.
  • Lead calibration with clinician raters and adjudicate the hardest cases.
  • Work with the machine learning team to translate training and evaluation needs into high-quality clinical data.
  • Write and publish papers in academic conferences.

Desired Qualifications

  • Experience with JavaScript or TypeScript, continuous integration and continuous delivery, or Amazon Web Services.
  • Experience shipping production software or digital health products.
  • Experience with clinical workflow analysis or quality improvement initiatives.
  • Experience working in Git alongside engineers, including branches, pull requests, and code review.

About the Company

Kinetic Systems

Reinforcement learning datasets for healthcare automation

Kinetic Systems builds data infrastructure for autonomous healthcare delivery, providing curated reinforcement learning environments and post-training datasets for AI researchers. Its flagship HealthAdminBench benchmarks AI agents on multi-step healthcare administrative tasks such as prior authorizations, denial appeals, and ordering durable medical equipment to tune models for real-world admin work. The company differentiates itself by focusing specifically on healthcare administration economics and by applying Stanford-origin research to improve fine-tuned models for administrative tasks rather than general clinical tasks. Its goal is to help frontier AI labs, providers, MSOs, and BPOs deploy AI that can automate back-office workflows and enable more autonomous care.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
San Francisco, CA
Founded
1973

Recently Posted Jobs

Explore more opportunities at Kinetic Systems

See more jobs