Simplify Logo

Full-Time

Director of AI Model Evaluation & Quality Validation

Llms & Generative AI

Confirmed live in the last 24 hours

Truveta

Truveta

201-500 employees

Provides comprehensive electronic health record data

Data & Analytics

Compensation Overview

$230k - $260kAnnually

+ Incentive Pay + Stock Options

Senior

Seattle, WA, USA

Category
Applied Machine Learning
Natural Language Processing (NLP)
AI & Machine Learning
Required Skills
Python
Tensorflow
Pytorch
Natural Language Processing (NLP)
Requirements
  • Master's or Ph.D. in Computer Science, Machine Learning, Artificial Intelligence, or a related field
  • 7+ years of experience in machine learning, with a focus on natural language processing and large language models
  • Strong programming skills in Python and experience with machine learning frameworks such as TensorFlow, PyTorch, or similar
  • Familiarity with performance evaluation metrics and techniques for LLMs
  • Excellent analytical and problem-solving skills
  • Ability to communicate complex technical concepts to non-technical stakeholders
Responsibilities
  • Evaluate the performance of AI models that leverage Large Language Models (LLMs) in various applications
  • Develop and implement metrics to measure the accuracy, efficiency, and overall effectiveness of LLM-based AI models
  • Conduct thorough analyses to identify strengths and weaknesses in model performance
  • Provide detailed reports and recommendations to improve model accuracy, efficiency, and scalability
  • Collaborate with the development team to refine and enhance AI models based on evaluation results
  • Stay up-to-date with the latest advancements in machine learning, NLP, and LLMs to ensure our models remain at the forefront of the industry
  • Ensure that models meet business requirements and deliver tangible value to our clients

Truveta delivers comprehensive and up-to-date electronic health record (EHR) data, including clinician notes, images, claims, social determinants of health (SDOH), and mortality data, providing a complete view of each patient. Their technology empowers researchers to enhance patient care, accelerate research and development (R&D), and inform public policy.

Company Stage

Series C

Total Funding

$100M

Headquarters

null, Washington

Founded

2020

Growth & Insights
Headcount

6 month growth

10%

1 year growth

14%

2 year growth

100%

Benefits

Competitive Compensation

Comprehensive Benefits

401(k)

Professional Development

Work/Life Autonomy

Flexible Time Off

Generous Parental Leave

Team Activities