S

Savant Bio

AI Engineer - Applied AI

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeNew York, NY, USA

About the Job

Requirements

  • Five or more years of experience in applied machine learning, AI engineering, data science, or adjacent software engineering roles.
  • Excellent Python and SQL skills.
  • Hands-on experience building production applications with large language models.
  • Experience designing experiments and interpreting noisy, multidimensional results.
  • Familiarity with large language model evaluation, retrieval-augmented generation, agentic workflows, or machine learning operations.
  • Strong software-engineering fundamentals and the ability to ship reliable production code.
  • Intellectual curiosity, sound judgment, and taste.

Responsibilities

  • Establish software programming paradigms for the platform’s interactions with large language models in both token-parsimonious and token-hungry scenarios.
  • Build a test bench for understanding the cost/performance frontier of open- and closed-weight language models as it relates to the platform’s core workloads.
  • Partner with clinical experts to encode domain knowledge and define meaningful quality standards.
  • Build evaluation suites that measure accuracy, completeness, consistency, latency, and cost.
  • Design controlled experiments that isolate the effects of changes throughout the platform.
  • Improve model interactions through prompting, structured outputs, tool use, context management, and workflow composition.
  • Build datasets and internal tools for evaluation, regression testing, and rapid iteration.
  • Study how changes throughout the pipeline affect system performance, then design and ship improvements across LLM interactions, retrieval, ranking, supporting-information assembly, workflow control, output validation, and repair.

Desired Qualifications

  • Knowledge of statistical inference, experimental design, or human-in-the-loop evaluation.
  • Experience building evaluation platforms, experiment tooling, or model-observability systems.
  • Familiarity with information retrieval, search, ranking, entity resolution, or knowledge systems.
  • Experience with clinical data, medical terminology, or other healthcare data.
  • Familiarity with HIPAA, de-identification, or quality controls for high-stakes data.
  • Experience in an early-stage startup or small, fast-moving technical team.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Savant Bio

See more jobs