A

Atria Health and Research Institute

Personalized preventive medicine practice and research

Senior AI Engineer

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeRemote in USARemote

About the Job

Requirements

  • Hands-on experience building and operating LLM-powered or production machine learning systems for at least 4 years.
  • Strong Python skills and deep familiarity with at least one production backend framework, such as FastAPI or Flask.
  • Hands-on experience with LLM orchestration, function/tool calling, and retrieval system design, including chunking, hybrid search, and reranking.
  • Working knowledge of a cloud data warehouse and modern data tooling such as dbt, Dagster, or Airflow; Snowflake is strongly preferred.
  • A track record of designing evaluation systems for LLM applications.
  • Familiarity with safety considerations for LLM applications, including guardrails, adversarial testing, and failure modes.
  • Practical understanding of HIPAA, business associate agreements, protected health information handling, and regulated environments.
  • Strong written communication skills for design documents, technical RFCs, and documentation.

Responsibilities

  • Architect and ship production AI systems end-to-end, including orchestration, retrieval, inference, evaluation, and monitoring, for clinical decision support, document understanding, and agentic medical companions.
  • Design agentic workflows with custom skills and harnesses, using frontier LLMs and self-hosted models where appropriate.
  • Lead development of structured information extraction pipelines from clinical documents, including automated verification systems and human-in-the-loop gates where necessary.
  • Build evaluation infrastructure, including golden datasets, LLM-as-judge, regression tests, and online A/B evaluation, to gate model and prompt changes; measure accuracy, safety, cost, and latency.
  • Engineer for latency and cost through streaming, caching, prompt compression, model routing, and inference-cost budgets.
  • Own production health through trace- and span-level observability, prompt versioning, drift detection, cost monitoring, replay-from-production debugging, and PHI-safe logging.
  • Operationalize models trained by the AI Scientist team, including serving, production evaluation, rollback paths, and feedback loops that turn usage into training and evaluation data.
  • Partner with clinicians, the data engineering team, and research collaborators to translate clinical requirements into specifications and deliverable systems.
  • Educate and mentor PMs and engineers on applied AI best practices, including prompt and evaluation design and model selection.
  • Set technical direction for AI engineering, including architecture decisions, build-versus-buy decisions, and evaluation and observability standards.
  • Raise engineering practices in code review, observability, and incident response.
  • Drive vendor and partner technical due diligence for AI/ML vendors, including business associate agreement scope, PHI handling, sub-processor obligations, and intellectual property terms.
  • Mentor other AI engineers through code review, design documents, and architecture decisions.

Desired Qualifications

  • Experience in healthcare, clinical informatics, or other regulated domains such as finance or biotechnology.
  • Familiarity with medical ontologies including LOINC, SNOMED CT, ICD-10, and RxNorm, and clinical data standards including FHIR and HL7.
  • Experience with self-hosted model serving such as vLLM, Triton, TGI, or SGLang, and inference optimization.
  • Multimodal experience with vision, structured data, or time-series data alongside text.

About the Company

Atria Health and Research Institute

Personalized preventive medicine practice and research

Atria Health and Research Institute delivers personalized preventive medicine through a membership-based clinical practice, while its nonprofit think tank, the Atria Research and Global Health Institute, advances preventive medicine through original research and strategic partnerships. How it works: it combines longitudinal studies with evidence-based, individualized care to move from reactive sick care to proactive prevention; it asks, “What is biologically possible?” and translates leading science into medical practice for patients. How it differs: it integrates a clinical practice with a global research effort focused on closing gaps in care, emphasizing collaboration, real-world implementation, and broad access to prevention-based medicine, rather than just offering standard treatment. Goal: prevent disease and extend healthy life for all by turning cutting-edge science into practical, scalable medical care.

Company size
201-500
Company stage
Not listed
Total funding
Not listed
Headquarters
New York City, New York
Founded
2022

Recently Posted Jobs

Explore more opportunities at Atria Health and Research Institute

See more jobs