R

Ro

Online telemedicine platform with prescription delivery

Senior Engineer - Applied AI

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeNew York, NY, USAHybrid

About the Job

Requirements

  • At least 5 years of experience building production software, including at least 1–2 years building and deploying production LLM-powered applications, or equivalent depth through substantial side projects or open-source work.
  • Strong Python engineering skills and experience building backend services and integrating modern AI APIs and frameworks.
  • Comfort using AI-assisted development tools throughout the software development lifecycle.
  • Experience shipping AI features to real users and articulating how quality, reliability, latency, cost, and business impact were measured.
  • Strong product instincts and ability to work in ambiguous environments, translating operational problems into technical solutions without detailed specifications.

Responsibilities

  • Design, build, and ship production LLM-powered features end-to-end.
  • Build the AI application layer, including prompt orchestration, tool calling, retrieval-augmented generation, embeddings, agent workflows, and structured outputs.
  • Develop evaluation infrastructure, including regression suites, LLM-as-a-judge evaluations, synthetic datasets, human review workflows, and quality metrics to detect regressions before users do.
  • Design observability systems that measure accuracy, latency, cost, hallucination rates, and model behavior in production.
  • Build safety and reliability guardrails to ensure AI systems meet quality, compliance, and operational requirements.
  • Evaluate and integrate third-party tools, including orchestration frameworks, evaluation platforms, vector databases, and model providers, and make build-versus-buy decisions.
  • Raise engineering standards across the team through technical leadership, code reviews, mentorship, and thoughtful system design.
  • Work with EHR operators, Patient Advocates, and clinical teams to understand the workflows being automated.
  • Prototype quickly, ship early, measure outcomes, and iterate based on real-world usage.

Desired Qualifications

  • Experience with orchestration frameworks such as LangChain, LangGraph, and AgentCore; retrieval-augmented generation architectures; vector databases; prompt/version management; and evaluation or observability platforms such as LangSmith, Braintrust, and Arize Phoenix.

About the Company

Ro

Online telemedicine platform with prescription delivery

Ro.co is a telemedicine platform enabling adults to manage health from home. Patients complete online visits; US-licensed clinicians review symptoms and history, provide diagnosis, and offer personalized treatment recommendations. If a prescription is needed, Ro.co ships medications in discreet packaging with free shipping. The service emphasizes privacy and security, delivering care from online consultation to prescription delivery.

Company size
1,001-5,000
Company stage
Late Stage VC
Total funding
$1B
Headquarters
New York City, New York
Founded
2017

Recently Posted Jobs

Explore more opportunities at Ro

See more jobs