P

Plenful

SaaS platform automating pharmacy workflows

Senior Machine Learning Engineer

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-time$146k - $207.5k /yr

About the Job

Requirements

  • At least 5 years of experience building and shipping software or machine-learning systems, including at least 2 years working with LLM-based systems in production.
  • Strong proficiency in Python, PyTorch, and Hugging Face Transformers.
  • Hands-on experience with agent frameworks such as LangGraph, retrieval-augmented generation, and vector search tools such as Pinecone.
  • Experience fine-tuning an LLM or vision-language model and explaining the measured improvement.
  • Experience building an evaluation harness and calibrating LLM-as-judge systems, with awareness of the limitations of accuracy alone.
  • Comfort working with large-scale datasets, databases, and data pipelines.
  • Experience with traditional machine learning and judgment about when simpler models are preferable to LLMs.
  • Use the minimum data necessary and de-identified or synthetic data where suitable.
  • Follow HIPAA requirements and Plenful's security and AI usage practices when building, testing, and logging.
  • Regularly use new models and coding agents, test them on real problems, and demonstrate practical evaluations or opinions.
  • Rapidly develop working prototypes and demonstrate shipped projects, open-source work, write-ups, or evaluations of new releases.

Responsibilities

  • Design, build, and operate production agents that use tools, retrieval, and multi-step reasoning to complete healthcare workflows end to end.
  • Build agent orchestration, tracing, and failure recovery to maintain reliability with messy inputs.
  • Determine whether each problem calls for an agent, a model, or a deterministic rule, and route low-confidence cases to a person.
  • Fine-tune and post-train LLMs and vision-language models for healthcare tasks using supervised fine-tuning, preference optimization, and distillation.
  • Choose between prompting, retrieval, and fine-tuning for each problem, and validate the choice with data.
  • Balance quality, latency, and cost when serving models.
  • Build and version labeled datasets, golden sets, and synthetic data derived from production signals.
  • Write evaluations that catch regressions, including automated graders, LLM-as-judge calibrated against human labels, and regression suites running in CI.
  • Instrument production with tracing, drift detection, and failure taxonomies, and use findings to improve training data.
  • Maintain reproducible releases using MLOps tools such as Docker, Kubernetes, MLflow or equivalent, and CI/CD.
  • Ship a change to a production agent or model within the first 30 days.
  • Own the evaluation suite and improvement loop for a workflow by day 90 and improve its quality metrics.

Desired Qualifications

  • Healthcare data experience, including EHR, FHIR, claims, or prior authorization.
  • Document AI or vision model experience.
  • Experience serving and training at scale with tools such as vLLM, FSDP, or DeepSpeed.
  • Experience working in another regulated, high-stakes domain.

About the Company

Plenful

SaaS platform automating pharmacy workflows

Plenful automates pharmacy operations by offering a SaaS platform that connects with existing data sources like Electronic Health Records (EHRs) and Pharmacy Management Systems (PMSs) to streamline workflows. Its system centralizes data and uses a mix of AI and rules-based logic, along with proprietary OCR, to automate manual tasks and reduce errors. The platform provides pre-configured workflows built from industry best practices and requires zero-code integration, making it easy to deploy within healthcare settings. Compared to generic automation tools, Plenful focuses specifically on healthcare and pharmacy operations, helping clients improve financial, operational, and care-related ROI through increased efficiency and data accuracy. The company’s goal is to lessen the burden on healthcare staff, optimize staffing, and offer clear transparency into operations.

Company size
51-200
Company stage
Series B
Total funding
$76M
Headquarters
San Francisco, CA
Founded
2020

Recently Posted Jobs

Explore more opportunities at Plenful

See more jobs