H

hims & hers

Connects patients to online medical care

Senior Staff Machine Learning Systems Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeRemote in USARemote

About the Job

Requirements

  • At least 10 years of experience in machine learning infrastructure, data engineering, or evaluation/testing systems, with impact beyond a single team or project.
  • Hands-on depth designing and calibrating large language model judges and scorers, building statistically sound regression-testing methodology (including paired significance testing with correction for multiple comparisons), measuring agreement against human labels, and designing adversarial or red-team evaluation approaches.
  • Hands-on depth in data pipeline engineering, including dataset versioning, feature and benchmark pipelines, labeling and calibration workflows, and high-throughput ingestion and transformation systems.
  • A history of building approaches that became standards for a broader group, changing how people tackle a category of problem.
  • Experience leading multi-team projects to completion, including navigating and resolving technical disagreements.
  • A track record of mentoring engineers, including senior engineers, and raising the technical bar of teams.
  • Strong communication skills, including adapting ideas to different audiences and building support before launch.
  • Strong Python skills and statistical fluency sufficient to design and defend a testing framework used for production decisions.

Responsibilities

  • Set technical direction for evaluation systems, including metric, judge, and scorer design, statistical methodology for regression decisions, and infrastructure that tracks and categorizes failures over time.
  • Design and scale data pipelines for ingestion, transformation, dataset versioning, labeling, and calibration that support evaluation and downstream data science.
  • Proactively address challenges in scaling and complexity of AI evaluation.
  • Define evaluation approaches for new AI services and drive multi-team initiatives, including replacing inconsistent manual reviews with statistically sound automated gates.
  • Own adversarial and red-team evaluation as a risk-reduction program by designing test suites and failure taxonomies to detect safety and edge-case issues before they reach patients.
  • Resolve complex cross-team technical disagreements and drive alignment across engineering, product, and AI leaders.
  • Develop new approaches and methodologies into reusable standards rather than one-off fixes.
  • Take vague cross-team problems from initial idea through specification and delivery of a complete production system.
  • Lead major platform improvements, including re-architecting core systems, removing brittle logic, and modernizing systems with organization-wide impact.
  • Build working relationships across machine learning engineering, data science, platform engineering, clinical, legal, and product teams.
  • Share evaluation methodology and data pipeline design through internal talks and written materials that other teams can use.
  • Mentor engineers, including experienced engineers, and help raise the technical and statistical bar of teams.

Desired Qualifications

  • Experience with Databricks, MLflow, Unity Catalog, or similar data and evaluation platforms.
  • Experience building reporting tools for people without direct engineering access, such as automated Slack digests or spreadsheet reports for non-technical teams.
  • Prior experience in a regulated industry such as healthcare, fintech, or life sciences.
  • A track record of company-wide talks or written materials that changed how other teams approached a problem.

About the Company

hims & hers

Connects patients to online medical care

Hims & Hers operates a consumer health platform that connects people with licensed providers for online consultations and ongoing care. Its Hims and Hers brands give customers access to services for hair loss, sexual health, mental health, skin care, and weight management, alongside prescription and nonprescription products. Providers assess patients and make treatment decisions, while the group coordinates digital records, follow-up, and fulfillment through owned and partner pharmacies. Revenue comes from product sales and subscriptions that combine recurring shipments with access to care. Hims & Hers was founded in 2017 and is headquartered in San Francisco, California.

Company size
1,001-5,000
Company stage
Post IPO Equity
Headquarters
San Francisco, California
Founded
2017

Recently Posted Jobs

Explore more opportunities at hims & hers

See more jobs