L

Lumos AI Research

Data infrastructure for health AI safety

Senior Software Engineer - RL Environments & Sandboxes

Backend EngineeringConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USAHybrid

About the Job

Requirements

  • At least 5 years of software engineering experience, or equivalent evidence of exceptional engineering ability.
  • Excellent Python skills and strong fundamentals in algorithms, data structures, systems design, and software architecture.
  • Hands-on experience with Docker, Linux, containers, process isolation, or sandbox execution.
  • Strong understanding of distributed systems, asynchronous execution, state management, and reliability.
  • Experience designing complex APIs, backend systems, and integrations.
  • Ability to independently architect, build, debug, and ship sophisticated technical systems.

Responsibilities

  • Design and implement realistic, stateful environments that reproduce complex workflows across healthcare, biology, and scientific software.
  • Build isolated, reproducible execution environments supporting agent-generated code, tool calls, filesystem operations, and application interactions.
  • Work with scientists and automation engineers to integrate laboratory instruments, robotic liquid handlers, experimental protocols, and biological readouts into agent-accessible workflows.
  • Implement MCP servers, APIs, and interfaces that enable agents to interact with software applications, scientific instruments, and simulated systems.
  • Develop deterministic initialization, snapshot/restore, state transitions, resets, and execution replay.
  • Translate real-world workflows into executable tasks with clear success criteria, ground-truth states, and programmatic verification.
  • Build orchestration infrastructure for high-throughput parallel rollouts, supporting simulated environments and physical experiments with appropriate execution controls.
  • Develop, integrate, and validate environments using Harbor-compatible task structures, execution harnesses, and evaluation workflows.
  • Identify unrealistic shortcuts, hidden state inconsistencies, and verification gaps that could compromise training quality.
  • Take technical ideas from early prototypes through production-grade infrastructure.

Desired Qualifications

  • Hands-on experience with Harbor, especially building custom reinforcement learning environments, task definitions, verifiers, or evaluation infrastructure.
  • Experience with reinforcement learning environments, AI agents, model evaluation, or agent training infrastructure.
  • Familiarity with MCP, Gymnasium, Ray, or similar agent and execution frameworks.
  • Experience with robotics, laboratory automation, hardware interfaces, or cyber-physical systems.
  • Knowledge of deterministic simulation, sandbox orchestration, reproducible execution, and reward verification.
  • Experience with scientific computing, bioinformatics, or computational biology.

About the Company

Lumos AI Research

Data infrastructure for health AI safety

Lumos AI Research builds data infrastructure to improve AI model accuracy and safety for health and life sciences. It partners with labs, startups, and governments and has supported major tech firms like OpenAI, Google, and Meta. Its offerings center on data-centric AI methods including Supervised Fine-Tuning (SFT) with high-quality prompt-response examples, Reinforcement Learning with Human Feedback (RL/HF) guided by medical experts, Preference Ranking, and Reinforcement Learning from AI Feedback (RLAIF). It also develops Health RL simulation loops and uses Traces to teach AI agents from user actions. The company differentiates itself through a focus on high-stakes health data, a team with backgrounds from OpenAI, Scale, TikTok, MIT, and Harvard, and its role as a partner for training and evaluating models in regulated environments. Its goal is to help organizations build, train, and evaluate safer, more accurate AI systems for health and life sciences.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at Lumos AI Research

See more jobs