H

HUD

AI agent evaluation platform and benchmarks

Forward Deployed Research Engineer

AI ResearchConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Experience building benchmarks and evaluations, including reasoning about realistic tasks, reliable rubrics, usable environments, and trajectories useful for reinforcement learning training.
  • Core engineering experience, preferably in a forward-deployed or customer-success context.
  • Strong debugging skills across code, data, and environments.
  • Ability to operate independently in ambiguous situations without a fully prescribed roadmap.
  • Sound judgment about when to move quickly, escalate, and prioritize correctness or security.
  • Ability to work directly with technical customers, vendors, or cross-functional internal teams.

Responsibilities

  • Own technical deployment requests from frontier AI labs, data vendors, and internal teams from triage through completion.
  • Build reinforcement learning environments and evaluations that meet frontier AI labs’ technical requirements and needs, sometimes on short timelines.
  • Clarify ambiguous requests by asking appropriate questions and identifying the actual work needed.
  • Build tools and one-off pipelines to resolve urgent customer or partner problems.
  • Balance speed and quality when customers need a fast turnaround and the path is not fully specified.

Desired Qualifications

  • Experience in applied research engineering or forward-deployed engineering.
  • Experience handling urgent production, customer, or deployment issues.
  • Early-stage startup experience and ability to work independently in fast-paced environments.
  • Strong communication skills for remote collaboration across time zones.

About the Company

HUD

AI agent evaluation platform and benchmarks

HUD provides an evaluation platform for AI agents that perform computer-use tasks. It offers an interface that connects to HUD evaluation environments, allowing users to run benchmarks across hundreds of environments and thousands of tasks. Users can integrate their agents using various adapters, and interact with the system through an asynchronous API for efficient experiments. The platform then collects telemetry and benchmarking results to inform agent improvements. HUD differentiates itself by concentrating on evaluating and improving knowledge-work agents across a wide range of tasks and environments, rather than just building models, and by enabling scalable, tool-enabled testing via adapters and an asynchronous workflow. The company’s goal is to help organizations and developers assess, compare, and enhance their AI agents so they perform better in real-world knowledge-work scenarios.

Company size
11-50
Company stage
Seed
Total funding
$130K
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at HUD

See more jobs