H

HUD

AI agent evaluation platform and benchmarks

Research Engineer - Privacy and Anonymization

AI ResearchConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • Strong proficiency in Python and experience building reliable production data or machine-learning systems.
  • Experience with information extraction, named-entity recognition, classification, or related methods for detecting rare or sensitive content.
  • Ability to compare approaches across recall, precision, latency, cost, and downstream data utility.
  • Understanding of redaction, masking, pseudonymization, anonymization, and synthetic data, and when each is appropriate.
  • Ability to reason about subtle leakage paths, edge cases, and adversarial failure modes.
  • Experience building end-to-end data processing pipelines without a fully prescribed roadmap.

Responsibilities

  • Build systems to detect personally identifiable information, quasi-identifiers, credentials, and other sensitive information, and design transformations based on data type and downstream use case.
  • Develop and benchmark detection approaches combining rules, statistical models, classifiers, and large language model-based methods.
  • Build production pipelines that anonymize raw data before downstream processing, training, evaluation, or synthetic data generation.
  • Create evaluation frameworks to measure privacy risk and retained data utility, including recall-weighted metrics, leakage tests, and adversarial re-identification attempts.
  • Design systems robust to new data sources, schema drift, unusual formats, and sensitive information embedded in unexpected fields.
  • Work with engineering, research, operations, and customers to translate privacy requirements into practical technical policies and safeguards.

Desired Qualifications

  • Hands-on experience with privacy-enhancing technologies such as differential privacy, k-anonymity, secure aggregation, and format-preserving encryption.
  • Experience working with sensitive data in healthcare, finance, or security.
  • Experience building low-latency or high-throughput machine-learning inference and data-processing systems.
  • Experience taking ownership in unstructured problem spaces from early research through production deployment.
  • Early-stage startup experience and communication skills for collaboration across teams and time zones.

About the Company

HUD

AI agent evaluation platform and benchmarks

HUD provides an evaluation platform for AI agents that perform computer-use tasks. It offers an interface that connects to HUD evaluation environments, allowing users to run benchmarks across hundreds of environments and thousands of tasks. Users can integrate their agents using various adapters, and interact with the system through an asynchronous API for efficient experiments. The platform then collects telemetry and benchmarking results to inform agent improvements. HUD differentiates itself by concentrating on evaluating and improving knowledge-work agents across a wide range of tasks and environments, rather than just building models, and by enabling scalable, tool-enabled testing via adapters and an asynchronous workflow. The company’s goal is to help organizations and developers assess, compare, and enhance their AI agents so they perform better in real-world knowledge-work scenarios.

Company size
11-50
Company stage
Seed
Total funding
$130K
Headquarters
San Francisco, CA
Founded
2025

Recently Posted Jobs

Explore more opportunities at HUD

See more jobs