R

Reflection AI

Builds AI models and deployment software

Member of Technical Staff - Data Ingestion Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeIn-person

About the Job

Requirements

  • Experience building web crawling, data ingestion, or large-scale data acquisition systems using Ray, Beam, Spark, or similar technologies.
  • Familiarity with how large language models are trained and evaluated, and an intuition for what makes data useful for training.
  • Ability to work with very large datasets at multi-terabyte to petabyte scale and build systems that are observable, testable, and maintainable.
  • Ability to design experiments and use data to guide system improvements.
  • Ability to explain system behavior and clearly communicate tradeoffs.

Responsibilities

  • Build and operate large-scale data ingestion systems for pre-training, including web crawling, extraction, and dataset delivery.
  • Run experiments to evaluate crawling strategies, extraction methods, and ingestion tradeoffs.
  • Analyze ingested data to identify gaps, redundancy, and areas for improvement.
  • Build ingestion pipelines that scale reliably across large data campaigns.
  • Develop specialized crawlers for high-priority data sources.
  • Review code, debug production issues, and continuously improve ingestion infrastructure.
  • Work closely with pre-training and data quality teams and collaborate with researchers, infrastructure, operations, and external partners.

About the Company

Reflection AI

Builds AI models and deployment software

Reflection AI develops language models for software developers, companies and governments that want control over how AI is deployed and adapted. Its research concentrates on coding, reasoning and AI agents that work through tasks with software tools. The lab builds the surrounding software and infrastructure as well as models, letting customers run AI through its hosted platform or in their own computing environments. Its commercial work pairs model access with engineers who design applications and support customized enterprise deployments from development through operation. Reflection AI was founded in 2024 and is headquartered in New York City.

Company size
201-500
Company stage
Late Stage VC
Total funding
$4.6B
Headquarters
New York City, New York
Founded
2024

Recently Posted Jobs

Explore more opportunities at Reflection AI

See more jobs