T

Turing

AI-matched, vetted software engineering services

Research Engineer - Frontier Data

AI ResearchConfirmed live in the last 24 hours
Full-timeRemote in BrazilNo salary listedRemote

About the Job

Requirements

  • Four to five years of experience building or improving deep learning systems where data quality materially mattered in training, post-training, evaluations, or agentic systems.
  • Strong intuition for selecting, filtering, and synthesizing data and measuring its effects on model improvements.
  • Ability to communicate research objectives as concrete specifications and messy outputs as actionable insights to researchers and engineers.
  • Comfort serving as the direct technical point of contact for a client and explaining setbacks or trade-offs.
  • Ability to diagnose subtle data quality issues and failure modes in detail.
  • Python proficiency is required.
  • Comfort designing quality systems, including rubrics, validation scripts, gold sets, sampling strategies, statistical checks, slice-based evaluation, and measurable human-in-the-loop review loops.

Responsibilities

  • Translate client requests and evolving research goals into technical proposals and clear data requirements covering target skills, failure modes, difficulty calibration, coverage, and success metrics.
  • Provide technical feasibility assessments, assumptions, acceptance criteria, and evaluation requirements for contract or statement-of-work scoping.
  • Create detailed rubrics, counterexamples, and boundary cases defining what data to include or exclude.
  • Audit produced data for subtle errors, reward-hacking opportunities, leakage, ambiguity, inconsistent assumptions, and distribution shifts.
  • Group failures, including by semantic similarity, to identify underlying gaps and provide concrete improvement instructions to the production team.
  • Design task suites, ground-truth signals such as verifiers, unit tests, structured checks, reward functions and automatic validators, and environment interfaces such as APIs, tool schemas, state abstractions, database schemas and simulator-like dynamics.
  • Build project-specific verification systems combining deterministic checks, model-based evaluators calibrated against gold sets, and targeted human review.
  • Implement automated validation and filtering, including deduplication, decontamination, leakage and consistency checks, and difficulty and diversity controls.
  • Develop synthetic data generation and augmentation pipelines, including programmatic task generators, controlled perturbations, scenario templating, and simulator- or tool-driven rollouts.
  • Create documentation and data cards covering dataset intent, known limitations, recommended use, and evaluation linkage.
  • Design and run evaluations reflecting client use; analyze pre/post comparisons, error breakdowns, and ablations to identify which data attributes drive model improvements.
  • When needed, run in-house fine-tuning or reinforcement-learning-style experiments, or partner with research, to demonstrate measurable improvements in model behavior.
  • Give technical direction to the distributed expert network by providing specifications, examples, edge cases, and fast feedback based on audits and quantitative signals.
  • Own technical translation, acceptance criteria, evaluator and verifier design, quality diagnosis, and the technical release recommendation.
  • Review and improve outputs from large annotation or creation efforts.
  • Communicate technical findings, quality risks, and recovery options directly to the client; align changes to scope, schedule, or external commitments with account and delivery owners.

Desired Qualifications

  • Strongly preferred: comfort with SQL and structured-data workflows.
  • For coding-focused work, proficiency in a major programming language such as C++, Java, Go, Rust, or JavaScript/TypeScript is a plus.
  • Experience with reinforcement learning or post-training, including RLHF/RLAIF, verifier training, reward modeling, reinforcement-learning fine-tuning, or environment design.
  • Experience with agentic evaluation, including tool use, multi-step workflows, long-horizon tasks, or trajectory analysis.
  • Multimodal expertise in document understanding, charts, diagrams, optical character recognition, user-interface or vision grounding; audio/video experience is optional.
  • Depth in mathematics, physics, or engineering with an emphasis on verifiability and rigorous correctness.
  • Experience with modern embodied AI or vision-language-model-driven agents, interaction datasets, embodied evaluations, long-horizon grounding, or tool/sensor/action interfaces.
  • Systems thinking, including the ability to simulate an application's API or data schema and design tasks that reflect real-world constraints and workflows.

About the Company

Turing

AI-matched, vetted software engineering services

Turing uses artificial intelligence to connect businesses with a global pool of over 3 million vetted software engineers from 150 countries for custom application development and on-demand software engineering. Clients specify the required skills, and the AI matches them to top engineers, speeding up hiring and project delivery while reducing recruitment effort. Engineers who pass Turing’s vetting gain access to high-paying remote jobs with a strong chance of repeat opportunities, reflected in a 99% rematch rate. The company differentiates itself by combining a large, pre-vetted talent pool with AI-driven matching to deliver fast, scalable engineering teams for businesses and steady remote work for engineers. Its goal is to accelerate project timelines for clients and provide reliable, well-compensated remote opportunities for engineers.

Company size
5,001-10,000
Company stage
Series E
Total funding
$247M
Headquarters
Palo Alto, CA
Founded
2018

Recently Posted Jobs

Explore more opportunities at Turing

See more jobs