T

Turing

AI-matched, vetted software engineering services

Research Engineer

AI ResearchConfirmed live in the last 24 hours
Full-timeRemote in ColombiaNo salary listed

About the Job

Requirements

  • 4–5 years of experience building or improving deep learning systems where data quality materially mattered, including training, post-training, evaluations, or agentic systems.
  • Strong intuition for selecting, filtering, and synthesizing data and measuring its impact on model improvement.
  • Ability to communicate clearly with researchers and engineers, translate research objectives into concrete specifications, and turn messy outputs into actionable insights.
  • Ability to diagnose subtle data-quality issues and failure modes with a high level of attention to detail.
  • Python proficiency is required.
  • Comfort with SQL and structured-data workflows is strongly preferred.
  • For coding-focused work, proficiency in one or more major programming languages such as C++, Java, Go, Rust, or JavaScript/TypeScript is a plus.
  • Comfort designing quality systems, including rubrics, validation scripts, gold sets, sampling strategies, statistical checks, slice-based evaluation, and human-in-the-loop review loops grounded in measurable criteria.

Responsibilities

  • Translate ambiguous research goals into clear data requirements, including target skills, failure modes, difficulty calibration, coverage, and success metrics.
  • Create detailed rubrics, counterexamples, and boundary cases defining what data should include and exclude.
  • Audit produced data for subtle errors, reward-hacking opportunities, leakage, ambiguity, inconsistent assumptions, and distribution shifts.
  • Drive iterative improvements using error taxonomies, slice-based quality metrics, and model-behavior-informed refinements.
  • Design task suites, ground-truth signals such as verifiers, unit tests, structured checks, reward functions and automatic validators, and environment interfaces such as APIs, tool schemas, state abstractions, database schemas, and simulator-like dynamics.
  • For coding and software-engineering agents, develop data reflecting real development work, including codebase navigation, bug localization, patching, tests, code reviews, CI-like constraints, refactors, and security fixes.
  • For multimodal work, design tasks testing chart reading, document question answering, user-interface understanding, diagram-based STEM reasoning, and OCR-aware tasks.
  • For STEM work, develop tasks with verifiable solutions using symbolic checks, reference solvers, numerical validation, step consistency, and unit sanity checks.
  • For modern embodied AI and vision-language-model-driven agents, develop interaction data and environments for long-horizon tasks, instruction-following grounded in visual context, robust action selection, safety and constraint adherence, and adversarial state coverage.
  • Implement automated validation and filtering, including deduplication, decontamination, leakage checks, format and schema consistency checks, invariant checks, and difficulty and diversity controls for coverage, novelty, and long-tail cases.
  • Develop synthetic-data generation and augmentation pipelines where appropriate, including programmatic task generators, controlled perturbations for hard negatives, scenario templating with diversity constraints, and simulator- or tool-driven rollouts for trajectory data.
  • Create documentation and data cards describing dataset intent, known limitations, recommended use, and evaluation linkage.
  • Design and run evaluations reflecting customers’ intended usage.
  • Analyze how data connects to outcomes through pre- and post-comparisons on targeted capability slices, error breakdowns, explanations of model failures, and ablations identifying which data attributes drive improvement.
  • When needed, run in-house fine-tuning or reinforcement-learning-style experiments, or partner with research, to demonstrate measurable improvements in model behavior from the data or environment.
  • Work with engineers, researchers, quality-assurance staff, domain subject-matter experts, and large-scale data-production groups by providing clear specifications, examples, edge cases, fast feedback based on audits and quantitative signals, and structured quality-focused review processes.
  • Review and improve outputs from large annotation and creation efforts.

Desired Qualifications

  • Comfort with SQL and structured-data workflows.
  • For coding-focused work, proficiency in one or more major programming languages such as C++, Java, Go, Rust, or JavaScript/TypeScript.
  • Experience with reinforcement learning or post-training, including RLHF/RLAIF, verifier training, reward modeling, reinforcement-learning fine-tuning, or environment design.
  • Experience with agentic evaluation, including tool use, multi-step workflows, long-horizon tasks, and trajectory analysis.
  • Multimodal expertise in document understanding, charts, diagrams, optical character recognition, user-interface or vision grounding; audio/video experience is optional.
  • Depth in STEM fields such as mathematics, physics, or engineering, with an emphasis on verifiability and rigorous correctness.
  • Experience with modern embodied AI or vision-language-model-driven agents, including vision-language-action models, interaction datasets, embodied evaluations, long-horizon grounding, and tool, sensor, or action interfaces.
  • Systems thinking and the ability to simulate an application's API or data schema and design tasks reflecting real-world constraints and workflows.

About the Company

Turing

AI-matched, vetted software engineering services

Turing uses artificial intelligence to connect businesses with a global pool of over 3 million vetted software engineers from 150 countries for custom application development and on-demand software engineering. Clients specify the required skills, and the AI matches them to top engineers, speeding up hiring and project delivery while reducing recruitment effort. Engineers who pass Turing’s vetting gain access to high-paying remote jobs with a strong chance of repeat opportunities, reflected in a 99% rematch rate. The company differentiates itself by combining a large, pre-vetted talent pool with AI-driven matching to deliver fast, scalable engineering teams for businesses and steady remote work for engineers. Its goal is to accelerate project timelines for clients and provide reliable, well-compensated remote opportunities for engineers.

Company size
5,001-10,000
Company stage
Series E
Total funding
$247M
Headquarters
Palo Alto, CA
Founded
2018

Recently Posted Jobs

Explore more opportunities at Turing

See more jobs