T

Toloka

Human-in-the-loop data labeling platform

Freelance Technical Consultant

Implementation & Technical Account ManagementConfirmed live in the last 24 hours
ContractRemote in USANo salary listed

About the Job

Requirements

  • Experience as a Solution Engineer, Technical Solutions Engineer, Data Scientist, Data/Systems Analyst, or Technical Project Manager.
  • Proven experience owning projects end to end, including scoping, delivery, and stakeholder management.
  • Direct experience working with external customers on technical projects, including requirements gathering, delivery, and iteration.
  • Strong Python skills for data manipulation using tools such as NumPy and pandas, natural language processing using tools such as NLTK and spaCy, and building lightweight web services or tools using tools such as FastAPI and Flask.
  • Solid understanding of machine learning concepts and data workflows.
  • Experience designing multi-stage pipelines and complex systems.
  • Understanding of software development fundamentals, including version control, testing, minimum viable products, and iterative development.
  • Bachelor's or master's degree in Data Science, machine learning/artificial intelligence, Software Engineering, or a related quantitative field such as Physics or Applied Mathematics, with strong analytical foundations.
  • Ability to reason about trade-offs between quality, speed, cost, and scalability.
  • English communication skills at B2 level or above, with the ability to explain complex technical concepts to non-technical audiences.
  • Confidence working with data engineers, machine learning engineers, and researchers from leading technology companies.
  • Ability to manage multiple projects in fast-paced, ambiguous environments.

Responsibilities

  • Act as the primary technical point of contact for customers across technical and executive stakeholders.
  • Lead discovery conversations to understand client goals, problems, and quality criteria.
  • Translate client needs into clear, actionable solution designs and delivery plans.
  • Advise customers on best practices in data collection, data quality, evaluation, and model training workflows.
  • Set expectations proactively, communicate progress regularly, and manage risks and trade-offs transparently.
  • Identify expansion opportunities and additional ways to create value for customers through data and AI solutions.
  • Design end-to-end data solutions using the platform, selecting appropriate components, workflows, and quality controls.
  • Configure data labeling components and quality controls; develop user interfaces and AI-driven tooling, such as agentic systems, retrieval-augmented generation, and synthetic data generation; and integrate them into end-to-end automated pipelines for AI training and evaluation.
  • Run experiments and pilots to validate quality, throughput, and cost assumptions.
  • Lead technical execution during delivery, coordinating internal teams and external stakeholders as needed.
  • Ensure solutions meet agreed quality, performance, and scalability requirements.
  • Own delivery outcomes holistically, including technical performance, quality, timelines, and financial efficiency.
  • Monitor key performance indicators such as throughput, quality metrics, gross margin, and contribution margin, and act on deviations.
  • Prioritize work based on customer impact and business value.
  • Analyze data to identify failure modes, inefficiencies, and opportunities for improvement.
  • Continuously optimize solutions through iteration, automation, and adoption of new technologies.
  • Troubleshoot delivery, process, or technical issues in collaboration with support, infrastructure, and product teams.
  • Drive solutions toward stable operation with minimal ongoing maintenance.

Desired Qualifications

  • Familiarity with large language models and prompt engineering.
  • Experience with crowdsourcing, expert workflows, or large-scale data labeling.
  • Experience working on machine learning training, evaluation, or agentic systems.
  • Familiarity with quality frameworks, audits, or data validation pipelines.

About the Company

Toloka

Human-in-the-loop data labeling platform

Toloka provides data services with human-in-the-loop for AI development. It connects AI developers with a global pool of over 200,000 contributors across more than 100 countries to perform microtasks like data annotation, content moderation, and sentiment analysis. The platform routes tasks to contributors, collects verified results, and offers specialized services such as dataset creation, model evaluation, and safety testing including red-teaming. Its goal is to deliver reliable, human-verified training data and testing environments that help AI developers build, evaluate, and safeguard advanced models.

Company size
1,001-5,000
Company stage
Late Stage VC
Total funding
$72M
Headquarters
Amsterdam, Netherlands
Founded
2014

Recently Posted Jobs

Explore more opportunities at Toloka

See more jobs