B

Bolt Technology

Ride-hailing app with scooters and delivery

Applied AI Engineer - Operations Automation

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeTallinn, Estonia

About the Job

Requirements

  • Experience in software engineering, machine learning, or data science, including having shipped and operated a system that calls large language models.
  • Experience building an evaluation suite for a large language model or agent system and using it to decide what ships.
  • Experience examining agent traces to identify and fix decision failures.
  • Experience designing a large language model judge, measuring agreement with human labels, and correcting disagreements.
  • Knowledge of how verifiers can be gamed, including having identified reward hacking in prior work.
  • Ability to design and interpret an A/B test and explain to operations leads differences between offline test predictions and live results.
  • Ability to identify when a rule, classic machine learning model, or human decision-maker is better than a large language model and explain the cost trade-off.
  • Ability to write clearly in English and prepare reports pairing a ceiling estimate with a realistic estimate.

Responsibilities

  • Redesign operational processes by examining systems of record, interviewing the people who run the processes, and determining which steps should become software, agents, or human checkpoints.
  • Turn real cases and human decisions into test sets, and convert each new failure into a regression test.
  • Calibrate large language model judges against human labels, keep judge checks separate from programmatic checks, and guard costs and payouts.
  • Run the improvement loop across policies, prompts, tools, and models, adding fine-tuning when a better policy is insufficient.
  • Own rollout gates, decide what ships, run A/B tests, and feed live results back into test sets.
  • Codify successful approaches so other teams can use them independently.
  • Automate operational decisions while improving their quality.

Desired Qualifications

  • Hands-on post-training experience, including RLVR, GRPO, DPO, reward modelling, or LoRA.
  • Experience with program optimisation frameworks such as GEPA, DSPy, or TextGrad.
  • Experience designing reinforcement learning environments or gyms with programmatic grading.
  • Experience in operations automation for a marketplace, fintech, or trust and safety team.
  • Strong SQL skills and comfort working in codebases written by others.

About the Company

Bolt Technology

Ride-hailing app with scooters and delivery

Bolt Technology is a mobility platform that combines ride-hailing, scooter rentals, and food delivery to connect people with transportation and local restaurants. Users book rides or scooters via the app, with drivers accepting requests and completing pickups quickly. For food delivery, Bolt drivers pick up meals from local restaurants and deliver them to customers. The company emphasizes flexible earning opportunities for drivers, who can choose when and how often to work and get paid weekly. It also serves businesses by helping restaurants and stores reach more customers. Bolt differentiates itself with a large global user base (over 150 million riders), rapid pickup times, and a multi-service model that lets drivers earn by transporting passengers, delivering food, or both. The goal is to provide flexible earnings for drivers while expanding mobility and delivery services to meet consumer demand and help partner businesses grow.

Company size
10,001+
Company stage
Debt Financing
Total funding
$2.2B
Headquarters
Tallinn, Estonia
Founded
2013

Recently Posted Jobs

Explore more opportunities at Bolt Technology

See more jobs