L

Lovable

No-code AI-driven web app platform

Data Scientist - Agent

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • Experience or strong interest in large language model evaluation and observability, including building evaluations, scoring outputs, tracing agent behavior, and catching regressions.
  • Strong SQL and Python skills, applied statistics, and experimentation; comfortable designing A/B tests for agent changes with noisy outcomes.
  • Ability to build systems and agents that produce insight continuously rather than relying on one-off analyses.
  • Ability to assess agent behavior, including success, error rates, and task completion, and measure it when there is no clean answer key.
  • Ability to work entrepreneurially in ambiguity and closely with the engineers building the agent.

Responsibilities

  • Define and own metrics for agent quality, including success, completion, error rates, and the behaviors that drive them.
  • Build evaluation systems and an experiment framework to determine whether an agent change should ship, including A/B-tested rollouts that catch increases in errors before broad release.
  • Turn agent traces and telemetry into concrete fixes in direct collaboration with the agent engineering team.
  • Build tooling and agents that continuously produce evaluations as the agent evolves.
  • Set the standard for judging agent behavior when there is no answer key.

About the Company

Lovable

No-code AI-driven web app platform

Lovable, based in Stockholm, builds AI software that lets people create and ship web apps from natural-language prompts without writing code. The platform uses vibe-coding: describe the app in plain language and it generates and hosts the app. Compared with competitors, it targets non-technical users to produce production-ready web apps at scale and serves enterprise customers like Adidas, Nvidia, Deutsche Telekom, and Zendesk, while expanding across regions. The goal is to democratize app creation by turning natural language into deployable software and to grow the platform through broader product features and global teams.

Company size
1,001-5,000
Company stage
Series C
Total funding
$953.5M
Headquarters
Stockholms kommun, Sweden
Founded
2023

Recently Posted Jobs

Explore more opportunities at Lovable

See more jobs