P

Preply

Online language-learning marketplace connecting live tutors

Senior ML Platform Engineer - GenAI Platform

Platform EngineeringConfirmed live in the last 24 hours
Full-timeLondon, UKHybrid

About the Job

Requirements

  • At least 5 years of experience designing, building, and operating backend services or machine-learning infrastructure that handles production traffic.
  • Strong Python skills and experience building developer-facing application programming interfaces, software development kits, or shared libraries.
  • Practical experience with generative AI systems, including vector retrieval, external provider application programming interfaces, and common issues.
  • Hands-on experience using agentic AI to influence engineering beyond code generation, applying judgment to architecture, business logic, and security, and setting up quality gates and safety nets or proposing AI-native alternatives.
  • Sound knowledge of distributed systems, including high availability, concurrency, caching, and rate limiting.
  • Experience with at least one major public cloud and its services and infrastructure; Amazon Web Services is preferred.
  • Hands-on experience with distributed tracing, system telemetry, service-level objectives, and incident triage.
  • Strong communication skills, English proficiency at least at C1 level, and willingness to participate in a paid on-call rotation.

Responsibilities

  • Architect a unified gateway with automated routing, quota controls, and resilient fallback systems across model vendors.
  • Improve system efficiency and reduce latency through dynamic traffic management, response caching, token budgeting, and cost-allocation controls.
  • Establish evaluation mechanisms to ensure precision, stability, and safety in model outputs.
  • Deliver observability across generative AI lifecycles, including deep tracing, performance telemetry, cost analytics, continuous monitoring, and alerting.
  • Standardize prompt-engineering workflows with automated versioning and testing, governance, and continuous integration and continuous delivery integrations for production delivery.
  • Implement platform guardrails with Security and Privacy experts to enforce policies and safe production defaults automatically.
  • Maintain incident response, blameless postmortems, and comprehensive monitoring for generative AI stacks.

Desired Qualifications

  • Experience operating AI gateways or scalable model-serving infrastructure.
  • Familiarity with evaluation suites, prompt management, vector databases, or customized generative AI observability tooling.
  • Experience with Metaflow, Databricks, or Amazon Web Services SageMaker.
  • Knowledge of hosting open-source foundation models, optimizing graphics processing unit compute, dynamic scaling, and infrastructure cost controls.
  • Familiarity with agentic workflows, multi-agent frameworks, and tool-use patterns.

About the Company

Preply

Online language-learning marketplace connecting live tutors

Preply is an online language-learning marketplace that connects learners with live tutors for 90+ languages across 180 countries. Through the platform, students can choose a language, browse tutors, schedule lessons, and receive video-based instruction from tutors around the world. Lessons are supported by an AI co-pilot toolkit that helps with practice, personalization, and learning data to aid the tutoring process. What sets Preply apart is its large, global network of more than 100,000 tutors, a broad language catalog, and a focus on combining human teaching with AI-assisted tools, backed by strong funding and profitability signals (it became EBITDA-positive) and a recent €127 million Series D to expand AI/data capabilities, product and engineering hiring, and global growth. The company’s goal is to make language learning accessible and effective for learners anywhere by scaling high-quality tutoring worldwide and enhancing it with AI-driven tools.

Company size
10,001+
Company stage
Series D
Total funding
$321.9M
Headquarters
Brookline, MA
Founded
2012

Recently Posted Jobs

Explore more opportunities at Preply

See more jobs