M

Mistral AI

Open-weight LLMs and enterprise AI deployment

Engineering Manager - Serverless Containers

Engineering LeadershipConfirmed live in the last 24 hours
Full-timeNo salary listedRemote

About the Job

Requirements

  • At least 3 years of people leadership experience managing engineers, including hiring, coaching, giving feedback, and developing them.
  • Production systems experience in Go, including having shipped production software.
  • Experience building container or workload platforms, including orchestration, scheduling, isolation, or request routing, rather than only deploying onto another provider's serverless platform.
  • Deep Linux knowledge, including namespaces, cgroups, image layers, and page cache.
  • Understanding of multi-tenancy, including density, isolation, and fairness across shared fleets.
  • Significant experience building complex backend or infrastructure systems.
  • Experience partnering with product, design, and business teams to ship software used by real users.
  • A low-ego, team-first approach and ability to work collaboratively with other engineers.

Responsibilities

  • Own the container platform end to end, including image delivery, placement, request routing, scale-up, and scale-to-zero across CPU and GPU.
  • Improve cold starts through techniques such as snapshotting, prewarming, and image-layer caching so scale-from-zero feels instant.
  • Support AI workloads, including GPU-backed containers, streaming responses, long-lived connections, and low-cost idle MCP servers.
  • Write Go alongside the team and own architecture and the most challenging implementation decisions.
  • Develop engineers, set standards for ownership, and coach team members beyond their comfort zones.
  • Manage the team, including hiring, performance, growth paths, and providing honest feedback.
  • Partner with Product Managers to translate platform decisions into a product developers want to deploy on.

About the Company

Mistral AI

Open-weight LLMs and enterprise AI deployment

Mistral AI builds open-weight large language models and the tools to run them, along with inference infrastructure and enterprise products that let organizations deploy AI with control over data residency, customization, and the underlying stack. Its platform provides open-model architectures and a deployment stack for inference, governance, and integration that can run on‑premises or in the cloud. This openness and modular stack differentiate it from single-vendor hyperscalers by prioritizing data locality and flexibility. The company aims to enable reliable, customizable AI deployment at scale for businesses and public-sector customers across many countries.

Company size
1,001-5,000
Company stage
Series D
Total funding
$7.2B
Headquarters
Paris, France
Founded
2023

Recently Posted Jobs

Explore more opportunities at Mistral AI

See more jobs