Site Reliability Engineer
Mistral AI
Site Reliability Engineer
Mistral AI
Open-weight LLMs and enterprise AI deployment
Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.
We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.
As a Site Reliability Engineer (SRE) on the Platform team, you will shape the reliability, scalability, and performance of our platform and customer-facing applications. You’ll work closely with software engineers and research teams to ensure our systems meet and exceed the expectations of both internal and external customers.
This role balances day-to-day operations on production systems with long-term software engineering improvements. Your work will reduce operational toil, foster reliability, and ensure high availability for our web services, inference environments, and ML workloads. You’ll enable seamless replication of work environments across multiple HPC clusters, directly impacting the stability and efficiency of our AI platform.
Design, build, and maintain scalable, highly available, and fault-tolerant infrastructures to support web services and ML workloads.
Ensure our platform, inference, and model training environments are always highly available and enable seamless replication across HPC clusters.
Operate systems and troubleshoot issues in production, including interrupts, on-call responses, and infrastructure scaling.
Implement and improve monitoring, alerting, and incident response systems to minimize downtime and optimize performance.
Develop and maintain workflows and tools for CI/CD, containerization, orchestration, monitoring, and logging.
Participate in on-call rotations to respond to incidents and perform root cause analysis.
Drive continuous improvement in infrastructure automation, deployment, and orchestration using tools like Kubernetes, Flux, and Terraform.
Collaborate with AI/ML researchers to enable safe and reproducible model-training experiments.
Build a cloud-agnostic platform that abstracts infrastructure complexities for science and engineering teams.
Design and develop new workflows, tooling, and automation to improve system reliability, availability, and performance.
Work with the security team to ensure infrastructure adheres to best practices and compliance requirements.
Document processes and procedures to ensure consistency and knowledge sharing across the team.
A Master’s degree in Computer Science, Engineering, or a related field.
7+ years of experience in a DevOps or SRE role, with strong expertise in cloud computing and distributed systems.
Hands-on experience with site reliability issues, including root cause analysis, in-production troubleshooting, and on-call rotations.
Proficiency in working with reliability KPIs, such as observability, alerting, and SLAs.
Experience with CI/CD, containerization, and orchestration tools like Docker and Kubernetes.
Knowledge of monitoring, logging, alerting, and observability tools such as Prometheus, Grafana, ELK Stack, or Datadog.
Familiarity with infrastructure-as-code tools like Terraform or CloudFormation.
Proficiency in scripting languages (Python, Go, Bash) and a strong understanding of software development best practices.
Solid grasp of networking, security, and system administration concepts.
Excellent problem-solving and communication skills, with the ability to work effectively in a collaborative environment.
Experience in an AI/ML environment, high-performance computing (HPC) systems, or modern AI-oriented solutions (e.g., Fluidstack, Coreweave, Vast) is a plus.
We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.
For the most up-to-date details on benefits available in your location, please refer to our Benefits page.
Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy.
Open-weight LLMs and enterprise AI deployment
Mistral AI builds open-weight large language models and the tools to run them, along with inference infrastructure and enterprise products that let organizations deploy AI with control over data residency, customization, and the underlying stack. Its platform provides open-model architectures and a deployment stack for inference, governance, and integration that can run on‑premises or in the cloud. This openness and modular stack differentiate it from single-vendor hyperscalers by prioritizing data locality and flexibility. The company aims to enable reliable, customizable AI deployment at scale for businesses and public-sector customers across many countries.
Explore more opportunities at Mistral AI