I

Institute of Foundation Models

Researches and develops foundation models

Senior Machine Learning Operations Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeAbu Dhabi - United Arab EmiratesNo salary listedIn-person

About the Job

Requirements

  • At least 4 years of experience in MLOps, DevOps, or cloud infrastructure engineering for machine learning systems.
  • Strong proficiency with Kubernetes, Helm, and container orchestration.
  • Experience deploying machine-learning models via vLLM, SGLang, TensorRT, or Ray Serve.
  • Proficiency with AWS services including EKS, EC2, S3, RDS, CloudWatch, and IAM.
  • Solid experience with Python, Docker, Git, and CI/CD pipelines.
  • Solid understanding of model lifecycle management, data pipelines, and observability tools such as Grafana, Prometheus, and Loki.
  • Ability to collaborate with machine-learning researchers and software engineers.

Responsibilities

  • Design and manage scalable machine-learning infrastructure on AWS using EKS, EC2, RDS, S3, and IAM-based access control.
  • Build and maintain Kubernetes deployments for large language model and text-to-speech inference using Helm, ArgoCD, and Prometheus/Grafana monitoring.
  • Implement and optimize model-serving pipelines using vLLM, SGLang, TensorRT, or similar frameworks for high-throughput inference.
  • Develop CI/CD and MLOps automation for data versioning, model validation, and deployment using GitHub Actions, Jenkins, or AWS CodePipeline.
  • Integrate OpenWebUI, Gradio, or similar user interfaces for model demos and internal evaluation tools.
  • Collaborate with machine-learning researchers to productize text-to-speech models, automatic speech recognition models, and large language model chat systems.
  • Ensure observability, cost optimization, and reliability of cloud resources across multiple environments.
  • Contribute to internal tools for dataset curation, model monitoring, and retraining pipelines.
  • Maintain infrastructure-as-code using Terraform and Helm charts for reproducibility and governance.
  • Support real-time multimodal workloads involving voice, text, and vision across inference clusters.

Desired Qualifications

  • Extensive experience with vLLM, Kubernetes, ElevenLabs, Whisper, Gradio/OpenWebUI, or custom text-to-speech/automatic speech recognition model hosting.
  • Familiarity with multi-GPU scheduling, NCCL optimization, and high-performance computing cluster integration.
  • Knowledge of security, cost management, and network policy in multi-tenant Kubernetes clusters and Cloudflare systems.
  • Prior work in large language model deployment, fine-tuning pipelines, or foundation model research.
  • Exposure to data governance and responsible AI operations in research or enterprise settings.

About the Company

Institute of Foundation Models

Researches and develops foundation models

IFM builds and studies foundation models—large AI models designed to learn broadly from diverse data and be used across many tasks. Its work centers on academic research to create open, fast, and practical models that address real-world societal needs, rather than narrow applications. The models are developed by a global team across Abu Dhabi, Paris, and Silicon Valley, with a strong emphasis on openness and collaboration to advance AI science and accessibility. Unlike typical private labs that lock models behind paywalls, IFM aims to provide publicly accessible, efficient models that can be used by researchers and developers to solve real problems. The overarching goal is to push the science of foundation models forward while ensuring their benefits reach society at large.

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
United Arab Emirates
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Institute of Foundation Models

See more jobs