A

Aleroy

Unified API for scalable AI inference

Site Reliability Engineer Lead

Site Reliability EngineeringConfirmed live in the last 24 hours
Full-timeAbu Dhabi - United Arab EmiratesNo salary listed

About the Job

Requirements

  • At least 7 years of experience in SRE, DevOps, Platform Engineering, Infrastructure Engineering, or similar roles.
  • Strong experience owning production infrastructure at scale.
  • Deep hands-on expertise with Kubernetes.
  • Strong experience with Terraform and Infrastructure as Code.
  • Experience designing and operating production-grade CI/CD pipelines.
  • Strong knowledge of Linux, networking, DNS, load balancing, storage, containers, and distributed systems.
  • Experience with Prometheus, Grafana, VictoriaMetrics, ELK/EFK, or similar observability stacks.
  • Strong scripting or programming skills in Python, Go, Bash, or similar.
  • Practical experience with SLIs, SLOs, SLAs, alerting, and error budgets.
  • Experience leading production incidents, root-cause analysis, and post-mortems.
  • Strong understanding of cloud-native and infrastructure security.
  • Experience making architectural decisions and driving technical standards.
  • Strong ownership and problem-solving skills.

Responsibilities

  • Own the reliability, availability, scalability, and performance of Aleroy production infrastructure.
  • Design and evolve resilient infrastructure supporting growing and distributed workloads.
  • Identify infrastructure bottlenecks, single points of failure, and operational risks.
  • Establish capacity planning, backup, recovery, and disaster-recovery practices.
  • Drive improvements in infrastructure performance, stability, and cost efficiency.
  • Own the architecture, operation, and optimization of Kubernetes environments.
  • Improve cluster reliability, networking, resource utilization, deployment strategies, and workload management.
  • Build and maintain infrastructure through Terraform, Helm, Ansible, or equivalent Infrastructure as Code tooling.
  • Ensure infrastructure is automated, reproducible, version-controlled, and scalable.
  • Design and improve production-grade CI/CD pipelines.
  • Automate infrastructure provisioning, deployments, configuration, testing, and operational workflows.
  • Improve deployment safety through automated validation, rollback mechanisms, and appropriate release controls.
  • Reduce manual operational work through automation.
  • Own the observability strategy across Aleroy.
  • Build monitoring, logging, tracing, dashboards, and alerting infrastructure.
  • Establish visibility into infrastructure health, application health, performance, and failures.
  • Improve alert quality and reduce unnecessary operational noise.
  • Define and implement SLIs, SLOs, SLAs, and error budgets.
  • Establish reliability standards for critical services.
  • Partner with engineering teams to make reliability part of the development lifecycle.
  • Use operational data to identify recurring problems and prioritize improvements.
  • Lead technical response to critical production incidents.
  • Establish incident management and escalation processes.
  • Lead root-cause analysis and blameless post-mortems.
  • Translate incidents into concrete engineering improvements.
  • Participate in and help structure the on-call rotation.
  • Embed infrastructure and cloud security best practices.
  • Strengthen access management, secrets management, network security, CI/CD security, and runtime security.
  • Support security, compliance, and audit-readiness requirements where relevant.
  • Set the technical direction for SRE and infrastructure engineering.
  • Establish engineering standards and best practices.
  • Review infrastructure architecture and major technical changes.
  • Mentor engineers and increase infrastructure expertise across teams.
  • Remain hands-on with implementation and troubleshooting.

Desired Qualifications

  • Experience supporting AI/ML or HPC workloads.
  • Experience with GPU infrastructure, scheduling, resource management, or performance optimization.
  • Experience operating large-scale distributed systems.
  • Multi-cloud, hybrid-cloud, or self-managed infrastructure experience.
  • Experience optimizing infrastructure costs and capacity.
  • Experience with service mesh, distributed tracing, or advanced Kubernetes networking.
  • Previous experience as an SRE Lead, Platform Lead, Infrastructure Lead, or Tech Lead.

About the Company

Aleroy

Unified API for scalable AI inference

Aleroy provides a single API for running AI models at scale, supporting both ready-to-use and custom models across cloud, dedicated capacity, and customer-owned hardware. It handles the entire inference lifecycle—optimization, deployment, and scaling—while letting enterprises choose where workloads run and ensuring data remains in their own infrastructure, with a zero-retention policy on prompts and outputs. The platform supports both dedicated and shared inference and differentiates itself with infrastructure-agnostic delivery via one API and options to monetize idle GPU capacity through white-labeled services or GPU-sharing partnerships. Its goal is to give enterprises precise control over AI deployments, optimize performance and cost, and enable secure, scalable inference across multiple environments.

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Aleroy

See more jobs