D

Deloitte

Audits companies and advises on tax and technology

Lead Applied AI Site Reliability Engineer 2

Site Reliability EngineeringPosted on Nov 9
Full-timeDallas, TX, USA

About the Job

Requirements

  • A bachelor's degree in computer science, software engineering, data science, machine learning, or a related discipline; experience is the most relevant factor.
  • At least 6 years of software engineering and site reliability engineering experience operating large-scale, distributed, cloud-native systems in production, with experience in most of Python, Go, Bash, Java, C#/.NET, SQL/NoSQL, Kubernetes, Terraform, ArgoCD, CI/CD, and observability stacks.
  • At least 3 years of site reliability or production engineering experience for large-scale systems, including defining and owning SLIs, SLOs, SLAs, and error budgets; incident command and on-call; production observability using metrics, tracing, and logging; environment integrity and drift prevention; and segregation-of-duties controls such as least-privilege/RBAC, deployment approvals, and secrets management in partnership with security and risk.
  • At least 3 years of cloud-native engineering and cloud platform ownership on Azure, AWS, or GCP, including their AI/ML services, container orchestration with Kubernetes and Docker, infrastructure-as-code, networking, and multi-environment management.
  • At least 1 year establishing reliability and operational standards, including SLO discipline, runbooks, and performance and resilience budgets, while leading, mentoring, and guiding team members in adopting and improving these standards.
  • Prior experience operating AI/ML and agentic workloads in production, including reliability failure modes such as drift, train/serve skew, and output variance; MLOps/LLMOps; and the AI control plane, including model/LLM gateways and guardrails, from an operability and performance perspective.
  • Prior experience with load and performance testing under simulated production traffic, chaos engineering, capacity planning, autoscaling, and cloud/AI cost engineering, including GPU/inference and token cost attribution.
  • Prior software engineering experience and understanding of Business Context Diagrams, sequence/activity/state/entity relationship/data flow diagrams, OOP/OOD, data structures, algorithms, code instrumentation, and AI-augmented spec-driven development.
  • Prior experience using methodologies and tools such as XP, Lean, DevSecOps, SRE, ADO, GitHub, SonarQube, ATF, MLflow, ServiceNow capabilities including ITSM, ITOM, CMDB/CSDM, SPM, IRM, SecOps, HRSD, workflow automation, integration/API patterns, platform administration, platform governance, operational service management, and agentic AI frameworks such as LangFuse, LangSmith, or equivalent multi-agent orchestration tools.
  • Ability to travel an average of 10%, based on the work and products built.
  • Must be located within commuting distance of the selected location available for the role.
  • Must work in the local office at least 3 days per week.

Responsibilities

  • Operate high-visibility products, platforms, and environments to achieve reliability, performance, and cost outcomes measured through service-level objectives and error budgets.
  • Track incident trends and toil to prioritize reliability improvements and maintain safe, resilient, lean operational designs.
  • Advocate for production reliability and operability, ensure systems are safe and performant to run and can degrade gracefully, and set production standards.
  • Lead the design of observability, performance and resilience testing, and operational tooling; own production admission, release gating against error budgets and automated reliability checks, readiness verification, environment integrity, and operational support.
  • Maintain operational integrity of production and pre-production environments and the standards against which systems are admitted.
  • Own SLOs and error budgets; build and operate version-controlled dashboards and actionable, SLO-driven alerting; run performance, ambient-noise, and chaos testing; and protect environments against drift.
  • Create technical specifications, runbooks, shared playbooks, and supportable automation; lead blameless postmortems that produce systemic fixes; review engineers' work and mentor them to meet reliability KPIs.
  • Develop lean operational solutions through rapid, inexpensive experimentation and engage engineering teams before, during, and after delivery to define SLOs and operational readiness.
  • Improve reliability incrementally through measurable resilience testing and SLO refinement while keeping operations supportable and maintainable.
  • Collaborate with engineering, platform engineering, security and risk, data governance, engineering leadership, and architecture partners to integrate constraints into production standards and enforce control objectives.
  • Acquire domain knowledge of operated products and platforms, translate reliability needs and requirements into SLOs, runbooks, and production tooling, and address AI-related production failure modes.
  • Communicate technical concepts, evidence-based trade-offs, and narratives that align technical solutions with business objectives.
  • Collaborate with product engineering teams and customers as needed, maintain constructive relationships, align perspectives, and build consensus on feasible solutions.

Desired Qualifications

  • Preferred certifications include ServiceNow Certified System Administrator (CSA), Certified Application Developer (CAD), CIS-ITSM, CIS-HRSD, CIS-Data Foundations, AI/GenAI-focused ServiceNow credentials, or relevant Azure, AWS, GCP, Kubernetes, or DevOps/SRE certifications.

About the Company

Deloitte

Audits companies and advises on tax and technology

Deloitte audits companies and advises businesses and governments on tax, technology, and risk, and it is one of the Big Four, the world's four largest accounting firms. In 1849 its founder became the first independent auditor of a public company, Britain's Great Western Railway. Its auditors check companies' financial reports for errors and fraud before investors rely on them, while its consultants design strategy, install business software, and defend clients against cyberattacks. Clients pay fees for each audit or project, and each country's Deloitte firm is a separate business owned by its local partners. Deloitte was founded in London in 1845 and is based in New York.

Company size
10,001+
Company stage
Late Stage VC
Total funding
$17.1M
Headquarters
New York, NY
Founded
1845

Recently Posted Jobs

Explore more opportunities at Deloitte

See more jobs