Weekday AI

Proactive software engineer recruitment via referrals

Founding Platform Engineer

Site Reliability EngineeringPosted on Nov 11

Full-timeGurugram, Haryana, IndiaNo salary listedIn-person

About the Job

Requirements

At least 5 years of hands-on experience in Site Reliability Engineering, DevOps, Infrastructure Engineering, or Platform Engineering.
Direct ownership of at least one mission-critical, production-grade machine learning system, including deployment, monitoring, scaling, and operational reliability.
Strong understanding of AWS cloud infrastructure, including networking, compute, storage, security, and distributed systems.
Hands-on expertise with Kubernetes, Amazon ECS, Docker, Terraform or AWS CDK, and CI/CD pipelines.
Understanding of data engineering fundamentals, including data pipelines, databases, messaging systems, and distributed processing.
Experience operating highly available, low-latency production systems at meaningful scale.
Ability to troubleshoot complex infrastructure issues and independently lead production incident resolution.
Automation and scripting capabilities using Python, Bash, or similar languages.
Ability to independently architect, build, and own infrastructure in a fast-paced startup environment.

Responsibilities

Architect, build, and operate scalable, secure, and highly available cloud infrastructure, primarily on AWS.
Design and manage containerized workloads using Kubernetes, Amazon ECS, and Docker.
Implement Infrastructure as Code using Terraform, AWS CDK, or equivalent tools.
Build and maintain CI/CD pipelines, automated deployment workflows, and safe rollback mechanisms.
Design infrastructure capable of supporting millions of users and large-scale concurrent workloads.
Optimize cloud infrastructure for performance, scalability, availability, and cost efficiency.
Own the deployment, scalability, availability, and operational reliability of mission-critical machine learning systems.
Build and maintain infrastructure for production machine learning inference workloads, including large language models and speech models.
Manage GPU-based infrastructure, model-serving services, inference workloads, and execution orchestration.
Optimize model-serving infrastructure for latency, throughput, reliability, and cost.
Establish monitoring, recovery, and uptime standards for production machine learning systems.
Collaborate with AI/ML engineers to support model deployment, infrastructure requirements, and production performance.
Design and maintain reliable data infrastructure, including databases, message queues, streaming systems, and distributed workers.
Work with PostgreSQL, Redis, Kafka, and other distributed data-processing systems.
Build scalable data pipelines supporting machine learning inference, application services, and operational workloads.
Ensure data consistency, fault tolerance, and efficient processing across distributed environments.
Design and maintain reliable asynchronous processing and high-concurrency systems.
Establish end-to-end observability across infrastructure, application services, and machine learning workloads.
Implement monitoring, logging, distributed tracing, alerting, and incident-response frameworks.
Define and manage Service Level Indicators, Service Level Objectives, and operational reliability standards.
Own production incident management, root-cause analysis, and post-incident improvements.
Identify infrastructure bottlenecks and proactively eliminate recurring reliability issues.
Build automation to improve system availability, operational efficiency, and recovery capabilities.
Design secure infrastructure for sensitive user data, credentials, payments, and AI-agent operations.
Implement Identity and Access Management, secrets management, network isolation, access controls, and infrastructure hardening.
Architect isolated execution environments for concurrent AI agents and browser-based workloads.
Ensure secure and fault-tolerant execution of long-running workflows and critical transactions.
Establish infrastructure security practices that support scalability, resilience, and data protection.

Desired Qualifications

Experience managing GPU infrastructure and production large language model or machine learning inference systems.
Exposure to model-serving technologies such as vLLM, NVIDIA Triton, or equivalent platforms.
Experience with real-time voice AI, speech processing, or latency-sensitive inference workloads.
Experience scaling high-concurrency systems, long-running workers, or isolated execution environments.
Background in high-scale AI/ML product companies, fintech platforms, or infrastructure-intensive SaaS businesses.
Experience building platform infrastructure from scratch or working as an early infrastructure engineering hire.

Founding Platform Engineer

Weekday AI · Gurugram, India · Full-time · Posted 2026-11-11

Workplace: on_site

Department: Weekday's Client via platform

Description

This role is for one of Weekday’s clients

Min Experience: 5+ years
Location: NCR, Gurgaon, Haryana, India
JobType: full-time

We are looking for an exceptional Founding Platform Engineer with deep expertise in Site Reliability Engineering (SRE), DevOps, cloud infrastructure, and production Machine Learning (ML) systems.

In this high-ownership role, you will architect, build, and operate the core platform infrastructure supporting large-scale AI-powered applications. You will own critical infrastructure components across cloud architecture, production ML deployment, distributed systems, observability, security, and reliability.

You will work closely with the founding team and AI/ML engineers to build scalable, secure, and resilient infrastructure capable of supporting millions of users, high-concurrency workloads, and mission-critical AI operations.

A key requirement is direct ownership of at least one production-grade ML system, including its deployment, monitoring, scaling, and operational reliability.

Requirements

Key Responsibilities

Cloud Infrastructure & Platform Engineering

Architect, build, and operate scalable, secure, and highly available cloud infrastructure, primarily on AWS.
Design and manage containerised workloads using Kubernetes, Amazon ECS, and Docker.
Implement Infrastructure as Code (IaC) using Terraform, AWS CDK, or equivalent tools.
Build and maintain robust CI/CD pipelines, automated deployment workflows, and safe rollback mechanisms.
Design infrastructure capable of supporting millions of users and large-scale concurrent workloads.
Optimise cloud infrastructure for performance, scalability, availability, and cost efficiency.

Production ML Infrastructure & Reliability

Own the deployment, scalability, availability, and operational reliability of mission-critical machine learning systems.
Build and maintain infrastructure for production ML inference workloads, including Large Language Models (LLMs) and speech models.
Manage GPU-based infrastructure, model-serving services, inference workloads, and execution orchestration.
Optimise model-serving infrastructure for latency, throughput, reliability, and cost.
Establish monitoring, recovery, and uptime standards for production ML systems.
Collaborate with AI/ML engineers to support model deployment, infrastructure requirements, and production performance.

Data Engineering & Distributed Systems

Design and maintain reliable data infrastructure, including databases, message queues, streaming systems, and distributed workers.
Work with technologies such as PostgreSQL, Redis, Kafka, and other distributed data-processing systems.
Build scalable data pipelines supporting ML inference, application services, and operational workloads.
Ensure data consistency, fault tolerance, and efficient processing across distributed environments.
Design and maintain reliable asynchronous processing and high-concurrency systems.

Site Reliability Engineering & Observability

Establish end-to-end observability across infrastructure, application services, and ML workloads.
Implement monitoring, logging, distributed tracing, alerting, and incident-response frameworks.
Define and manage Service Level Indicators (SLIs), Service Level Objectives (SLOs), and operational reliability standards.
Own production incident management, root-cause analysis, and post-incident improvements.
Identify infrastructure bottlenecks and proactively eliminate recurring reliability issues.
Build automation to improve system availability, operational efficiency, and recovery capabilities.

Infrastructure Security & Scalability

Design secure infrastructure for sensitive user data, credentials, payments, and AI-agent operations.
Implement Identity and Access Management (IAM), secrets management, network isolation, access controls, and infrastructure hardening.
Architect isolated execution environments for concurrent AI agents and browser-based workloads.
Ensure secure and fault-tolerant execution of long-running workflows and critical transactions.
Establish infrastructure security practices that support scalability, resilience, and data protection.

Required Qualifications

5+ years of hands-on experience in Site Reliability Engineering, DevOps, Infrastructure Engineering, or Platform Engineering.
Direct ownership of at least one mission-critical, production-grade ML system, including deployment, monitoring, scaling, and operational reliability.
Exceptional understanding of AWS cloud infrastructure, including networking, compute, storage, security, and distributed systems.
Strong hands-on expertise with Kubernetes, ECS, Docker, Terraform or AWS CDK, and CI/CD pipelines.
Strong understanding of data engineering fundamentals, including data pipelines, databases, messaging systems, and distributed processing.
Experience operating highly available, low-latency production systems at meaningful scale.
Proven ability to troubleshoot complex infrastructure issues and independently lead production incident resolution.
Strong automation and scripting capabilities using Python, Bash, or similar languages.
Ability to independently architect, build, and own infrastructure in a fast-paced startup environment.

Preferred Qualifications

Experience managing GPU infrastructure and production LLM/ML inference systems.
Exposure to model-serving technologies such as vLLM, NVIDIA Triton, or equivalent platforms.
Experience with real-time voice AI, speech processing, or latency-sensitive inference workloads.
Experience scaling high-concurrency systems, long-running workers, or isolated execution environments.
Background in high-scale AI/ML product companies, fintech platforms, or infrastructure-intensive SaaS businesses.
Experience building platform infrastructure from scratch or working as an early infrastructure engineering hire.

Must-Have Skills

Site Reliability Engineering (SRE)
DevOps
AWS Cloud Infrastructure

Good-to-Have Skills

GPU Infrastructure
LLM Inference
Speech Models

Apply

Apply at Weekday AI

About the Company

Weekday AI

Proactive software engineer recruitment via referrals

Weekday.works helps companies hire software engineers through proactive outreach and peer-recommended candidates. Its platform automates tracking, pipeline management, and provides weekly updates, while it actively identifies engineers via peer networks, reaches out, shortlists, checks references, and schedules interviews. Differentiators include peer-backed vetting instead of traditional job boards, proactive outreach, and a passive-income reference feature that monetizes referrals. The goal is to reduce the time and effort of hiring by connecting companies with pre-vetted engineers who are open to new opportunities through a network-driven approach.

Company size: 201-500
Company stage: Seed
Total funding: $2.3M
Headquarters: Bengaluru, India
Founded: 2021

Recently Posted Jobs

Explore more opportunities at Weekday AI

See more jobs