F

Focused Labs

Enterprise software with custom AI agents

Platform Engineer - AI Infrastructure

Platform EngineeringPosted on Nov 3
Full-timeChicago, IL, USA$145k - $175k /yr

About the Job

Requirements

  • At least 5 years of experience in platform, infrastructure, DevOps, or Site Reliability Engineering roles.
  • Hands-on production experience with Kubernetes.
  • Experience with Azure and/or Google Cloud Platform.
  • Experience with Terraform or similar infrastructure-as-code tools.
  • Experience supporting AI/ML platforms or machine-learning workloads in production.
  • Proficiency in Python and solid scripting skills.

Responsibilities

  • Build and operate Kubernetes clusters on Azure AKS and Google Cloud GKE.
  • Write and maintain Terraform modules for cloud resources and environments.
  • Build continuous integration/continuous delivery and GitOps pipelines for platform and application deployments.
  • Monitor, troubleshoot, and improve the reliability of AI/ML platform services.
  • Deploy and operate supporting services for large language model applications, including model gateways, vector databases, tracing, and evaluation.
  • Support GPU workloads, including node pools, scheduling, and cost monitoring.
  • Write runbooks and automate day-two operations.
  • Build reference agents and large language model application templates that client teams can use as starting points.
  • Help application teams integrate with the platform and debug their workloads.
  • Prototype with agent frameworks and large language model APIs to test platform support requirements.

Desired Qualifications

  • Experience building large language model applications or agents using LangChain, LangGraph, LlamaIndex, or similar tools.
  • Experience with Azure OpenAI or Vertex AI.
  • Familiarity with GPU infrastructure and model serving.
  • Consulting or client-facing experience.
  • Experience shipping a large language model feature or agent to real users.
  • Interest in pairing and learning from senior engineers.
  • Ability to build documentation systems that automatically update for subsequent users and coding agents.

About the Company

Focused Labs

Enterprise software with custom AI agents

Focused Labs builds custom AI agents and modernizes legacy systems for enterprise clients, embedding senior engineers into client teams so solutions are built and owned by the client. It connects to the client’s existing tech stack and uses LangChain-based RAG pipelines and AI agents, evaluated through an Evaluation-Driven Development process to ensure production readiness. Unlike many firms, it maintains close, in-house collaboration and emphasizes ownership, lean delivery, and a formal testing framework, aided by a LangChain partnership and access to GenAI tools. Its goal is to help enterprises adopt and scale AI by delivering integrated, maintainable solutions that modernize legacy systems while preserving client ownership and control.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
2018

Recently Posted Jobs

Explore more opportunities at Focused Labs

See more jobs