C

Capgemini

Global consulting, technology services, outsourcing

AI Platform Engineer

Applied Machine LearningUpdated on Nov 14
Full-timeAtlanta, GA, USAIn-person

About the Job

Requirements

  • Strong production engineering experience with Python and one systems language; Go or Rust are welcome, along with Kubernetes, infrastructure-as-code, and a major cloud.
  • Hands-on experience with LLM infrastructure, including a model gateway pattern, model serving, and vector or retrieval systems.
  • Experience building with an agent orchestration framework and understanding tool calling and the Model Context Protocol.
  • Experience building or operating evaluation harnesses, including golden datasets, regression gates in continuous integration, and LLM-judge calibration.
  • Post-training experience through fine-tuning or post-training a model, building its data pipeline, or reproducing recent research techniques in production systems.
  • Daily, hands-on use of AI coding assistants in the development workflow.

Responsibilities

  • Own one or more platform components end to end, such as a model gateway for routing, failover, caching, and per-line cost attribution; agent runtime and orchestration; evaluation harness; guardrail engine; tool and agent registry; or shared product services.
  • Own the training and adaptation loop, including pipelines that turn production traces and evaluation verdicts into reinforcement learning and fine-tuning datasets, and infrastructure to train, evaluate, and serve tuned large and small language models behind the same gates as vendor models.
  • Own the reliability, latency, and cost of the systems built; platform services carry baselines and the engineer holds them.
  • Build self-service surfaces for product engineers, with components that include documentation and sensible defaults and do not require a ticket queue.
  • Co-build with product teams, embedding new shared services with a product line and graduating them to platform services when proven.
  • Write specifications, harnesses, evaluations, and guardrails; AI agents execute implementation loops, with engineering judgment focused on review.
  • Follow three human gates for shipped work: specification approval, merge, and release. Regulated code paths involving money movement, authentication, cryptography, and secrets remain human-owned.

Desired Qualifications

  • Experience with guardrail engines or AI observability, such as NeMo Guardrails, OpenTelemetry GenAI conventions, LangSmith, or Braintrust.
  • Reinforcement learning infrastructure experience, including reward modeling and RLHF or GRPO-class pipelines, or small language model distillation experience.
  • Multi-tenant SaaS infrastructure experience, including tenancy isolation, metering, and usage-based billing.
  • Financial services engineering experience with banks, insurers, or payment providers; experience in another regulated industry or security engineering also counts.
  • Open-source contributions or a portfolio of deployed agents and evaluation suites.
  • Depth in four or five of the stated technical areas is valued more than surface familiarity across all of them.
  • Experience with components comparable to the reference stack: self-hosted LangSmith and LangGraph Platform; model providers behind a swappable gateway; PostgreSQL with pgvector, ClickHouse, S3-compatible object storage, Neo4j Enterprise, agent memory over MCP, MCP-native connectors, OpenTelemetry, Grafana, Kubernetes, Helm, and Argo CD. A direct tool-for-tool match is not required.

About the Company

Capgemini

Global consulting, technology services, outsourcing

Capgemini provides consulting, technology services, and outsourcing to help organizations transform digitally. Its offerings include strategy and transformation consulting, system integration, application development, IT infrastructure management, and managed IT operations. It differentiates itself with a global presence in over 50 countries and a focus on applying AI, cloud, and cybersecurity to real business problems. Its goal is to help clients navigate digital transformation and improve efficiency and innovation through tailored, contract-based or managed services.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1967

Recently Posted Jobs

Explore more opportunities at Capgemini

See more jobs