G

GEICO

Sells vehicle insurance to drivers and businesses

Senior Software Engineer - AI Agent Platform

Backend EngineeringConfirmed live in the last 24 hours
Full-time$105k - $230k /yrIn-person

About the Job

Requirements

  • At least 5 years of professional software engineering experience building and operating production backend systems at scale.
  • Experience owning the end-to-end design and delivery of services or major features.
  • Strong proficiency in one or more of Python, Java, Go, or comparable languages.
  • Strong distributed-systems fundamentals, including concurrency, consistency, fault tolerance, data modeling, API design, and scalability.
  • Experience operating production services with continuous integration and continuous delivery, automated testing, and Kubernetes or other container platforms.
  • Hands-on operational experience supporting production systems, including observability, monitoring and alerting, on-call participation, incident response, and postmortems.
  • Experience scaling systems or improving reliability, such as meeting service-level objectives, performance tuning, capacity planning, or eliminating recurring failure modes.
  • Background in application, platform, or infrastructure engineering.

Responsibilities

  • Own the design and end-to-end delivery of significant platform components and features, from technical design and API definition through implementation, rollout, and iteration.
  • Write design documents, contribute to design and code reviews, and make sound tradeoffs within the area of ownership.
  • Mentor junior and mid-level engineers and help raise the engineering bar on the team.
  • Collaborate with product managers, data scientists, and consuming teams to understand workflow needs and translate them into platform features.
  • Build durable execution engines for agent workflows, including state management, checkpointing, retries, idempotency, and recovery for long-running, multi-step, tool-calling workflows.
  • Build services, APIs, and integration contracts, including protocols such as MCP, so teams can connect agents to internal services, data sources, and external systems consistently.
  • Build shared retrieval-augmented generation platform services for ingestion, chunking, embedding, indexing, and retrieval, with access controls, freshness guarantees, and low-latency retrieval at scale.
  • Build pipelines and services that collect data from agent executions and related enterprise systems, turn it into continuously updated domain knowledge and agent context, and serve it through dashboards, reports, retrieval, and tool interfaces.
  • Build high-throughput offline and online evaluation pipelines that simulate scenarios, capture execution traces, detect regressions, and store execution data in a shared framework.
  • Build a multi-tenant service for teams to publish, version, discover, and reuse agent skills and tools, supported by permissions, security review, and governance.
  • Implement reliability, isolation, and cost controls, including sandboxing, rate limiting, quotas, service-level objectives, and enterprise-scale capacity planning.
  • Work across storage and data modeling, services, deployment infrastructure, and developer-facing software development kits, command-line interfaces, and portals.
  • Own the production health of built components, help define service-level indicators and objectives, and build dashboards and alerts to detect issues.
  • Build observability with metrics, structured logging, and distributed tracing to diagnose failures in agent harnesses and complex workflows.
  • Design for scale and resilience through load testing, capacity planning, graceful degradation, and failure-mode analysis.
  • Participate in the on-call rotation, respond to incidents, and contribute to blameless postmortems that produce durable fixes.
  • Contribute to operational excellence through runbooks, alert hygiene, and safe deployment practices such as canaries, feature flags, and rollbacks.

Desired Qualifications

  • Experience with durable execution or workflow orchestration systems such as Temporal, Restate, DBOS, Azure Durable Task, or AWS Step Functions, or with event-driven architectures such as Kafka.
  • Experience building internal developer platforms, multi-tenant services, or software development kits used by many teams.
  • Experience building generative AI applications and agentic harnesses using frontier and open-weight models such as GPT, Claude, Gemini, Llama, or Qwen, and frameworks such as LangGraph, Microsoft Agent Framework, OpenAI Agents SDK, or Claude Agent SDK.
  • Experience building retrieval-augmented generation systems at scale, including ingestion pipelines, hybrid retrieval using dense and keyword search, reranking, and permission-aware retrieval, with engines such as Azure AI Search, OpenSearch, or Vespa.
  • Experience building data pipelines or analytics systems, such as streaming ingestion, event processing, knowledge graphs, or feature stores, that turn operational data into insights or context for downstream consumers.
  • Experience building evaluation frameworks for large language model or agent systems, or capability ecosystems such as MCP server registries or agent skills marketplaces.
  • Experience with observability and evaluation tools such as OpenTelemetry, Prometheus, Grafana, Datadog, Langfuse, LangSmith, Braintrust, or Arize Phoenix.
  • Experience with site reliability engineering practices such as error budgets, chaos engineering, or game days.
  • Experience with cloud platforms such as Azure or AWS, including managed agent services such as Microsoft Foundry Agent Service or Amazon Bedrock AgentCore.
  • Understanding of AI security and governance, including prompt injection, sandboxing, and supply chain security for third-party tools and skills.

About the Company

GEICO

Sells vehicle insurance to drivers and businesses

GEICO sells vehicle insurance to drivers and businesses across the United States, with private passenger auto coverage at the core of its business. It handles quotes mainly through its website and phone lines, while local agencies also sell its policies. Customers pay premiums for protection against covered accidents, vehicle damage and liability, and use its app to manage policies and report claims. The GEICO Insurance Agency also arranges home, renters and life coverage written by unaffiliated insurers, expanding the choices available through its website. Founded in 1936, GEICO is owned by Berkshire Hathaway and headquartered in Bethesda, Maryland.

Company size
10,001+
Company stage
Acquired
Total funding
Not listed
Headquarters
Bethesda, MD
Founded
1936

Recently Posted Jobs

Explore more opportunities at GEICO

See more jobs