B

Booz Allen

Builds AI and cyber systems for the US government

AI Integration Engineer

AI Application EngineeringConfirmed live in the last 24 hours
Full-time$112.8k - $257k /yrIn-person

About the Job

Requirements

  • At least 3 years of experience building and maintaining production software systems in Python.
  • Experience integrating external services or APIs into distributed systems.
  • Experience implementing inference request flows, including handling latency, token limits, and batching strategies.
  • Experience writing integration tests for multi-service environments.
  • Experience integrating large language models into production services, including managing inference requests, model responses, and error-handling flows.
  • Knowledge of HTTP API design patterns, including authentication mechanisms such as OAuth2, API keys, or JWT.
  • Knowledge of containerization and CI/CD pipelines.
  • Ability to travel up to 25% of the time.
  • TS/SCI clearance with a polygraph is required.
  • A bachelor's degree in Computer Science, Engineering, or Data Science is required.

Responsibilities

  • Integrate AI-enabled capabilities into existing software systems by connecting models, inference endpoints, and orchestration components to production applications.
  • Implement AI features using established integration and software engineering patterns.
  • Ensure AI capabilities operate reliably, securely, and efficiently within distributed systems.
  • Contribute to evaluation and monitoring approaches.
  • Refine integration workflows.
  • Collaborate with cross-functional teams to deliver scalable AI functionality.

Desired Qualifications

  • Experience with message queues or event streaming, including Kafka, SQS, or SNS, and patterns for idempotency and handling out-of-order or duplicate events.
  • Experience implementing resilience patterns such as retries with backoff, timeouts, and circuit breakers to ensure reliable system behavior.
  • Experience with cloud AI platform tooling such as AWS Bedrock AgentCore, Google Gemini Enterprise Agent Platform, or Microsoft Foundry Agent Service.
  • Experience with Docker, Kubernetes, or Infrastructure-as-Code tooling.
  • Experience with multi-step agentic workflows or orchestration concepts and how they integrate into existing systems.
  • Experience with agent memory concepts such as session-level and persistent state, and how they relate to application logic.
  • Experience with orchestration frameworks for AI-enabled systems such as LangGraph, CrewAI, or AutoGen, and supporting data stores such as Redis and Postgres.

About the Company

Booz Allen

Builds AI and cyber systems for the US government

Booz Allen builds and runs technology for the U.S. government, mostly for the military and intelligence agencies, and its engineers work alongside consultants who know each agency's mission. In 1958, it helped the U.S. Navy create PERT, a project-scheduling method first used on the Polaris submarine missile program and later adopted across government and industry. Its teams design cyber defenses, AI and data tools, and battlefield communications, and it sells its own products, such as Vellox, a suite of AI tools that spot and fight off hackers. Agencies pay mainly through multi-year contracts that reimburse costs, bill hours, or set a fixed price. Booz Allen was founded in 1914 and is based in McLean, Virginia.

Company size
11-50
Company stage
IPO
Headquarters
McLean, VA
Founded
1914

Recently Posted Jobs

Explore more opportunities at Booz Allen

See more jobs