P

Peraton

Runs and secures technology for federal agencies

Senior AI Integration Developer

AI Application EngineeringConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • A minimum of 8 years of experience with a Bachelor's degree, 6 years with a Master's degree, or 3 or more years with a PhD in Computer Science, Computer Engineering, Information Systems, or similar or related programs.
  • Experience deploying and working with locally hosted models such as Ollama or llama.cpp in offline or restricted network environments.
  • Strong understanding of the Model Context Protocol, including server design, tool schemas, and client-server communication.
  • Experience with prompt engineering and system prompt design, particularly tuning prompts for smaller or quantized local models.
  • Experience with agentic artificial intelligence patterns, including multi-step reasoning, tool chaining, and error recovery.
  • Familiarity with model selection tradeoffs, including capability, context length, quantization, and hardware requirements.
  • Ability to design structured evaluation approaches for AI output quality and tool performance.
  • Strong judgment about AI assistant user experience and effective tool calls and responses.
  • Proficiency in Python and familiarity with FastAPI or comparable frameworks.
  • Experience with Docker and containerized service development.
  • Familiarity with TypeScript and Node.js for server-side development.
  • Experience with React for implementing AI assistant or chat user-interface components.
  • Experience with Git, continuous integration and continuous delivery pipelines, and automated testing infrastructure.
  • Must be a U.S. citizen and able to obtain or maintain a Secret clearance.
  • Candidate should be local and able to work within the Red Bank, New Jersey; Basking Ridge, New Jersey; or Silver Spring, Maryland locations.

Responsibilities

  • Design and implement Model Context Protocol servers and tool interfaces that expose application data and functionality to the AI assistant.
  • Deploy and configure locally hosted models, such as Ollama, for use in air-gapped or connectivity-constrained environments.
  • Evaluate and select local models for specific assistant tasks, assessing capability and performance tradeoffs across model sizes and families.
  • Integrate large language model inference endpoints into the application backend and frontend, supporting local and cloud-hosted models where applicable.
  • Develop and refine system prompts, tool definitions, and context-management strategies optimized for local model capabilities and limitations.
  • Define and execute evaluation frameworks to assess AI output quality, tool-call accuracy, and assistant reliability.
  • Identify high-value use cases with domain experts and stakeholders and translate them into concrete AI tool designs.
  • Maintain and extend backend Python and TypeScript/Node.js services supporting AI functionality, or work closely with other engineers to do so.
  • Document AI architecture, tool schemas, prompt strategies, model configurations, and evaluation results.
  • Stay current with the evolving local model and Model Context Protocol ecosystem.
  • Lead the design and implementation of an AI assistant capability within an existing web application supporting RF spectrum monitoring for the Department of Defense.
  • Understand the application domain and concepts of operations to develop appropriate Model Context Protocol tool chains.
  • Work closely with the broader engineering team and domain stakeholders to identify AI use cases, implement and iterate on Model Context Protocol tools, and evaluate and improve AI-generated outputs.

Desired Qualifications

  • Experience with LangChain, LangGraph, and FastMCP.
  • Experience with GPU hardware performance benchmarking on constrained edge-deployed infrastructure.
  • Familiarity with performance evaluation, including tool-selection accuracy, parameter-extraction correctness, multi-step reasoning success rates, response-quality scoring, latency benchmarking, and regression testing across model versions.
  • Experience fine-tuning or adapting open-weight models for domain-specific tasks.
  • Familiarity with retrieval-augmented generation architectures and vector databases in offline or on-premise deployments.
  • Background in radio frequency, spectrum management, spectrum sensing, software-defined radios, propagation modeling, signal processing, or related Department of Defense domains.
  • Cybersecurity awareness in the context of artificial intelligence systems and Department of Defense environments.
  • Experience with cloud-hosted large language model APIs as a secondary deployment target.
  • Active Secret or higher clearance.

About the Company

Peraton

Runs and secures technology for federal agencies

Peraton builds and runs secure technology for American defense, intelligence, space, and civilian agencies, from military networks to satellite ground stations. In 2025, the Federal Aviation Administration chose it to manage the overhaul of the nation's air traffic control system, replacing copper wiring with fiber and upgrading radar and radios. Its engineers, many holding security clearances, run and defend agency networks and data centers, write mission software, and operate space and communications systems, and agencies pay for this work through multiyear contracts. Peraton was formed in 2017, when private-equity firm Veritas Capital bought Harris Corporation's government IT business, and is based in Reston, Virginia.

Company size
10,001+
Company stage
Grant
Total funding
$60M
Headquarters
Reston, VA
Founded
2017

Recently Posted Jobs

Explore more opportunities at Peraton

See more jobs