S

Soft Tech Consulting

IT consulting delivering mission-critical solutions

AI Mid Software Engineer

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeWashington, DC, USA$120k - $165k /yr

About the Job

Requirements

  • A bachelor's degree is required, or nine years of relevant experience in lieu of a degree.
  • A minimum of five years of related experience is required.
  • Ability to iteratively tune, evaluate, and validate AI workflows, including refining prompts, agent configurations, tool-calling patterns, and retrieval strategies.
  • Experience designing and running structured tests for AI behavior, including regression tests, scenario-based evaluations, synthetic testing, and model comparisons.
  • Ability to diagnose and correct AI system failures, including hallucinations, retrieval issues, or tool-use errors, and implement guardrails or workflow adjustments.
  • Ability to document and maintain AI models, agent behaviors, experiments, and workflow designs.
  • Proficiency in data modeling and familiarity with AWS Bedrock services.
  • Proficiency in Python.
  • Comfort with CI/CD and Git-based development workflows.
  • Experience integrating observability tools into AI application workflows, including logging, metrics, and traces.
  • Intermediate experience with AI agents and workflow integration, AI prompting, Python software development, AWS AI services, and AI architecture.
  • Ability to communicate effectively, both verbally and in writing.
  • Ability to work independently with minimal oversight.
  • Ability to develop strong client relationships.
  • Must be a United States citizen and hold a Top Secret clearance.

Responsibilities

  • Design, build, and optimize agentic AI systems using orchestration frameworks such as LangGraph, CrewAI, Google ADK, and AWS Bedrock AgentCore.
  • Implement multi-step, tool-enabled AI agent workflows combining large language model reasoning, retrieval-augmented generation, retrieval systems, external APIs, and custom enterprise tools.
  • Use foundation models such as Claude Sonnet and Claude Opus on Amazon Bedrock to build structured generation, extraction, summarization, planning, and decision-support capabilities.
  • Tune and refine AI workflows through prompt engineering, instruction design, agent configuration, and tool-use optimization.
  • Conduct structured testing and evaluation of AI behavior, including regression tests, scenario-based evaluations, synthetic test creation, and model-to-model comparisons.
  • Diagnose hallucinations, retrieval mismatches, tool-use errors, and unexpected agent behavior, and implement corrective strategies such as guardrails and workflow adjustments.
  • Integrate AI components with vector databases, graph databases, internal applications, and other infrastructure tools in collaboration with the engineers managing the underlying systems.
  • Document model usage patterns, agent behaviors, experimental findings, workflow designs, and best practices for reproducibility and maintainability.
  • Collaborate with cybersecurity and governance teams to ensure AI implementations follow required policies and safe-use guidelines.

Desired Qualifications

  • A master's degree in Computer Science.
  • Familiarity with JavaScript or other programming languages.

About the Company

Soft Tech Consulting

IT consulting delivering mission-critical solutions

Soft Tech Consulting provides IT consulting services for government and private sector organizations in the DC metro area. The company delivers enterprise-class IT solutions at good value and supports design, implementation, and ongoing maintenance of mission-critical systems. The team consists of experienced information technology professionals, and services focus on delivering continuous quality customer support to ensure successful outcomes for clients of all sizes. The firm emphasizes its status as woman- and minority-owned and aims to help government and other clients acquire effective, affordable IT solutions through a combination of skilled staff, disciplined project execution, and strong customer service. Overall goal: help customers design, implement, and maintain critical IT infrastructure while providing reliable support and value-based solutions.

Company size
51-200
Company stage
Not listed
Total funding
Not listed
Headquarters
Chantilly, VA
Founded
1996

Recently Posted Jobs

Explore more opportunities at Soft Tech Consulting

See more jobs