G

GovCIO

Federal IT modernization and cybersecurity services

Senior Azure AI Solutions Architect / Engineer

AI Application Engineering +1Confirmed live in the last 24 hours
Full-timeRemote in USA$180k - $220k /yr

About the Job

Requirements

  • A bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Science, Artificial Intelligence, Engineering, or a related technical discipline, with 12 years of experience or commensurate experience.
  • A Public Trust clearance is required.
  • At least 8 years of progressive experience designing, developing, and implementing enterprise software, cloud, or data solutions.
  • At least 5 years of experience in senior engineering, technical architecture, cloud architecture, or comparable solution-design roles.
  • At least 3 years of hands-on experience designing or implementing artificial intelligence or machine learning solutions.
  • At least 2 years of recent hands-on experience designing and implementing Generative AI, large language model, or retrieval-augmented generation applications.
  • Demonstrated hands-on experience with the Microsoft Azure AI ecosystem, including Microsoft Foundry or Azure AI Foundry and Azure-hosted foundation models.
  • Demonstrated experience designing and implementing retrieval-augmented generation architectures using enterprise data.
  • Hands-on experience with Azure AI Search or comparable enterprise semantic or vector search technologies.
  • Strong understanding of vector embeddings and vector databases or search; semantic and hybrid search; chunking and document-processing strategies; prompt engineering and context management; grounding and citation or source attribution; large language model orchestration; and AI evaluation and hallucination mitigation.
  • Experience integrating large language models and AI services with enterprise data sources and applications.
  • Experience designing and implementing secure REST API and software development kit integrations.
  • Experience with Python and/or Java for enterprise AI or application development.
  • Experience with Microsoft Azure architecture, including Entra ID, role-based access control, managed identities, Key Vault, networking, storage, monitoring, and logging.
  • Ability to design solutions involving sensitive or restricted enterprise information with appropriate data isolation and authorization controls.
  • Experience taking at least one enterprise AI or machine learning solution from architecture or proof of concept through production deployment.
  • Experience establishing technical architecture while remaining directly involved in hands-on development and troubleshooting.
  • Ability to communicate complex AI architecture and technical concepts to technical and non-technical stakeholders.
  • Experience mentoring developers and transferring technical knowledge to existing engineering teams.

Responsibilities

  • Lead the architecture, design, development, and implementation of enterprise Generative AI solutions using the Microsoft Azure AI ecosystem.
  • Design and implement solutions using Microsoft Foundry, Azure OpenAI or model services, Azure AI Search, Azure AI Document Intelligence, and related Azure capabilities.
  • Architect and implement retrieval-augmented generation solutions over enterprise structured and unstructured data.
  • Develop enterprise search capabilities that identify relevant documents, pages, data elements, and supporting evidence across large document repositories.
  • Develop capabilities for natural-language question answering, document summarization, information extraction, structured output generation, and AI-assisted research.
  • Design and implement semantic, vector, hybrid, and agentic retrieval approaches suited to business requirements.
  • Develop secure integration patterns between Azure AI services and existing enterprise applications, APIs, databases, and document repositories.
  • Integrate AI functionality into existing enterprise applications through REST APIs, software development kits, Java services, and other approved integration patterns.
  • Evaluate and implement Azure AI Document Intelligence for document classification, metadata and data extraction, confidence scoring, and exception handling.
  • Design AI agents and orchestration workflows using Microsoft Foundry capabilities when appropriate.
  • Partner with application, IBM FileNet, and IBM DataCap technical teams to introduce AI capabilities while leveraging existing enterprise platforms and investments.
  • Design solutions that preserve application-level authorization and ensure users receive only AI-generated information derived from data they are authorized to access.
  • Implement Azure identity, access management, secrets management, networking, logging, monitoring, and security controls.
  • Establish AI evaluation and testing frameworks measuring retrieval accuracy, extraction accuracy, groundedness, hallucination rates, confidence, latency, performance, and business outcomes.
  • Develop and execute technical proofs of concept and minimum viable products, and transition successful capabilities into secure, scalable production implementations.
  • Work with business and technical stakeholders to translate business processes and pain points into actionable AI solutions.
  • Evaluate alternative AI technologies and integration approaches and provide technical recommendations based on feasibility, security, cost, scalability, and business value.
  • Establish reusable architecture patterns, development standards, and technical documentation for future enterprise AI implementations.
  • Mentor existing architects and developers on Azure AI, retrieval-augmented generation, large language model integration, prompt engineering, evaluation, and responsible AI development.
  • Provide hands-on knowledge transfer so successful AI capabilities can ultimately be maintained and expanded by the existing technical organization.

Desired Qualifications

  • Candidates located in the DC area are highly preferred.
  • Hands-on experience with Azure AI Document Intelligence, including document classification, custom extraction, structured data extraction, confidence scoring, and exception processing.
  • Experience building enterprise document intelligence, document search, or knowledge retrieval solutions involving large volumes of unstructured content.
  • Experience integrating AI solutions with enterprise content-management systems such as IBM FileNet.
  • Experience with IBM DataCap or comparable enterprise document capture and processing platforms.
  • Experience integrating AI functionality into existing Java-based enterprise applications.
  • Experience with Microsoft Foundry Agent Service and agentic AI architectures.
  • Experience with Microsoft Copilot Studio, including agents, connectors, actions, and enterprise workflow integration.
  • Experience with Azure DevOps, Git, continuous integration and continuous delivery, Infrastructure as Code, and DevSecOps practices for AI-enabled applications.
  • Experience implementing AI evaluation frameworks and automated testing for production large language model applications.
  • Experience with document-level or page-level citations, source attribution, and explainable or traceable AI responses.
  • Experience implementing human-in-the-loop workflows and confidence-based exception routing.
  • Knowledge of responsible AI principles, model governance, data privacy, and AI risk management.
  • Experience working with personally identifiable information, financial, benefits, healthcare, or other regulated or sensitive information.
  • Experience delivering solutions within federal government environments, including familiarity with FedRAMP, NIST controls, FISMA, ATO processes, and federal security requirements.
  • Experience evaluating AI platforms, models, and services based on cost, performance, security, accuracy, and operational suitability.
  • Experience with IBM watsonx or other enterprise AI platforms is beneficial but not required.

About the Company

GovCIO

Federal IT modernization and cybersecurity services

GovCIO provides IT services and digital solutions to the U.S. federal government, including IT modernization, digital services, data analytics, cybersecurity, DevSecOps, and management consulting. It wins prime federal contracts and delivers services through business units like Health and Civilian Agencies, National Security Solutions, and Veteran and Enterprise Technology Solutions, plus GovCIO Media & Research as a separate subsidiary. Primary customers include federal health agencies (VA, HHS), national security and civilian agencies, and it leverages contract vehicles such as VA's T4NG2. The company aims to help the government transform its IT landscape by delivering mission-critical technology and analytics at scale, supported by growth through strategic acquisitions and rebranding.

Company size
1,001-5,000
Company stage
Not listed
Total funding
Not listed
Headquarters
Washington DC, District of Columbia
Founded
2010

Recently Posted Jobs

Explore more opportunities at GovCIO

See more jobs