AI Systems Engineer

We are seeking a highly skilled, self-motivated, and resourceful AI Systems Engineer to spearhead the design and deployment of AI capabilities supporting the highest levels of government. This is a unique opportunity to build and manage a complete AI team, vision, infrastructure, and suite of capabilities from the ground up. This role demands a deep understanding of hardware, data engineering, software engineering, containerization, and system administration, coupled with a proactive and problem-solving mindset. 

Seize your opportunity to fulfill our AI systems engineering requirements across our set of managed services and processes. With GDIT, you will gain unmatched experience within our fast-paced environment along with extensive options for further training, certification, and career advancement. 

How an AI Systems Engineer will make an Impact:

• Identify and recommend optimal hardware infrastructure (compute, storage, networking) required to support inference workloads within a self-hosted, offline environment. 

• Implement the integration of AI-specific hardware (e.g., GPUs and servers) within our existing Kubernetes clusters. Configure and optimize Kubernetes for AI workloads. 

• Research, deploy, and manage suitable engines for large language models and other AI models. Optimize these engines for performance and efficiency. 

• Evaluate and select open-weight models based on accuracy, performance, consistency, and unbiased responses. 

• Implement prompt engineering concepts to provide optimal output and the best user experience. 

• Develop Extract, Transform, Load (ETL) pipelines of structured and unstructured data from a verity of disparate sources. 

• Properly format, chunk, and embed documents into vector databases for advanced search and Retrieval Augmented Generation (RAG) capabilities. 

• Implement and manage appropriate database solutions for storing and retrieving data relevant to the AI applications. Ensure data integrity, security, and performance. 

• Maintain and troubleshoot the underlying Linux operating systems powering the AI infrastructure. Ensure system stability, security, and performance. 

• Configure on-prem S3-compatible storage solutions for storing datasets, models, and other AI-related artifacts. 

• Implement and maintain stringent security measures to protect the AI infrastructure and data within the environment. Adhere to internal compliance requirements. 

• Contribute to engineering of software that interacts with our internal models and other data platforms. 

• Proactively monitor the AI infrastructure, diagnose and resolve issues, and provide support to internal users of the AI capabilities. 

• Create comprehensive documentation for the infrastructure, deployment processes, and operational procedures. 

• Stay up to date with the latest advancements in hardware, software, and best practices, and adapt them for our unique environment. 

What You’ll need to Succeed:

• Experience with containerization technologies, particularly Kubernetes, including hardware integration (e.g., GPU nodes). 

• Strong understanding of AI/ML concepts and experience deploying and managing inference engines. 

• Experience in designing and implementing data pipelines using relevant tools and technologies. 

• Software engineering/development experience. 

• Proficiency in database management. 

• Proficiency in Linux system administration, including scripting and automation. 

• Experience with configuring and managing S3-compatible storage solutions. 

• Excellent problem-solving and troubleshooting skills, with the ability to work independently in a challenging environment. 

• Strong understanding of security best practices for isolated environments. 

• Excellent communication and documentation skills. 

• Education: BS in Computer Engineering, Computer Science or related technology field. Experience may be substituted for education. 

• Required Experience: 10+ years 

• Required Technical Skills: DoD 8140/8570 IAT III compliance 

• Security Clearance Level: Active Top Secret

• Location: Washington, District of Columbia; limited telework may be available 

GDIT Is Your Place: 

• 401K with company match 

• Comprehensive health and wellness packages 

• Internal mobility team dedicated to helping you own your career 

• Professional growth opportunities including paid education and certifications 

• Cutting-edge technology you can learn from  

• Rest and recharge with paid vacation and holidays