Full-Time

Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer

Visualization and Decision Support Division, All-Domain Analytics and Signatures Office

Updated on 9/12/2026

Pennsylvania State University

Pennsylvania State University

Land-grant university in University Park, PA

Compensation Overview

$168k - $318.8k/yr

No H1B Sponsorship

State College, PA, USA + 1 more

More locations: Reston, VA, USA

In Person

Fully on-site in either State College, Pennsylvania or Reston, Virginia.

US Citizenship, US Top Secret Clearance Required

Bachelor's, Master's

Category
Data & Analytics (2)
,
Required Skills
Kubernetes
Microsoft Azure
Agile
Python
SQL
Machine Learning
Data Engineering
Docker
Quality Assurance (QA)
AWS
Data Governance

Get referred to Pennsylvania State University

See people who can refer or advise you

Requirements
  • A bachelor's degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field is required.
  • Extensive experience designing and managing data curation, annotation, or independent verification and validation workflows for artificial intelligence and machine learning systems is required.
  • A deep understanding of machine learning fundamentals, including how data quality, labeling strategies, and dataset composition affect model training, evaluation, and deployment, is required.
  • Strong proficiency in Python and SQL for data manipulation, pipeline development, and analysis is required.
  • Experience with data annotation tools and platforms such as CVAT, Label Studio, or equivalent is required.
  • The role requires eligibility to obtain a government security clearance, compliance with ARL drug testing, and compliance with applicable electronic and physical monitoring requirements.
  • U.S. citizenship is required.
  • If filled as R&D Engineer – Artificial Intelligence, Principal Professional, the position requires a bachelor's degree in Engineering or Science and 19 or more years of relevant experience.
  • If filled as R&D Engineer – Artificial Intelligence, Senior Professional, the position requires a bachelor's degree in Engineering or Science and 14 or more years of relevant experience.
Responsibilities
  • Serve as the technical lead for the Independent Verification and Validation and Data Curation Center of Excellence by setting priorities, defining standards, and driving the team's technical direction.
  • Mentor, guide, and coordinate engineers performing data labeling, annotation, curation, and independent verification and validation across multiple data modalities.
  • Establish and evolve annotation standards, labeling guidelines, data governance frameworks, and quality assurance processes to ensure consistency and reproducibility at scale.
  • Design and oversee data pipelines for ingestion, transformation, quality control, and cataloging of classified and open-source data.
  • Lead independent verification and validation efforts on datasets and model outputs by defining acceptance criteria and fitness-for-use standards.
  • Act as the primary point of contact between the data curation team and research scientists, algorithm developers, and program stakeholders to translate data needs into actionable plans.
  • Present findings, status, and recommendations to leadership and sponsors through briefings, papers, and technical artifacts.
  • Evaluate and introduce annotation tools, platforms, data versioning practices, and metadata management practices.
  • Drive automation of manual data analysis and curation processes to improve efficiency and scalability.
  • Architect and maintain data catalogs, metadata schemas, and access-controlled repositories that make curated datasets discoverable and accessible to the broader research team.
  • Work within an Agile development environment on a large research team.
Desired Qualifications
  • Prior experience leading or managing a technical team.
  • Experience working with Department of Defense or Intelligence Community data, workflows, or operational environments.
  • Familiarity with geospatial data formats such as shapefiles, GeoJSON, and AIS, imagery or full-motion video exploitation, or signals data processing.
  • Experience with data versioning tools such as DVC and LakeFS or data catalog platforms.
  • Knowledge of independent verification and validation methodologies and test and evaluation practices for data-driven systems.
  • Experience with containerized development environments such as Docker and Kubernetes and cloud platforms such as AWS and Azure.
  • A master's degree or higher in a relevant field.
  • Current eligibility to access classified information at the Top Secret/Sensitive Compartmented Information level or higher and potential subjection to a government background investigation to update clearance eligibility.
Pennsylvania State University

Pennsylvania State University

View

Pennsylvania State University is a multi-campus, land-grant public research university whose mission spans undergraduate and graduate education, research, and public service.

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A

Get referred to Pennsylvania State University

See people who can refer or advise you