Full-Time

Artificial Intelligence / Machine Learning Verification and Validation Engineer

Information Science Division, All-Domain Analytics and Signatures Office

Posted on 8/17/2026

Pennsylvania State University

Pennsylvania State University

Land-grant university in University Park, PA

Compensation Overview

$110.5k - $241k/yr

No H1B Sponsorship

State College, PA, USA + 1 more

More locations: Reston, VA, USA

In Person

Fully on-site at either State College, PA or Reston, VA.

US Citizenship, US Top Secret Clearance Required

Bachelor's

Category
AI & Machine Learning (1)
QA & Testing (1)
Required Skills
Kubernetes
Microsoft Azure
Agile
Python
SQL
Machine Learning
Data Engineering
Docker
Quality Assurance (QA)
AWS
Data Governance
Data Analysis

Get referred to Pennsylvania State University

See people who can refer or advise you

Requirements
  • Bachelor's degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field.
  • Proficiency in Python and SQL for data manipulation, analysis, and pipeline development.
  • Familiarity with data annotation tools and workflows such as CVAT, Label Studio, or equivalent.
  • Understanding of machine learning concepts, including how data quality impacts model training, evaluation, and deployment.
  • Eligibility to obtain a government security clearance.
  • U.S. citizenship.
  • For the Advanced Professional grade, 5+ years of relevant experience is required.
  • For the Intermediate Professional grade, 2+ years of relevant experience is required.
  • For the Professional grade, no prior relevant work experience is required.
Responsibilities
  • Label, annotate, and curate multi-modal datasets, including imagery/FMV, geospatial, signals, and text/documents, to support AI/ML model development and evaluation.
  • Design and implement data pipelines for ingestion, transformation, quality control, and cataloging of classified and open-source data.
  • Develop and maintain annotation standards, labeling guidelines, and data governance processes to ensure consistency and reproducibility across projects.
  • Conduct independent verification and validation of datasets and model outputs to ensure data integrity, label accuracy, and fitness for intended use.
  • Collaborate with research scientists, algorithm developers, and program stakeholders to identify, acquire, and prioritize data requirements for specific AI/ML projects.
  • Build and maintain data catalogs, metadata schemas, and access-controlled repositories to make curated datasets discoverable and accessible to the research team.
  • Use Python, SQL, and annotation platforms such as CVAT and Label Studio to automate labeling workflows, perform exploratory data analysis, and develop quality metrics.
  • Document data provenance, lineage, and known limitations to support model evaluation, reproducibility, and responsible AI practices.
  • Collaborate within an Agile development environment as part of a large research team.
  • Complete required background checks and comply with applicable drug testing, electronic monitoring, and physical monitoring requirements.
Desired Qualifications
  • Experience working with Department of Defense or Intelligence Community data, workflows, or operational environments.
  • Familiarity with geospatial data formats such as shapefiles, GeoJSON, and AIS; imagery/FMV exploitation; or signals data processing.
  • Experience with data versioning tools such as DVC and LakeFS or data catalog platforms.
  • Knowledge of independent verification and validation methodologies and quality assurance practices for data-driven systems.
  • Exposure to containerized development environments such as Docker and Kubernetes and cloud platforms such as AWS and Azure.
  • Current eligibility for access to classified information at the TS/SCI level or higher.
Pennsylvania State University

Pennsylvania State University

View

Pennsylvania State University is a multi-campus, land-grant public research university whose mission spans undergraduate and graduate education, research, and public service.

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A

Get referred to Pennsylvania State University

See people who can refer or advise you