P

Pennsylvania State University

Land-grant university in University Park, PA

Artificial Intelligence / Machine Learning Verification and Validation Engineer - Information Science Division, All-Domain Analytics and Signatures Office

Full-TimeUpdated on 10/1/2026
$110.5k - $241k/yr
Entry, Junior, Mid, Senior
Bachelor's
State College, PA, USA+1 moreMore locations: Reston, VA, USA
In PersonFully on-site at either State College, PA or Reston, VA.
No H1B Sponsorship
US Citizenship, US Top Secret Clearance Required

About the job

Requirements
  • Bachelor's degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field.
  • Proficiency in Python and SQL for data manipulation, analysis, and pipeline development.
  • Familiarity with data annotation tools and workflows such as CVAT, Label Studio, or equivalent.
  • Understanding of machine learning concepts, including how data quality impacts model training, evaluation, and deployment.
  • Eligibility to obtain a government security clearance.
  • U.S. citizenship.
  • For the Advanced Professional grade, 5+ years of relevant experience is required.
  • For the Intermediate Professional grade, 2+ years of relevant experience is required.
  • For the Professional grade, no prior relevant work experience is required.
Responsibilities
  • Label, annotate, and curate multi-modal datasets, including imagery/FMV, geospatial, signals, and text/documents, to support AI/ML model development and evaluation.
  • Design and implement data pipelines for ingestion, transformation, quality control, and cataloging of classified and open-source data.
  • Develop and maintain annotation standards, labeling guidelines, and data governance processes to ensure consistency and reproducibility across projects.
  • Conduct independent verification and validation of datasets and model outputs to ensure data integrity, label accuracy, and fitness for intended use.
  • Collaborate with research scientists, algorithm developers, and program stakeholders to identify, acquire, and prioritize data requirements for specific AI/ML projects.
  • Build and maintain data catalogs, metadata schemas, and access-controlled repositories to make curated datasets discoverable and accessible to the research team.
  • Use Python, SQL, and annotation platforms such as CVAT and Label Studio to automate labeling workflows, perform exploratory data analysis, and develop quality metrics.
  • Document data provenance, lineage, and known limitations to support model evaluation, reproducibility, and responsible AI practices.
  • Collaborate within an Agile development environment as part of a large research team.
  • Complete required background checks and comply with applicable drug testing, electronic monitoring, and physical monitoring requirements.
Desired Qualifications
  • Experience working with Department of Defense or Intelligence Community data, workflows, or operational environments.
  • Familiarity with geospatial data formats such as shapefiles, GeoJSON, and AIS; imagery/FMV exploitation; or signals data processing.
  • Experience with data versioning tools such as DVC and LakeFS or data catalog platforms.
  • Knowledge of independent verification and validation methodologies and quality assurance practices for data-driven systems.
  • Exposure to containerized development environments such as Docker and Kubernetes and cloud platforms such as AWS and Azure.
  • Current eligibility for access to classified information at the TS/SCI level or higher.

About the company

P

Pennsylvania State University

View

Pennsylvania State University is a multi-campus, land-grant public research university whose mission spans undergraduate and graduate education, research, and public service.

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A

Get referred to Pennsylvania State University

See people who can refer or advise you