Test & Evaluation AI SME

Overview

Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and practice, producing Results that Matter. Come work with the best! We offer opportunity, unique challenges, and clear-sighted commitment to the mission. SPA: Objective. Responsive. Trusted.  

The Joint, Office of the Secretary of Defense, Interagency Division (JOID) provides expert support services to a range of customers spanning across the Department of Defense, Federal Civilian, and international markets. JOID provides a diverse portfolio of analytical and programmatic capabilities to help our customers make informed decisions on their most challenging issues.

The Critical Infrastructure Group (CIG) within JOID provides technical, programmatic and analytical support to customers with missions in national security to include the Department of Homeland Security (DHS), Health and Human Services (HHS), and the Federal Aviation Administration (FAA). The Group brings technical and operational expertise in fields of countering weapons of mass destruction, critical infrastructure protection, emergency response, nuclear non-proliferation, weapons deployment programs, and transportation safety. In addition to management and advisory services, CIG staff collaborate closely with our clients to provide high-quality modeling, simulation, software, and analytical products to meet the most demanding government standards and timelines.

We have a near-term need for a Testing and Evaluation Artificial Intelligence SME to provide hybrid support for DHS customers located in Washington, DC.

Responsibilities

The T&E Analyst will review and comment on revisions of program T&E documents and provide the Government advice. Support multiple DHS acquisition programs, especially in capabilities that involve AI. Provide AI T&E expertise to assist the Government with ensuring that DHS acquisition programs generate suitable, executable T&E approaches that adequately assess the effectiveness, suitability, reliability, robustness, security, explainability, and operational risks of AI technologies embedded in technical solutions. Provide support, guidance, recommendations, and mentoring to all Deputy Directors regarding AI T&E and the development of DHS standards for evaluating embedded AI technologies, including reviews of program TEMPs, Operational Assessment/Test Plans, Operational Assessment/Test Reports, and Letters of Assessment. Provide support to the instructional advisor regarding the inclusion of AI T&E within the T&E curriculum. Provide, as directed, focused training on AI T&E. Research Government and industry acquisition and T&E sources and analyze results for applicable AI evaluation standards, tools, metrics, plans, and procedures.

Qualifications

Required:

• Advanced Degree or equivalent credits/certifications.
• 10+ years of relevant experience.
• Active Secret clearance .
• Demonstrated skills and abilities to develop and implement strategies, standards, and methods to integrate AI T&E activities—including, but not limited to, data quality and representativeness assessments, AI performance and robustness testing, bias assessments, human-AI interaction evaluations, adversarial testing, and post-deployment monitoring—in support of acquisition programs, including, but not limited to, aviation, detection equipment, cybersecurity, information technology, decision-support systems, and autonomous systems.
  
  

Desired:

• DHS T&E Level 3 equivalent certification.

Pay Range Information

At SPA, we strive to deliver a robust total compensation package that will attract and retain top talent. Elements of the compensation package include competitive base pay and variable compensation opportunities. SPA provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health insurance, flexible spending accounts, health savings accounts, retirement savings plans, life and disability insurance programs, and a number of programs that provide for both paid and unpaid time away from work. The specific programs and options available to any given employee may vary depending on eligibility factors such as geographic location, date of hire, etc. Please note that the salary information shown below is a general guideline only. Salaries are commensurate with experience and qualifications, as well as market and business considerations. Washington, DC, Pay Transparency Salary range: USD $170,000.00/Yr. - USD $200,000.00/Yr.