Test Engineer 3

Location: Annapolis Junction, MD 

Category: Test Engineer 3

Travel Required: No
Remote Type: No
Clearance: TS/SCI w/ Polygraph

Position Requirements

We are seeking a Senior Test Automation Engineer to design, build, and maintain automated test solutions across both back-end services (REST APIs) and web user interfaces. This role requires strong hands-on engineering skills in Linux command-line tooling, Python-based automation, containerized test execution (Docker/Podman), and CI/CD integration using Jenkins and GitLab pipelines. The successful candidate will also help evolve our existing in-house automation framework, including planning and executing migration efforts from legacy Robot Framework implementations to newer platforms.

Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results. Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports. Works with other test organizations to support T&E program integration. Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance area as assigned in the SOW

Position Responsibilities

• Develop, maintain, and enhance automated test suites for back-end REST APIs and web-based user interfaces.
• Build and maintain a scalable, reliable test automation harness (framework) including execution, reporting, data setup/teardown, and CI/CD integration.
• Implement and expand Python-based test automation using Pytest, including fixtures, test data strategies, and robust assertions/validation.
• Create and maintain Docker/Podman container images used to run automation consistently across developer environments and CI pipelines.
• Integrate automated test execution into Jenkins and GitLab CI/CD pipelines, ensuring repeatable runs, clear reporting, and actionable results.
• Use Linx command-line tools and Bash shell scripting to locate, parse, transform, and report on large volumes of logs, test output, and system data.
• Support and extend UI automation using Robot Framework and the Python Selenium library, including test stability improvements and best practices.
• Collaborate with stakeholders to plan, estimate, and break down work for migrating the current in-house test harness from legacy Robot Framework to a modern alternative (e.g., Robot Framework AIO or Microsoft Playwright).
• Write and maintain SQL queries (using SQL Developer or similar tooling) and integrate database validation steps into automated tests were appropriate.
• Troubleshoot CI failures and test irregularity/volatility, improve test reliability, and contribute to continuous improvement of the overall QA automation approach.
• Assist with any or all of the Level I tasks as constrained by technical training and previous testing experience
• Conduct research into and apply knowledge of Government test and evaluation concepts all related engineering acquisition and operations activities as needed to suppo1t the T&E activities
• Plan and Execute Performance Analysis
• Review planned acquisition approaches to support T&B schedule alignment with decision maker needs for T&E support
• Analyze performance risk areas to focus T&B planning
• Specify, validate, and adapt Modeling and Simulation for T&E use
• Apply Statistical Analysis of variations in performance behavior to characterize confidence in
• performance estimates
• Select, develop, & use analysis tools
• Execute the evaluation plan of data collected by the Testing Task
• Plan and Execute Performance Data Collection
• Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
• Establish and employ Data & Configuration Management capabilities
• Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
• Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
• Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
• Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
• Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions· levels of T&E include inspection, demonstration paper analysis, survey simulation, and physical test
• Design surveys for evaluation of Subject Matter Expert (SE input and user as estimates of performance)
• Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
• Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans Data Requirements Risk Assessments, Evaluation Reports Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test
• Readiness Reports)
• Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
• Select, coordinate. and calibrate Instrumentation, collection and data management tools, targets, and facilities
• Ensure test readiness including training of test event participants re conduct of the event; equipment readiness, and security legal, and privacy compliance arrangements
• Participate in T&E WIPT and/or Integrated Test Team for coordination of data collection plan -
• Execute Testing and Data Collection per plan
• Produce associated Test Plans, Procedures, and Reports /Briefings, Data Management Plan
• Define and provide technical direction and guidance for the Level 1 tasks to the Level 0 and Level 1 TEs assigned to the task
• Recommend draft plans and reports from the Level 1 tasks for approval by the task leader
• Work directly with the Government sponsor to coordinate task implementation
• Maintain knowledge of current and evolving agency, national, and international standards applicable to the system development of interest
• Provide overall leadership of the T&E task and serve as primary liaison to the government for supporting contract coordination and task execution
• Communicate issues and solutions to the broader government and contract management structure as requested by Leadership
• Ensure the appropriate level of independence of the team from the solution provider to support government management of objectivity risk
• Manage T&E resources and tasks; ensure quality assurance of test processes and product
• Coordinate and integrate Evaluation and Testing tasks and products
• Participate in T&E WIPT and /or integrated Test Team as needed to ensure proper coordination of T&E activities
• Drive innovation and responsiveness to program changes and evolving T&E status to help manage program risk; develop alternative courses of action, work-arounds, and fall-back positions with a recommended course of action for each risk and monitor and re-evaluate risks at appropriate milestones

Basic Qualifications

• This position requires a polygraph within the last 5 years.
• Eight (8) years' experience as a TE in programs and contracts of similar scope type and complexity is required. Bachelor's degree in Math, Science, Engineering, Statistics, Engineering Management or related discipline from an accredited college or w1iversity is required. Four (4) years of additional TE experience may be substituted for a bache lor' s degree.
• Strong experience with Linux and Bash shell scripting, with demonstrated ability to work effectively from the command-line and process/report on large data sets (logs, test artifacts, results).
• Advanced experience building test automation in Python, including Pytest-based frameworks and best practices for maintainable automated testing.
• Strong hands-on experience with Docker (or Podman) including building, versioning, and maintaining images used in automation and CI/CD workflows.
• Working knowledge of Jenkins and GitLab pipelines, including running containerized workloads and managing automated test stages.
• Experience with REST API testing, including validation of responses, authentication flows, and negative/error-path testing.
• Familiarity with Robot Framework UI automation using Selenium library (Python).
• Solid understanding of how to architect a test automation harness/framework for UI and/or API testing (test structure , configuration, reporting, environment management).
• Familiarity with SQL and tools such as SQL Developer, including writing queries and using them within automated validation steps.

Preferred Qualifications

• Experience planning and executing test automation framework migrations (e.g., Robot Framework to Microsoft Playwright or Robot Framework AIO).
• Experience improving CI performance, parallelization, and test execution efficiency in containerized environments.
• Strong debugging skills across services, CI logs, containers, and test reporting outputs.

-----------------------------------------------------------

Who We Are 

Sunayu, LLC serves as a premier technology partner to the Defense and Intelligence communities, delivering mission-critical engineering solutions across the nation. Our operations are anchored in a commitment to trust, accountability, and ethical transparency, ensuring the high-performance outcomes necessary to protect our country's most vital interests. 

Culture

Our strength lies in our community: Our team prioritizes collaboration, professional growth, and encourages open communication. At Sunayu, we don't just secure the mission—we grow together.

Career Development

We support and encourage our team members to continue their professional growth by providing company-reimbursed training and continuing education of up to $5,000 per year. We also participate in many industry conferences and events where we share our expertise and experiences.

Pay Rate

Salary range considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/ training, key skills, as well as market and business considerations when extending an offer.

Benefits

• 3 Medical Plan Options
• Dental and Vision 
• FSA, DCFSA, HSA
• Life/AD&D Insurance
• Short-Term & Long-Term Disability 
• Employee Assistance Program (EAP)
• Training and Educational Assistance
• Paid Time Off (PTO)
• 11 Federal holidays 
• 401k plan with up to a 6% match (100% immediate vesting) 
  

Equal Opportunity Employer

Sunayu, LLC is an Equal Opportunity/Affirmative Action Employer.  All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, gender expression, national origin, age, protected veteran status, disability status, marital status, genetic information, medical condition, or any other characteristic protected by law.