C

Capital Technology Group

Quality Engineer - Data

Full-Time
$75k - $110k/yr+ 401(k) with 4% matching + Bonus incentive
Senior
Bachelor's
Remote in USA
Remote
QA & TestingTest Automation Engineering
No H1B Sponsorship
US Citizenship Required

About the job

Requirements
  • A bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience.
  • At least 7 years of professional experience in software quality assurance, testing, or quality engineering roles.
  • Strong programming experience with Python and experience developing automated tests and test frameworks such as Pytest or comparable tools.
  • Strong understanding of data quality principles and methodologies, including accuracy, completeness, consistency, uniqueness, validity, and timeliness.
  • Experience working with relational databases and SQL.
  • Experience testing data pipelines, ETL/ELT processes, or large-scale data transformations.
  • Experience with distributed data processing technologies such as Apache Spark or PySpark.
  • Familiarity with Apache Airflow or another workflow orchestration platform.
  • Experience working with cloud-based data platforms, preferably AWS.
  • Experience creating, executing, and maintaining automated and manual test plans and test cases, and identifying, documenting, prioritizing, and tracking software defects.
  • Experience supporting Agile software development teams.
  • Strong analytical, communication, and problem-solving skills, including the ability to investigate data discrepancies, identify root causes, and communicate technical data quality issues clearly to technical and non-technical stakeholders.
  • U.S. citizenship and the ability to obtain Public Trust clearance.
Responsibilities
  • Develop and implement data quality strategies, standards, testing practices, documentation, and maintenance processes for data pipelines and analytical datasets.
  • Design and execute automated and manual tests covering data accuracy, completeness, integrity, uniqueness, schema consistency, business rules, freshness, and statistical validity.
  • Build automated quality checks and integration and end-to-end tests using Python, PySpark or Spark, SQL, and Apache Airflow.
  • Validate data transformations and pipelines across Apache Spark, Python, AWS, Amazon S3, and related AWS data services.
  • Develop reusable testing frameworks and utilities for data pipelines and continuous integration and continuous delivery, ensuring code and data are validated before production release.
  • Implement quality validation across raw, cleaned, curated, and analytics-ready data, establishing thresholds, rules, and acceptance criteria.
  • Investigate data anomalies, schema changes, missing data, pipeline failures, and other quality issues; identify root causes and partner with Data Engineers on resolution.
  • Conduct code and product reviews and ensure new pipelines and transformations include appropriate unit, integration, and data quality testing.
  • Monitor data quality metrics and dashboards and support automated regression testing to protect downstream data consumers.
  • Collaborate with Data Engineers, Data Scientists, Analysts, and stakeholders to translate business and regulatory requirements into data quality controls throughout the software development life cycle.
  • Support user acceptance testing, release validation, production deployments, and documentation of test strategies, requirements, defects, and validation procedures.
Desired Qualifications
  • Experience testing financial, securities, regulatory, or other highly governed data.
  • Experience with AWS services such as Amazon S3, AWS Glue, Amazon Redshift, and/or Amazon Athena.
  • Experience implementing data quality frameworks or automated data validation platforms.
  • Experience with Pytest or similar Python testing frameworks.
  • Experience with dbt and/or automated testing of SQL-based transformations.
  • Experience with continuous integration and continuous delivery pipelines and automated testing within software development workflows.
  • Experience with data lineage, metadata management, and data observability.
  • Experience testing data in data lakes, lakehouses, or data warehouses.
  • Familiarity with schema evolution, schema validation, and detection of schema drift.
  • Experience designing tests for high-volume datasets and distributed processing environments.
  • Experience supporting federal government agencies.
  • Certified Software Tester (CSTE), ISTQB, or similar certification.

About the company

C

Capital Technology Group

View

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A