Q

Quantiphi

AI-driven digital transformation and automation services

QA Architect / Lead

Performance Testing +1Confirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • A bachelor's or master's degree in Computer Science, Engineering, or a related quantitative field is required.
  • At least 8 years of QA experience, including at least 3–5 years focused on data quality, data warehousing, or data platform testing, and at least 2 years in a lead or architect role.
  • Demonstrated experience defining and operating QA strategies for large-scale data platforms in cloud environments; GCP experience is preferred.
  • Strong Python and SQL skills for test framework authorship, with familiarity with pytest and dbt-test conventions.
  • Experience validating data across batch, streaming (Kafka), and event-driven pipelines.
  • Experience with dbt's native testing framework, dbt-expectations or dbt-utils packages, custom test authorship via macros, and source freshness checks.
  • Experience testing Iceberg or other open-table-format-backed warehouses, including schema evolution edge cases, partition handling, snapshot semantics, and copy-on-write versus merge-on-read behavioral differences.
  • Experience with healthcare data quality testing, including HL7v2 parsing edge cases, FHIR profile conformance validation, terminology binding validation, and master data quality.
  • Experience designing and executing load tests for data platforms at scale using JMeter, Gatling, Locust, or custom load generators, and familiarity with realistic load profile design.
  • Experience with parallel-run validation and reconciliation between legacy and replacement data systems.
  • Strong CI/CD experience with GitHub Actions, GitLab CI, or Cloud Build, and ability to design pipeline gates and integrate test execution into pull request and release workflows.
  • Experience working across engineering, architecture, governance, and customer stakeholder groups; strong analytical, communication, and collaboration skills.

Responsibilities

  • Define and own the four-tier test framework: unit tests per specification acceptance criterion, integration tests within-layer composition, contract tests for cross-layer schema and behavior, and acceptance tests for end-to-end scenarios; establish conventions and CI gates to enforce them.
  • Establish the specification-to-test traceability standard, ensuring every unit-spec acceptance criterion has a named verifying test, test names reference the acceptance-criterion ID, and CI enforces coverage.
  • Build and maintain test infrastructure, including fixtures for HL7v2, CCDA, CSV, and FHIR samples organized by source and dead-letter-queue scenario; dbt test runners; FHIR validator integration; Mini Cluster Flink test harnesses; HAPI test server harnesses for FHIR Repository interceptor work; and end-to-end test orchestration.
  • Establish synthetic test data conventions that exclude real protected health information, use structured synthetic patient names, identifiers, and dates, provide reusable patterns for multi-source linkage scenarios, and cover edge cases such as null values, ECI merges, late-arriving data, and validation failures.
  • Lead the load-testing campaign by designing and executing eight to ten scenarios validating sustained 50,000-message-per-second ingest, 150,000-message-per-second peaks, full dbt refresh at billion-row scale, 1,000 concurrent Starburst queries, 5,000 requests per second on the FHIR API, MDM degradation behavior, and reprocessing during steady state; report results against acceptance criteria.
  • Lead the parallel-run validation framework for the 30–60 day cutover period, defining data comparisons between the new platform and the existing Health Data Engine, accepted tolerances, reconciliation reports, and rollback triggers.
  • Define performance service-level objectives and a monitoring strategy with measurable latency, throughput, and freshness budgets for every component; build dashboards operators use during incidents and for trend baselines.
  • Define and enforce CI/CD test gates for pull-request merges, nightly runs, and staging before promotion; codify gates in pipeline configuration and runbooks.
  • Build test automation for FHIR profile validation so every published Bundle is validated against US Core 6.1 in CI and at runtime; establish validator deployment, profile-pack management, and conformance test patterns.
  • Lead testing for bidirectional FHIR flow, verifying loop prevention through origin tagging under load, capture of every client-originated change by the FHIR Repository egress interceptor, correct application of write-authority rules by the loopback Flink job, and prevention of propagated echoes.
  • Establish testing patterns for MDM integration by synthesizing match, no-match, and multi-match scenarios; validating ECI assignment and ECI_MERGE and ECI_SPLIT handling end-to-end; and validating dead-letter-queue routing for MDM failures.
  • Lead data-quality validation at every layer, including dbt test suites for CDM, freshness checks at each layer boundary, anomaly detection for ingestion patterns, and governance integration for publishing quality metrics to Atlan.
  • Mentor data engineers on test authorship under the specification-driven development framework; make test quality part of pull-request reviews and set the quality bar for the QA lead role.
  • Participate in incident response and root-cause analysis, adding tests to prevent recurrence by making each production incident a new acceptance criterion in the affected specification and adding a corresponding test to the suite.

Desired Qualifications

  • Experience with the HL7 FHIR validator, Inferno, or HAPI FHIR validation tooling.
  • Atlan experience for data-quality metric publication and governance integration.
  • Experience with chaos engineering or resilience testing for streaming data systems.
  • Experience integrating specification-driven or contract-first frameworks with QA workflows.
  • Experience with test-management tools such as TestRail, Zephyr, or qTest.
  • Experience working in HIPAA-regulated environments, including synthetic protected health information generation, audit-trail validation, and regulatory test evidence.
  • QA or cloud-platform certifications.

About the Company

Quantiphi

AI-driven digital transformation and automation services

Quantiphi uses AI and digital engineering to help organizations transform by making products and operations smarter and safer. It partners with clients to understand their challenges and then designs and builds customized AI and automation systems—combining machine learning, data analytics, and software engineering—delivering them under long-term contracts with ongoing support, and collaborating with Google Cloud to integrate technologies. Compared with competitors, it provides end-to-end, tailored solutions across industries rather than one-off projects, backed by long-term relationships and strong technology partnerships to scale. Its goal is to embed AI into products and processes to improve customer experiences and overall efficiency.

Company size
1,001-5,000
Company stage
Series A
Total funding
$23.4M
Headquarters
Marlborough, MA
Founded
2013

Recently Posted Jobs

Explore more opportunities at Quantiphi

See more jobs