C

Caylent

AWS-focused cloud-native consulting and DevOps

Senior QA Engineer

Test Automation EngineeringConfirmed live in the last 24 hours
Full-timeRemote in Mexico

About the Job

Requirements

  • At least 8 years of QA/test engineering experience, including at least 3 years testing contact center, CCaaS, or IVR/voice platforms.
  • Hands-on experience with Amazon Connect or a comparable CCaaS platform, including contact flows, routing, Cases/Tasks, and reporting.
  • Proficiency with automated testing frameworks, including Playwright E2E and API tests, Cypress, and Selenium, for unit, integration, and end-to-end testing.
  • Experience testing serverless/event-driven AWS architectures, including Lambda, API Gateway, DynamoDB, and Step Functions.
  • Working knowledge of conversational AI and voice testing considerations, including intent accuracy, latency, and fallback behavior.
  • Strong defect documentation and triage skills, and comfort running UAT sessions with business and technical stakeholders.
  • Familiarity with CI/CD pipelines, including GitHub Actions, and integrating automated tests into deployment workflows.
  • Current legal authorization to work in the country where the position is located; the employer does not sponsor visa or work permit applications.

Responsibilities

  • Design and execute test strategies for Amazon Connect implementations covering contact flows, routing logic, IVR/self-service, Cases/Tasks workflows, and Contact Lens configurations.
  • Build test plans validating AI agent behavior, including intent recognition accuracy, escalation paths, barge-in/fallback handling, hallucination guardrails, and multilingual/SSML voice interactions.
  • Validate legacy-to-Connect migrations, including parallel-run testing, flow conversion verification, and data migration validation.
  • Define and track quality metrics, including defect density, test coverage, and escape rate, and report release readiness to delivery leads and customer stakeholders.
  • Build, maintain, and execute manual and automated IVR test suites and web application test suites.
  • Build and maintain Playwright end-to-end and API tests, Cypress and Selenium tests, integration tests against live Amazon Connect instances, and end-to-end tests of Amazon Connect call flows.
  • Test custom Agent Workspace experiences, including Amazon Connect and Agent Assist.
  • Validate serverless, event-driven backends using integration and contract tests.
  • Execute phased rollout and cutover validation for live contact centers.
  • Verify monitoring and alerting coverage across voice, chat, tasks, queues, agents, Lambda, and AI agents before go-live.
  • Participate in production incident triage by reproducing defects and validating fixes across the contact center stack.
  • Perform security and compliance validation, including least-privilege IAM checks, DevSecOps scan review, and encryption-standard verification.
  • Partner with engineers during development to shift testing left by pairing on test design, reviewing acceptance criteria, and flagging risk areas early.
  • Run UAT sessions with customer stakeholders, triage findings, and drive defects to resolution ahead of production cutovers.
  • Contribute reusable test assets, including automated suites, test data sets, and QA checklists, to the CXE practice.
  • Mentor junior QA engineers on contact center testing patterns and the company's quality standards.

Desired Qualifications

  • Experience with contact center migration testing, including Avaya, Genesys, Connect, or NICE.
  • Experience with AI observability/trace validation, including agent spans and token/cost attribution, or accessibility engineering.
  • AWS certifications such as Solutions Architect, Developer, or an ML/Connect-relevant Specialty.
  • Contact center operations fluency, including quality management, outbound compliance, and CX KPIs.
  • Consulting or client-delivery background.
  • Hands-on experience with Cyara or Botium.
  • Experience using tools such as Cyara, Hammer, or Botium for manual and automated IVR test suites.
  • Experience using frameworks such as Cypress, Selenium, or Playwright for manual and automated web application test suites.

About the Company

Caylent

AWS-focused cloud-native consulting and DevOps

Caylent is a cloud-native services company that helps organizations maximize the value of AWS-driven solutions. It guides and executes on cloud journeys, offering migration, DevOps, DevSecOps, and ongoing optimization to build, scale, and improve cloud systems. The company uses a co-delivery model, working closely with clients to deliver tailored cloud solutions and transfer knowledge so clients can manage their environments themselves. Caylent differentiates itself with deep AWS alignment (as an AWS all-in partner), a strong library of methodologies and code repositories, and a history rooted in container and microservices work (originating as the first Docker Swarm container-as-a-service platform). Its goal is to shorten time-to-value for customers by applying AWS best practices and proven processes to create scalable, secure, and well-optimized cloud environments.

Company size
501-1,000
Company stage
Growth Equity (Venture Capital)
Total funding
$16.2M
Headquarters
Irvine, CA
Founded
2015

Recently Posted Jobs

Explore more opportunities at Caylent

See more jobs