Software Development Engineer in Test

Description

The Ring Blink Customer Service (RBCS) team's application complexity has grown significantly, now serving thousands of external users 24/7 across multiple integrated platforms. We're rapidly deploying AI across voice, chat, and self-service channels, but our AI capabilities ship faster than we can validate them manually, creating a critical gap in our quality assurance process. The current testing team is overwhelmed with manual testing efforts, causing delays in release cycles and increasing the risk of production issues. Key challenges include managing multiple parallel releases, ensuring comprehensive integration testing across four major systems, maintaining high availability requirements (99.9% uptime), and meeting strict security compliance standards. We are seeking a Software Development Engineer in Test to establish and own the automated quality layer using AccelQ and other Amazon internal test automation tools, enabling us to ship AI features with confidence instead of slowing down to manually test every model change. This role will implement robust automation frameworks, conduct thorough integration testing, and ensure quality across all platforms. Without this crucial hire, we risk increased production incidents, delayed AI feature releases, customer dissatisfaction, team burnout, and technical debt accumulation. This role will be instrumental in supporting our business objectives of maintaining high system reliability, ensuring secure transactions, and enabling faster time to delivery of new AI-powered features.

Key job responsibilities
Key job responsibilities

The successful Software Development Test Engineer will be obsessed with customer experience and quality improvement. In this role, you will:



Code Development & Delivery

Write secure, stable, testable, maintainable code that consistently meets high quality standards

Apply best practices in all aspects of software development and testing



Test Automation & Framework Development



Design, develop, and execute comprehensive test automation frameworks using AccelQ and Amazon internal test automation tools for web applications, APIs, and integrated systems

Build scalable test automation solutions for Salesforce Lightning components, Amazon Connect flows, AI services, and AWS service integrations

Use technology to validate and verify software, seeking input from team members on the best software test techniques to utilize

Develop custom testing tools and utilities that enable the team to efficiently validate complex AI-powered workflows

Create reusable test libraries and patterns that accelerate test development across the organization

Establish automated validation pipelines for AI model outputs, conversation flows, and intent recognition accuracy



Quality Transformation & Process Improvement



Dive deep into testing methodologies to transform manual quality processes into highly automated quality solutions, specifically targeting AI validation bottlenecks

Improve your team's automation of development, testing, and deployment processes using Amazon's internal testing ecosystem

Design, develop, and execute automation test plans and reporting on test execution

Coordinate test approaches, test cases, and test methodology with remote teams

Drive continuous improvement in test coverage from current 65% to target 90%, with focus on AI-critical paths

Transform manual AI testing processes into highly automated, reliable quality gates

Integration & End-to-End Testing

Own the end-to-end testing strategy across Salesforce, Amazon Connect, AI services, and AWS platforms

Design and execute integration test suites that validate data flow and business logic across system boundaries

Implement API testing frameworks for RESTful services and AWS service integrations

Validate AI model outputs and ensure quality of AI-powered customer service features

Automate the validation of modern user interfaces and cloud infrastructures

Build automated testing for conversational AI flows, including edge cases and error scenarios

Performance & Security Testing



Conduct performance testing and capacity planning for high-traffic customer service applications and AI services

Implement load testing strategies to validate system behavior under peak conditions, including AI service performance

Implement security testing practices and validate compliance with Amazon security standards

Establish performance benchmarks and regression testing for critical user journeys

Create performance testing frameworks for AI services under varying load conditions

Team Collaboration & Mentorship



Communicate technical concepts and processes using clear, simple language and visuals

Collaborate with development teams to shift testing left and implement test-driven development practices

Work in Agile/Scrum development methodologies with cross-functional teams

Collaborate with AI/ML teams to implement test-driven AI development practices

Basic Qualifications

- 3+ years of non-internship professional software development testing experience
- Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design
- Experience in penetration testing and exploitability-focused vulnerability assessment
- Experience in platform-level security mitigations and hardening for Linux and Windows
- 1+ years of test automation frameworks and tools building experience
- 4+ years of test automation frameworks and tools building experience
- Knowledge of at least one object-oriented language (e.g., Java, Python)
- Familiar with software engineering best practices for the full software development life cycle
- Familiar with software test techniques and strategy
- Familiarity with CI/CD frameworks, processes and tools for continuous testing and integration
- Experience with both on-premises and cloud-based testing environments, preferably including AWS services

Preferred Qualifications

- Knowledge of overall system architecture, scalability, reliability, and performance in a database environment
- Experience with security in service-oriented architectures and web services
- Experience with test automation framework or tools (e.g., Junit, TestNG, Selenium)
- Experience with AccelQ or similar enterprise test automation platforms
- Familiarity with Amazon internal test automation tools and testing frameworks
- Knowledge of industry standard test automation tools and experience developing product test frameworks
- Knowledge of scripting languages (bash, python, etc.)
- Experience with open source tools and resources
- Experience automating the validation of modern user interfaces and infrastructures
- Experience communicating technical concepts and processes using clear, simple language and visuals
- Experience in Agile or Scrum software development methodologies
- Experience with Salesforce testing (Apex, Lightning Web Components, Salesforce APIs)
- Familiarity with Amazon Connect or contact center platforms
- Experience testing AI/ML systems and validating model outputs
- Experience with AI model monitoring, A/B testing frameworks, and automated performance validation
- Experience building quality gates for rapid AI deployment pipelines using enterprise automation tools
- Knowledge of AI safety testing, bias detection, and automated compliance validation
- Familiarity with CI/CD frameworks, processes, and tools for continuous testing and integration

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.