Quality Assurance Engineer - Manual & Automation Testing

QA Engineer – Manual & Automation Testing

About UptimeAI:

UptimeAI provides AI reasoning agents that help industrial operations teams make goal-oriented, real-time decisions.

Industrial facilities are rich in data but constrained by the expertise required to maintain and interpret it. As experienced engineers retire and operational complexity grows, organizations struggle to scale the expert judgment needed to maintain reliability, safety, and performance.

UptimeAI addresses this challenge by embedding engineering reasoning directly into AI agents that continuously analyze operational data, diagnose issues, and guide teams toward the best actions. The result is faster decisions, reduced downtime, improved efficiency, and stronger operational performance.

Role: QA Engineer – Manual & Automation Testing

Location: Bangalore, India (Hybrid)

Experience: 3+ years

Department: Engineering

Role Overview:

We are looking for a QA Engineer with 3 - 5 years of experience in manual and automation testing, along with basic exposure to ML & GenAI model/application testing.

The ideal candidate should have strong software testing fundamentals, hands-on experience with web/API testing and test automation, and an understanding of how to validate ML-based applications and their outputs.

The candidate will work closely with developers, product managers, and QA engineers to ensure the quality, reliability, and accuracy of applications and ML-powered features.

Key Responsibilities:

• Understand business, functional, and technical requirements and identify appropriate test scenarios.

• Create and maintain test cases, test scenarios, test data, and test plans.

• Perform functional, regression, integration, smoke, sanity, exploratory, and end-to-end testing.

• Develop and maintain automated test scripts for web applications and APIs.

• Execute automated regression suites and analyze automation failures.

• Identify repetitive test scenarios and contribute to automation coverage.

• Perform API testing and validate request/response data.

• Perform database validation using SQL queries where required.

• Test application workflows involving ML/AI-powered features.

• Validate ML model outputs against expected behavior and business rules.

• Perform basic testing of prediction, classification, recommendation, anomaly detection, or AI-generated outputs.

• Identify incorrect, inconsistent, unexpected, or potentially biased model outputs.

• Validate ML/AI functionality using different input data, edge cases, boundary conditions, and negative scenarios.

• Perform basic data validation to ensure input data is accurate, complete, and correctly processed.

• Compare model responses/results across different test inputs and application versions.

• Support regression testing when ML models, prompts, datasets, or application logic are changed.

• Work with developers/data scientists to investigate issues related to model output or data processing.

• Document defects with clear reproduction steps, input data, expected results, actual results, and supporting evidence.

• Participate in Agile ceremonies including sprint planning, daily stand-ups, reviews, and retrospectives.

• Prepare test execution reports and communicate testing status, risks, and quality metrics.

Required Skills:

• Strong understanding of SDLC and STLC.

• Good knowledge of software testing methodologies and test design techniques.

• Hands-on experience with Functional Testing, Regression Testing, Integration Testing, Smoke/Sanity Testing, Exploratory Testing & End-to-End Testing.

• Strong test case and test scenario writing skills.

• Minimum 2+ years of hands-on automation testing experience.

• Experience with at least one automation framework:

  • Playwright

  • Selenium

  • Cypress

  • Appium

• Experience with at least one programming language:

  • Java

  • JavaScript/TypeScript

  • Python

• Ability to create, execute, debug, and maintain automation scripts.

• Understanding of Page Object Model, reusable utilities, assertions, test data management, and test reporting.

• Hands-on experience with API testing using Postman or similar tools.

• Jira or similar defect/test management tools.

Good to Have:

• Playwright with TypeScript experience.

• API automation experience.

• Experience contributing to or maintaining an automation framework.

• Experience testing ML/AI/GenAI applications.

• Exposure to ML model evaluation or data validation.

• Experience with Allure or similar test reporting tools.

• Exposure to CI/CD-based automated test execution.

• Basic knowledge of Docker or cloud-based testing environments.