Senior AI-Driven Automation Test Engineer

Role : Test Engineer - Test Automation

Role Overview

We're looking for an experienced and highly innovative Senior AI-Driven Automation Test Engineer with 5+ years of experience to join our dynamic team in Bengaluru.

 In this pivotal role, you'll be instrumental in integrating Artificial Intelligence to revolutionize our testing processes. You'll not only develop robust automation frameworks but also lead initiatives to apply AI for enhanced test prioritization, consolidation, defect triage, and sentiment analysis.

 This position demands a strong technical background, a deep understanding of automation principles, and a passion for leveraging AI to solve complex quality challenges.

Key Responsibilities

Requirements Validation: Collaborate closely with product and development teams to validate requirements for testability, clarity, and completeness, ensuring early defect detection.

Test Case Development & Consolidation: Design, develop, and execute high-quality test cases. Apply AI to consolidate and optimize large existing test suites (e.g., aiming to consolidate 135K test cases).

Test Prioritization: Implement and optimize strategies for intelligent test prioritization, including conducting a Proof-of-Concept (PoC) for AI for Test Prioritization to maximize efficiency.

LLM/AI Testing: Design and execute specialized tests for Large Language Models (LLMs) and other AI/ML components, focusing on model performance, bias, fairness, and robustness.

i18n Automation: Develop and implement automation strategies for internationalization (i18n) testing to ensure global readiness of our products.

Automation Strategy & Framework Development: Design, develop, and maintain scalable, robust, and efficient automation frameworks. Drive the overall automation strategy, ensuring comprehensive coverage and alignment with product goals.

Pipeline Integration: Integrate automated tests seamlessly into CI/CD pipelines, optimizing for continuous testing, faster feedback loops, and efficient delivery.

Reporting & Triage: Establish clear reporting mechanisms for test results. Leverage AI for Defect Triage to expedite resolution times.

Crowd Testing (Coordination/Analysis): Participate in or coordinate crowd testing efforts, and analyze results to extract valuable insights.

Sentiment Analytics: Apply AI to Sentiment Analytics on user feedback, reviews, and internal data to gain actionable insights into product quality and user experience.

Develop AI Strategy: Proactively research, evaluate, and define the strategy for applying cutting-edge AI/ML technologies to enhance overall quality engineering practices.

Required Skills & Qualifications

Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.

5+ years of hands-on experience in software test automation, with a strong background in framework development and strategy.

Strong proficiency in at least one major programming language (e.g., Python - highly preferred due to AI/ML ecosystem, Java, C#, JavaScript/TypeScript), with a solid understanding of object-oriented design and data structures.

Demonstrable experience with leading test automation frameworks such as Selenium WebDriver, Playwright, Cypress, Rest Assured, TestNG, JUnit, Pytest, etc.

Solid understanding and practical experience with AI/Machine Learning concepts, including hands-on work with relevant libraries/frameworks (e.g., scikit-learn, TensorFlow, Keras, PyTorch) or cloud AI services.

Experience with API testing for RESTful and/or gRPC services using tools like Postman, SoapUI, Karate, or Rest Assured.

Strong command of version control systems (e.g., Git) and experience working in an Agile/Scrum development environment.

Hands-on experience with CI/CD tools (e.g., Jenkins, GitLab CI, Azure DevOps, GitHub Actions) for integrating and optimizing automated tests.

Excellent analytical, problem-solving, and root cause analysis skills for complex technical issues.

Strong communication (written and verbal) and interpersonal skills, with the ability to articulate technical concepts clearly to diverse audiences.

Preferred Qualifications (Nice to Have)Specific experience in LLM/AI testing methodologies, including prompt engineering, bias detection, and performance evaluation of AI models.

Experience with cloud platforms (AWS, Azure, GCP) and testing applications deployed on them.

Familiarity with containerization technologies (Docker, Kubernetes).Experience with performance testing tools (e.g., JMeter, Gatling).

Knowledge of database concepts and SQL for data validation.Prior experience in applying AI/ML to test data management, test prioritization, or defect prediction.

Contributions to open-source projects or significant internal automation frameworks.What We OfferCompetitive salary and comprehensive benefits package.

Opportunity to work on cutting-edge AI-driven projects and revolutionize quality assurance.A dynamic, collaborative, and innovative work environment.

Significant opportunities for professional growth and skill development in AI and advanced automation.

Modern office facilities in Bengaluru.Health, wellness, and retirement benefits.

Flexible work arrangements (if applicable).

3 must haves

Automation Testing 4/5

AI / ML 3/5