Job Title: Senior AI QA Automation Engineer

Key Skills: Python, AI Testing, Test Automation, Playwright, Selenium, API Testing, Azure AI Foundry Evaluations, RAG Evaluation, Prompt Testing, CI/CD, Monitoring

Experience: 5+ YOE.

Location: Costa Rica, Peru, Colombia, Bolivia.

Mode: Remote

We at Coforge are hiring Senior AI QA Automation Engineer (#006fu00000bWsOCAA0-4) with the following skill set.

Key Responsibilities

Build automated evaluation frameworks for AI agents, RAG solutions, prompts, tools, workflows, and model outputs, including benchmark datasets, golden responses, regression suites, evaluation metrics, and release thresholds.
Test AI-specific behaviors including hallucinations, grounding, citation accuracy, prompt injection, tool selection, and multi-agent coordination.
Develop agent-powered QA solutions for test-case generation, API and workflow validation, and intelligent UAT, while building UI, API, integration, performance, and end-to-end automation.
Implement CI/CD quality gates and continuously monitor production AI quality, drift, reliability, and recurring failure patterns.

Required Skills & Qualifications

5+ years of experience in Software Quality Engineering, Test Automation, or Reliability Engineering.
Strong Python skills with experience building reusable automated testing frameworks.
Hands-on experience with Playwright and/or Selenium.
Strong experience with API, UI, integration, regression, end-to-end, and CI/CD-based test automation.
Experience with Azure AI Foundry Evaluations, RAG evaluation, and prompt testing.
Experience defining evaluation metrics, benchmark datasets, regression suites, and measurable quality thresholds.
Knowledge of AI quality concepts such as hallucination testing, grounding, citation accuracy, prompt injection, and agent behavior validation.
Experience implementing CI/CD quality gates and production monitoring.
Ability to translate business requirements, workflows, and AI behaviors into measurable quality criteria.
Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related field.

Preferred Skills:

Experience testing Generative AI, RAG solutions, copilots, or AI agents.
Experience with LLM evaluation frameworks and advanced prompt testing.
Experience developing agent-powered test generation, workflow validation, or intelligent UAT assistants.
Experience with adversarial testing and Responsible AI testing.
Experience monitoring AI quality, drift, reliability, and failure patterns in production environments.

Posted On: 12-10-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

About the company

Encora provides digital engineering services including software product engineering, cloud services, data science, and quality engineering to help organizations transform their technology. It uses nearshore and offshore delivery in Latin America and India to offer cost-efficient software development and IT consulting for financial services, healthcare, retail, and technology. Projects are carried out by specialized engineering teams that design, build, test, deploy software, migrate and manage cloud environments, and create data-driven solutions with a strong emphasis on quality. The company differentiates itself through a scalable global delivery model and large talent pools in its hubs, supported by Advent International to drive growth, with the goal of helping clients achieve rapid, cost-efficient digital progress.

Company Size

5,001-10,000

Company Stage

Acquired

Total Funding

$215M

Headquarters

Scottsdale, Arizona

Founded

2003

Get referred to Encora

See people who can refer or advise you

Simplify's Take

What believers are saying

Coforge said Encora added $100.7 million in Q1 FY27 after May 1 consolidation.
Coforge targets a $2.5 billion run rate and $2 billion AI-data-cloud core by FY27.
Current leadership kept senior Encora executives, reducing client disruption during the 2026 integration.

What critics are saying

Coforge closed Encora on April 23, 2026; Encora’s standalone identity is disappearing fast.
Coforge funded the deal with $550 million debt, pressuring integration discipline through FY30.
Any missed synergy or customer churn after integration threatens margins and triggers leadership attrition.

What makes Encora unique

Encora built AI-native engineering around AIVA and cloud-data delivery, per 2025-2026 releases.
Encora’s Latin America and India bench gives Coforge scaled nearshore execution for U.S. clients.
AWS designations on January 15, 2026 validate Encora’s cloud engineering credibility with enterprises.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Hybrid Work Options

Growth & Insights and Company News

Headcount

6 month growth

1 year growth

2 year growth

NDTV Profit

Sep 10th, 2026

Coforge Chairman's resignation not A red flag, says CLSA; retains bullish stance - check target price.

Coforge Chairman's resignation not A red flag, says CLSA; retains bullish stance - check target price. CLSA remains focused on the company's operating outlook, particularly the potential for revenue synergies from its Encora acquisition. Read Time: 2 mins Coforge's chairman resignation may have triggered a sharp reaction in the stock yesterday, but CLSA does not view the development as a major governance red flag, retaining its High Conviction Outperform rating and a target price of Rs 2,170, implying about 11% upside from the levels cited in its report. Coforge Chairman and Non-Executive Independent Director OP Bhatt resigned with immediate effect on September 8, after an internal audit raised concerns over the handling and disclosure of information in the company's board evaluation report. Coforge subsequently clarified that the issues related to the board evaluation exercise and did not involve financial statements, financial reporting or the company's business operations. It also said the matter had no bearing on its near-, medium- or long-term business guidance. CLSA's assessment pointed to Coforge's governance framework and the increase in the proportion of independent directors since FY24. It also noted that the company's books are subject to scrutiny from its current and previous private-equity investors, as well as KPMG, its internal auditor, according to the report. The brokerage also highlighted what it described as a proactive exchange filing by Coforge management following the resignation and said it had seen no major governance lapses relating to financial reporting or business operations. The development comes shortly after shareholders rejected Bhatt's proposed reappointment for another five-year term at Coforge's August annual general meeting. His existing term was originally due to expire in April 2027. Meanwhile, the market reaction has been sharper. Coforge shares fell as much as 8.67% to Rs 1,780.10 on September 9, before paring some losses. CLSA remains focused on the company's operating outlook, particularly the potential for revenue synergies from its Encora acquisition. Its estimates show revenue rising from Rs 16,238.3 crore in FY26 to Rs 24,549 crore in FY27, with net profit projected at Rs 2,672 crore. Essential Business Intelligence, Sharp Market Insights, Practical Personal Finance Advice, Daily Fuel, Gold and Silver Prices and Latest Stories - On NDTV Profit.

Encora

Aug 4th, 2026

Coforge | Where AI Engineering Meets Industry Expertise

Coforge is a global digital services and solutions provider that combines AI engineering with deep industry expertise to deliver real world business impact for leading enterprises.

PitchOnNet

Aug 4th, 2026

Hitachi appoints anand Birje as CEO of Digital Engineering & AI Business Unit.

Hitachi appoints anand Birje as CEO of Digital Engineering & AI Business Unit. Prior to his appointment, Birje served as Chief Executive Officer and Board Member at Encora Inc. Anand Birje has been appointed CEO of Hitachi's Digital Engineering and AI Business Unit. Before joining Hitachi, Birje served as Chief Executive Officer and Board Member at Encora Inc., a digital engineering and operations services company. Prior to that, he spent nearly two decades at HCL Technologies, where he last served as President - Digital Business Services before stepping down in May 2023. Over the course of his career, Birje has also been associated with the World Economic Forum, adding to his extensive leadership experience in digital transformation and technology.

Primex Media Services Pvt. Ltd.

Jan 23rd, 2026

Coforge net profit up 71% to ₹364cr, plans stock dilution and ₹5,000cr debt for $2.35B Encora acquisition

Coforge has reported strong third-quarter results, with net profit rising 71.2% year-on-year to ₹364 crores and consolidated revenues increasing 28.5% to ₹4,188 crores. The company secured orders worth $593 million during the quarter, with its executable order book standing at $1.72 billion. The results follow Coforge's $2.35 billion acquisition of Encora through a share swap deal. Encora's shareholders will receive approximately 20% of the combined entity's stock. The acquisition is expected to make Coforge India's seventh-largest IT firm upon closing in six months. Coforge's total debt stands at ₹2,925 crores as of December 2025 and plans to raise up to ₹5,000 crores through bridge loans or qualified institutional placement to retire Encora's liabilities. The company announced a ₹4 interim dividend per share.

VCCircle

Dec 26th, 2025

Coforge inks $2.35 bn deal to acquire Encora; contrasting outcomes for Advent, Warburg Pincus

Coforge inks $2.35 bn deal to acquire Encora; contrasting outcomes for Advent, Warburg Pincus. Indian IT services provider Coforge said Friday it has signed a definitive agreement to acquire Encora, a United States-based firm that provides artificial intelligence (AI)-driven engineering services, from private equity groups Advent International and Warburg Pincus at an enterprise value of $2.35 billion. Under the deal structure, Coforge will fund the acquisition...