A

Arthur J. Gallagher & Co.

Global insurance brokerage, risk management, consulting

Senior QA Engineer - AI Testing

Test Automation EngineeringPosted on Nov 18
Full-timeColombo, Sri LankaNo salary listed

About the Job

Requirements

  • Proven experience in software testing, including AI-specific testing.
  • Expertise in AI risks, retrieval-augmented generation, and prompt engineering.
  • Familiarity with secure software engineering practices and Agile methodologies.
  • Experience with performance, accessibility, and security testing.
  • Knowledge of continuous integration platforms such as Azure DevOps and tools such as Postman and JMeter.

Responsibilities

  • Develop and maintain comprehensive test strategies for AI-enabled solutions.
  • Evaluate AI behavior for accuracy, robustness, fairness, and safety.
  • Test AI-specific risks, including hallucination, data leakage, and model drift.
  • Build automated regression suites and integrate them into continuous integration and continuous delivery pipelines.
  • Collaborate with stakeholders to clarify requirements and communicate quality risks.
  • Monitor AI quality in production and contribute to continuous improvement.
  • Stay updated on industry trends and introduce advanced testing tools and techniques.

Desired Qualifications

  • ISTQB certification and training in AI or machine learning are advantageous.

About the Company

Arthur J. Gallagher & Co.

Global insurance brokerage, risk management, consulting

Arthur J. Gallagher & Co. is a global insurance brokerage and risk management firm. It helps businesses, public entities, and individuals manage risk and obtain insurance through three segments: brokerage, risk management, and corporate. The brokerage unit offers a full range of retail and wholesale insurance brokerage and consulting services to match clients with coverage. The risk management unit handles contract claim settlements, claim administration, loss control consulting, and risk management information services to reduce exposures. The corporate unit oversees the company’s clean energy and other investments. The firm differentiates itself by providing end-to-end risk solutions across insurance placement, claims handling, risk counseling, and investment activities, rather than focusing on a single service. Its goal is to help clients manage risk effectively, protect assets, and pursue value through diverse investments, including clean energy.

Company size
10,001+
Company stage
IPO
Headquarters
Itasca, IL
Founded
1927

Recently Posted Jobs

Explore more opportunities at Arthur J. Gallagher & Co.

See more jobs