H

HighLevel

All-in-one marketing platform for agencies

Lead Software Development Engineer in Test – AI

Test Automation EngineeringPosted on Nov 10
Full-timeRemote in IndiaNo salary listedRemote

About the Job

Requirements

  • At least 7 years of overall experience in QA or SDET roles.
  • Deep expertise in AI tools and model testing, including designing scalable test approaches for retrieval-augmented generation (RAG), hallucination, drift, and bias.
  • Proven experience architecting large-scale, reusable, cross-platform automation frameworks.
  • Ability to coach and upskill an entire team, set best practices, and build a talent pipeline.
  • Ability to influence cross-functional teams and participate in architecture discussions.
  • Strong problem-solving skills and ability to own decisions on test strategy, tools, frameworks, and AI testing methodologies.

Responsibilities

  • Define the overall QA strategy and architect large-scale, reusable, cross-platform automation frameworks.
  • Drive organization-wide quality initiatives and own the quality charter for the AI vertical.
  • Design scalable test approaches for RAG, hallucination, drift, and bias using deep expertise in AI tools and model testing.
  • Own decisions on test strategy, tools, frameworks, and AI testing methodologies.
  • Coach and upskill the team, set best practices, and build a talent pipeline.
  • Influence cross-functional teams, participate in architecture discussions, and align testing with business strategy.
  • Own end-to-end quality strategy at the product or vertical level.
  • Shape the AI quality roadmap, reduce organization-wide risk, and improve scalability and reliability.

Desired Qualifications

  • Experience with continuous integration and continuous delivery (CI/CD) pipelines and cloud platforms such as AWS, Google Cloud Platform (GCP), or Azure.
  • Familiarity with MLOps pipelines and monitoring AI systems.
  • Exposure to performance and scalability testing of AI workloads.

About the Company

HighLevel

All-in-one marketing platform for agencies

HighLevel provides an all-in-one sales and marketing platform for marketing agencies, freelancers, and businesses, including CRM, page builder, lead capture tools, and automated campaigns. It works as a subscription service with pricing tiers, giving users access to CRM, funnel/page building, lead generation, and marketing automation from a single dashboard. It differentiates itself by focusing on marketing agencies and offering bundled tools in one platform to simplify client management and workflows. Its goal is to streamline marketing work for agencies and marketers and help them scale their operations from a centralized tool.

Company size
1,001-5,000
Company stage
Growth Equity (Non-Venture Capital)
Total funding
$60M
Headquarters
Dallas, TX
Founded
2018

Recently Posted Jobs

Explore more opportunities at HighLevel

See more jobs