Full-Time

Gen AI Architect

Qualitest

Qualitest

5,001-10,000 employees

AI-powered software testing and quality engineering

Compensation Overview

$180k - $200k/yr

Santa Clara, CA, USA

In Person

Category
AI & Machine Learning
Required Skills
LLM
MLOps
Machine Learning
RAG
Microservices
LangGraph
Observability
REST APIs
LangChain

Get referred to Qualitest

See people who can refer or advise you

Requirements
  • 15+ years in software engineering, solution architecture, or digital transformation roles
  • 5+ years of hands-on experience in AI/ML, NLP, or Generative AI system design
  • Deep knowledge of LLMs, vector databases, and orchestration frameworks (LangChain, LangGraph, LlamaIndex, etc.)
  • Strong understanding of Retrieval-Augmented Generation (RAG) architecture, fine-tuning (LoRA/QLoRA), embeddings, and prompt engineering
  • Expertise in cloud-native AI platforms - Azure OpenAI, AWS Bedrock, Vertex AI, or similar
  • Proven ability to integrate AI models into enterprise systems using APIs, microservices, and event-driven architectures
  • Excellent communication, storytelling, and client engagement skills - able to translate AI concepts into business value
  • Strong leadership in cross-functional environments involving AI research, engineering, and business stakeholders
  • 12+ years overall experience in technology and digital engineering, with 5+ years of hands-on experience in AI/ML, with at least 3+ years in Generative AI (LLMs, RAG, multimodal, or agentic systems)
Responsibilities
  • Architect enterprise-scale Generative AI solutions leveraging LLMs, embeddings, and retrieval-augmented generation (RAG) pipelines
  • Design and implement scalable AI microservices and APIs integrated into existing enterprise ecosystems (Azure, AWS, GCP)
  • Lead PoCs and pilot implementations for AI-first use cases such as intelligent automation, code generation, knowledge assistants, and predictive analytics
  • Define and evolve the organization’s AI architecture strategy, focusing on scalability, security, and ethical AI principles
  • Define and design AI Assurance strategy. Define key metrics and approaches to test AI ( Traditional and GenAI ) and work with the platform team to automate the process of capturing and reporting on key metrics
  • Introduce emerging Gen AI frameworks (LangChain, LangGraph, CrewAI, OpenAI Agents SDK, etc.) to enable multi-agent orchestration and intelligent workflow automation
  • Build reusable AI accelerators, tools, and frameworks to standardize model deployment, evaluation, and governance
  • Partner with clients to identify high-value AI opportunities and translate business problems into technical blueprints
  • Lead technical discussions, RFP responses, and client demos showcasing Gen AI capabilities and ROI
  • Collaborate with account leaders to shape AI roadmaps and innovation strategies for enterprise clients
  • Oversee architecture reviews and ensure best practices in AI model lifecycle management (training, fine-tuning, inference, observability)
  • Guide engineering and data science teams in adopting AI-first design principles, model operationalization (MLOps/LLMOps), and continuous learning loops
  • Ensure compliance with data privacy, responsible AI, and enterprise governance standards
  • Build and scale the Generative AI practice across North America - mentoring architects, engineers, and data scientists
  • Collaborate with global CoE and platform teams to enhance reusable AI assets, domain-specific models, and evaluation frameworks
  • Evangelize AI-first engineering through thought leadership, workshops, and industry events
Desired Qualifications
  • Prior experience leading enterprise AI transformations or building Gen AI Centers of Excellence
  • Experience implementing agentic AI systems, AI copilots, or autonomous agents in real-world business scenarios
  • Certifications in AI/ML, cloud architecture (Azure/AWS/GCP), or Responsible AI practices

Qualitest provides software testing services powered by AI to help clients in healthcare, finance, and technology improve quality and speed up time to market. Its core product is Qualisense, an AI tool that enhances risk-based testing by prioritizing testing efforts, identifying high-risk areas, and optimizing test coverage. This allows Qualitest to automate and accelerate testing workflows, reduce costs, and improve operational efficiency for large, diverse enterprises worldwide. The company differentiates itself from competitors through its focus on AI-driven testing and risk-based strategies, enabling faster release cycles and better customer experiences. Qualitest aims to help organizations deliver reliable software quickly and at lower overall risk by combining specialized testing services with advanced AI-enabled tooling, primarily under long-term service contracts and partnerships.

Company Size

5,001-10,000

Company Stage

Acquired

Total Funding

$497M

Headquarters

Fairfield, Connecticut

Founded

1997

Get referred to Qualitest

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • 43% of enterprises prioritize agentic AI, validating Qualitest's AI-first strategy.
  • Hired 100 Israel employees targeting Wix layoffs to strengthen automation teams.
  • New CEO Andrew Duncan drives global AI-driven testing and operational efficiency.

What critics are saying

  • AI automation may replace 50–70% manual QA roles within 12–18 months.
  • Competitor ACCELQ's platform outpaces Qualisense in speed and cost by 6–12 months.
  • GenAI test bias causes false positives and security gaps within 6–12 months.

What makes Qualitest unique

  • Qualisense AI tool enables risk-based testing and faster market release globally.
  • Exclusive focus on AI-driven testing sets it apart from competitors.
  • Nearly 30 years of expertise in software testing and quality assurance.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Remote Work Options

Growth & Insights and Company News

Headcount

6 month growth

10%

1 year growth

10%

2 year growth

10%
Qualitest
Aug 11th, 2025
Qualitest Named Among UK's Top 10 Automation Testing Companies by The London Post

Qualitest is pleased to share that QualiTest Group has been named as one of the top 10 automation testing companies in the UK by The London Post.

Qualitest
Aug 6th, 2025
Qualitest Appoints Mike Shaklik as Chief Revenue Officer

London, UK, 6th August 2025 - Qualitest is pleased to announce the appointment of Mike Shaklik as Chief Revenue Officer (CRO) and member of the company's executive leadership team.

Qualitest
Jul 25th, 2025
Qualitest Named One of Israel's Top 100 Employers for the Fifth Year Running

QualiTest Group is pleased to announce that Qualitest has once again been named by TheMarker and CofaceBdi as one of Israel's Top 100 Companies to Work For in 2025.

Qualitest
Jul 7th, 2025
Oscar Perez Appointed as Chief Operating Officer at Qualitest

London, UK, 7th July 2025 - Qualitest is pleased to announce the appointment of Oscar Perez as its new Chief Operating Officer (COO) and a member of the company's executive leadership team.

Qualitest
Jun 23rd, 2025
Qualitest Wins Bronze at ET Future Skills Awards for Game-Changing L&D Innovation

Qualitest is pleased to announce that QualiTest Group has been awarded the Bronze in the "Best Use of Blended Learning Program" category at the prestigious Economic Times - Future Skills HR Awards 2025, hosted by the Times Group and ETHRWorld.