C

Cadence Design Systems

Develops EDA software, IP, verification tools

Product Validation Engineer 2: AI Agent Quality Assurance

Manual & Functional QAConfirmed live in the last 24 hours
Full-timeBelo Horizonte, State of Minas Gerais, BrazilNo salary listedIn-person

About the Job

Requirements

  • A completed bachelor's degree in Computer Science, Computer Engineering, or Electrical Engineering, or equivalent experience.
  • At least two years of experience in product validation, software quality assurance, test engineering, software development, or engineering productivity tools.
  • Hands-on experience writing test plans and test cases, executing validation cycles, reporting defects, and verifying fixes.
  • Familiarity with artificial intelligence and large language model concepts, AI agents, prompt behavior, retrieval-augmented generation workflows, and common AI system failure modes.
  • Ability to evaluate AI agent outputs using clear quality criteria and communicate findings to technical and product stakeholders.
  • Experience with Python, scripting, or automation for testing, data preparation, log analysis, or reporting.
  • Good spoken and written English and Portuguese.

Responsibilities

  • Validate AI agent products and customer workflows through structured test planning and execution.
  • Test agent behavior across prompts, tool usage, retrieval quality, workflow execution, error handling, and response consistency.
  • Evaluate agent outputs using quality rubrics, benchmarks, regression checks, and metrics such as accuracy, relevance, safety, latency, and task success.
  • Create and expand test case suites and evaluation datasets reflecting real customer scenarios, edge cases, and domain-specific workflows.
  • Document defects, analyze failures, support root-cause triage, and verify fixes through repeatable regression testing.
  • Collaborate with product and engineering teams to improve AI agent quality, release readiness, and customer experience.

Desired Qualifications

  • Experience validating AI agents, copilots, conversational products, or workflow automation tools.
  • Familiarity with AI evaluation frameworks, benchmarking, red-team testing, or metrics-driven product improvement.
  • Experience creating evaluation datasets, golden answers, customer workflow test suites, or regression packs.
  • Knowledge of vector databases, embeddings, retrieval evaluation, or agent orchestration frameworks.
  • Knowledge of electronic design automation, very-large-scale integration design, design verification, emulation, Palladium, or Protium workflows.

About the Company

Cadence Design Systems

Develops EDA software, IP, verification tools

Cadence Design Systems supplies software, hardware, and IP for electronic design automation (EDA) to help customers create advanced semiconductor chips and electronic systems. Its tools handle system design, verification, digital and analog IC design, and custom flows, while IP such as Tensilica processors and DSP cores can be licensed for integration into customer products. The offerings are delivered as software licenses with maintenance and support, plus IP licensing and occasional hardware-accelerated options. The company differentiates itself with a broad, end-to-end EDA portfolio and close collaboration with industry leaders to streamline the path from concept to silicon, aiming to help customers bring sophisticated silicon and electronics to market faster with lower risk and higher productivity.

Company size
10,001+
Company stage
IPO
Headquarters
San Jose, CA
Founded
1988

Recently Posted Jobs

Explore more opportunities at Cadence Design Systems

See more jobs