C

Cognition

Builds AI agents that write and fix code

QA Engineer

Manual & Functional QAConfirmed live in the last 24 hours
Full-timeIndiaNo salary listed

About the Job

Requirements

  • At least 5 years of QA/Test Engineering experience testing complex product workflows, including multi-step user journeys, cross-surface interactions, and end-to-end behavior.
  • Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies.
  • Ability to read and write code in Python, TypeScript, or a similar language, navigate codebases, and reason about systems.
  • A user-first testing approach, testing from the perspective of real users rather than only against a specification.
  • Strong attention to detail and debugging instincts, with the ability to communicate clearly and precisely in bug reports and triage.
  • Familiarity with continuous integration/continuous delivery and test automation frameworks, and comfort working in fast-moving, release-driven environments.
  • Must overlap with U.S. time zones; release cycles may require weekend availability.

Responsibilities

  • Own end-to-end product quality across AI workflows by testing Windsurf and Devin across onboarding flows, chat interactions, multi-file edits, agentic task execution, and autonomous workflows, thinking like a developer and testing like a user.
  • Design and execute comprehensive functional, regression, integration, exploratory, and end-to-end test strategies across product surfaces and releases.
  • Break down complex flows into testable scenarios, identifying edge cases, race conditions, state recovery failures, and real-world usage patterns that emerge in production-like behavior.
  • Reproduce, document, and debug issues across layers, distinguishing between UI defects, orchestration/system issues, and unexpected AI behavior, and work with engineering and product to drive resolution.
  • Partner with engineering and product to define completion criteria, set quality standards, and ensure releases meet the expectations of real developers.
  • Establish QA playbooks, test processes, and automation where it has leverage; help evolve continuous integration/continuous delivery and testing practices as the product scales.

Desired Qualifications

  • Experience testing AI-powered products with non-deterministic outputs and ability to evaluate quality when responses vary.
  • Experience testing IDE plugins/extensions or developer tools such as VS Code extensions, command-line interfaces, or code review systems.
  • Familiarity with AI coding tools such as Windsurf, Copilot, Cursor, and Devin, and informed opinions on what constitutes good performance.
  • Prior software engineering background with shipped production code.

About the Company

Cognition

Builds AI agents that write and fix code

Cognition builds AI agents that write and fix code for software teams, and its agent Devin was one of the first able to carry a software task from assignment to a finished pull request. Engineers give Devin tasks in plain English through Slack, the web, or the company's Devin Desktop editor. Devin then works in its own cloud workspace with a terminal, browser, and code editor, where it plans the change, writes and tests the code, and opens a pull request for an engineer to review. Teams can run many Devin sessions at once, and companies pay through subscriptions and usage-based pricing. Cognition was founded in 2023 and is based in San Francisco.

Company size
501-1,000
Company stage
Late Stage VC
Total funding
$3.7B
Headquarters
San Francisco, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at Cognition

See more jobs