QA Team Lead

The Opportunity

We’re seeking a QA Team Lead to become a founding member of the team and help define the best direction for establishing the QA function across several AI products. This includes providing technical leadership, designing and developing testing infrastructure, selecting and adapting the tech stack, and building and scaling healthy teams with high team engagement. 

You’ll take on the challenge of evaluating and improving LLM quality while working with various programming languages and frameworks. We offer the rare advantage of building from the ground up with minimmal legacy code to hold you back. Moreover, your hands-on approach and innovative technical proficiency will significantly impact how QA is done in the whole industry integrating with AI technologies.

This is a unique opportunity to join an early-stage company led by the founder of a unicorn startup, Andrew Filev, and help scale it into a thriving, innovative business. You’ll be a part of the team that ships AI products, shaping the future of software development and unlocking the creative potential of brilliant minds.

Key Responsibilities

• Manage, develop and mentor exceptional QA team, focusing on engagement, performance, and growth. Conduct regular 1-on-1s to provide feedback, support professional development, and set clear goals.
• Refine, tweak and extend the existing QA infrastructure for multiple AI-driven products. We use TypeScript to test VSCode plug-in and Java/Kotlin to test JetBrains plug-in. 
• Generate ideas how to adapt the tech stack to ensure high-quality testing processes and seamless integration with AI technologies.
• Evaluate the performance of LLMs.
• Define and implement testing strategy.
• Set up test automation and fine-tune it to the state where the majority of testing for a complex project is performed with test automation.
• Optimize the delivery process (CI/CD pipeline).
• Maintain and manage virtual testing environments across multiple programming languages and frameworks. Address key challenges, such as sourcing test data effectively, scaling the diversity of test coverage across different scenarios, etc.
• Work closely with developers, product managers, and other stakeholders to thoroughly understand requirements, offer constructive feedback, and ensure alignment on quality standards.
• Collaborate closely with developers and users to collect feedback, identify areas for improvement, and investigate issues, ensuring the product meets user needs. Engage with our user community, fostering a supportive environment and leveraging user insights to improve the product.
• Explore and define new opportunities to improve our product, particularly in the context of AI-driven tools for QA engineers.
• Leverage AI tools to increase efficiency and effectiveness within the QA processes.
• Serve as a QA expert, providing insights into QA methodologies, tools, and technologies while offering guidance and training to the team.
• Stay updated with the latest trends in QA practices and AI advancements to drive innovation and maintain competitiveness.

Essential Qualifications

• 10+ years of experience in QA, including 7+ years in test automation.
• 5+ years of leadership experience managing teams of 7+ members.
• Proficient in multiple programming languages and able to navigate diverse tech stacks.
• Experience designing and building test automation infrastructure for UI, API, and desktop applications from the ground up.
• Experience in DevOps practices and configuration management to streamline the QA process.
• Strong problem-solving skills, with the ability to tackle complex challenges that may not have been solved by the community yet.
• A solid understanding of startup environments and the flexibility to adapt to fast-changing conditions.
• Proven ability to build teams from the ground up and improve processes in established teams.
• Experienced in 1:1 coaching, team development, giving feedback, hiring, and fostering professional growth.
• Skilled in conflict resolution and promoting healthy team dynamics.
• A hands-on leader who takes ownership and ensures tasks are completed successfully.
• Capable of developing and presenting ideas with clarity and driving their implementation.
• Willing to contribute directly by writing code when needed, not just delegating tasks.
  

  As a plus:

  • Experience implementing or working with AI-driven testing tools.
  • Experience introducing test automation (or testing) for an AI tool/project (familiar with testing AI outputs).
  • Experience with TypeScript/Java, Python, and Playwright.

Why Join Zencoder?

• Impact: Gen AI will change how companies develop software in the next two years. Be at the frontier of that AI work, building a category-leading product in a huge market. You will have an everyday opportunity to innovate.
• Growth potential: Thrive in a high-growth AI startup combining personal and career growth.
• High Talent Density: Collaborate daily with our team of top-notch engineers and founder, Andrew Filev.
• Equity: Align your success with ours by participating in our equity plan.
• Flexibility: We hire globally, prioritizing talent over location. Work where you’re most productive and comfortable.