Vena Solutions

SaaS financial planning with Excel integration

Senior Software Developer in Test - AI Portfolio

Test Automation EngineeringUpdated on Nov 13

Full-timeRemote in CanadaCA$114.8k - CA$155.3k /yr

About the Job

Requirements

At least 5 years of experience in quality assurance/quality engineering and test automation development roles within an Agile environment.
A proven track record testing AI/ML products, including prompt evaluation, bias detection, or model boundary testing.
Hands-on experience integrating AI tools or large language model APIs into continuous integration and continuous delivery pipelines to accelerate test execution and automatically detect flaky tests.
Strong understanding of software testing methodologies, automation design patterns, and high-quality test case development.
At least 3 years of hands-on experience with one or more automation frameworks for UI and API test automation, such as Playwright, Cypress, Selenium, RestAssured, RestSharp, or Pytest.
Hands-on experience with version control, issue tracking, and test case management tools such as GitHub, GitLab, JIRA, Xray, Zephyr, or Qase.
Proficiency with relational databases and data validation using SQL, MS SQL, Oracle, GraphQL, or DB2.
Proficiency in one or more programming languages, such as Java, JavaScript, TypeScript, C#, or Python.
Ability to assess system architecture and the impact of product changes across components.
Strong troubleshooting, analytical, and problem-solving skills.
Written and verbal communication skills to explain technical and non-technical concepts.
Interest in AI and willingness to explore AI-driven solutions to improve performance and efficiency.

Responsibilities

Analyze functional and technical requirements to define comprehensive test strategies and automation needs.
Design, write, maintain, and manage automated UI and API test suites.
Contribute to building and enhancing scalable automation frameworks, such as Playwright and Rest-Assured.
Identify, plan, and execute exploratory, functional, integration, performance, and regression tests.
Collaborate with development and product teams to validate testing requirements and optimize test coverage.
Promote best practices for automation, test data management, continuous integration and continuous delivery integration, and code quality.
Monitor, troubleshoot, and optimize automation pipelines and test frameworks for dependability, scalability, and stability.
Perform root cause analysis and support teams in identifying and preventing defects.
Define and implement testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality.
Use generative AI and modern AI tools to improve test automation, streamline test case development, and improve testing efficiency and coverage.

As a Senior Software Developer in Test, you will be responsible for the development, execution, and maintenance of automated tests to support the Software Test Life Cycle for Vena’s agentic AI solutions. You will collaborate closely with development and product teams to define and execute functional, integration, and regression testing strategies, while continuously improving the scalability, stability, and reliability of testing processes.

You will play a key role in defining and implementing testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality. Additionally, you will leverage Generative AI and modern AI tools to enhance test automation, streamline test case development, and improve testing efficiency and coverage.

Analyze functional and technical requirements to define comprehensive test strategies and automation needs
Design, write, maintain, and manage automated UI and API test suites
Contribute to building and enhancing scalable automation frameworks (e.g., Playwright, Rest-Assured)
Identify, plan, and execute exploratory, functional, integration, performance, and regression tests
Collaborate with development and product teams to validate testing requirements and optimize test coverage
Champion best practices for automation, test data management, CI/CD integration, and code quality
Monitor, troubleshoot, and optimize automation pipelines and test frameworks for dependability, scalability, and stability
Perform root cause analysis and support teams in identifying and preventing defects

5+ years’ experience in QA/QE and test automation development roles, within a fast-paced Agile environment
AI Testing Expertise: Proven track record testing AI/ML products (including prompt evaluation, bias detection, or model boundary testing)
Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines to accelerate test execution and automatically detect flaky tests.
Strong understanding of software testing methodologies, automation design patterns, and the fundamentals of high-quality test case development
3+ years of hands-on experience with at least one automation framework for both UI and API test automation (Playwright, Cypress, Selenium, RestAssured, RestSharp, Pytest, etc.)
Hands-on experience with version control, issue tracking, and test case management tools (GitHub, Gitlab, JIRA, Xray, Zephyr, Qase, etc.)
Proficiency with relational databases and data validation (SQL, MS SQL, Oracle, GraphQL, or DB2)
Proficiency in one or more programming languages (Java, JavaScript, Typescript, C#, or Python)
Ability to think critically about system architecture and assess the impact of product changes across components
Strong troubleshooting, analytical, and problem-solving skills
Exceptional written and verbal communication skills, with the ability to articulate both technical and non-technical concepts
Interest in AI and willingness to explore AI-driven solutions to enhance performance and drive efficiencies

The base salary range for this role is $114,750-155,250 CAD.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.

About the Company

Vena Solutions

SaaS financial planning with Excel integration

Vena Solutions provides a SaaS financial planning and management platform called Vena Complete Planning. It sits in the cloud and connects to Microsoft Excel, so users can keep using a familiar tool while gaining more planning power. The product uses artificial intelligence and flexible data modeling to combine financial, operational, and other data, delivering insights and automating routine tasks. It also offers automated workflows, integrations with source systems, and strong security within a structured database, helping teams collaborate and make better financial decisions. What sets it apart is the combination of Excel-based workflows with a full planning platform, enterprise-grade security, and cross-department data connections that reveal dependencies and trends. The company aims to help businesses streamline their planning processes, improve financial resilience, and drive growth.

Company size: 501-1,000
Company stage: Series C
Total funding: $415M
Headquarters: Toronto, Canada
Founded: 2011

Recently Posted Jobs

Explore more opportunities at Vena Solutions

See more jobs