Full-Time

Senior AI Test Automation Engineer

Posted on 5/11/2026

Julius Baer

Julius Baer

5,001-10,000 employees

Provides private banking services worldwide

No salary listed

Madrid, Spain

In Person

Category
QA & Testing (1)
Required Skills
LLM
Kubernetes
Python
Docker
Microservices
JIRA
Playwright
REST APIs
DevOps
Requirements
  • Proven expertise in Python-based test automation: Playwright-Python (UI), Behave or pytest-bdd (Gherkin/BDD), requests + pytest (API/service validation practical equivalence to REST-Assured)
  • Demonstrated ability to design and own test automation frameworks, not just write test scripts including reusable utilities and maintainability patterns
  • Hands-on experience integrating and executing automated tests within CI/CD pipelines, ideally GitLab or equivalent enterprise platforms
  • Experience with distributed test execution, parallelisation, flaky-test management, and modern reporting tools (Allure, pytest-html, or equivalent)
  • Solid grasp of Git and version control workflows, clean code principles, and code review culture
  • Working knowledge of Docker; familiarity with Kubernetes basics (jobs, namespaces)
  • Exposure to testing AI/ML systems, or strong motivation to develop this expertise: evaluation of LLM outputs, handling non-deterministic responses, evals for RAG and agentic workflows
  • Understanding of API design, microservices, event-driven architectures, and authentication layers
  • Sound understanding of SAFe and DevOps principles; experience operating in an Agile Release Train is a plus
  • Experience with Jira for Story/Feature tracking and test management integration (Xray, Agile Hive)
  • Demonstrated end-to-end thinking — connecting user journeys, data flows, authentication layers, and system boundaries
  • Comfortable working within an established Test Strategy, collaborating with Test Managers on execution planning, reporting, and compliance
  • Demonstrated awareness of information security, data privacy, and compliant test data handling in regulated environments
  • Collaborative team player with strong ownership takes automation problems from analysis to execution to resolution with minimal supervision
  • Strong communicator able to work effectively with engineers, Product Owners, Scrum Masters, Architects, and Test Managers
  • Strong organisational skills, structured, reliable
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • Minimum 5–7 years in Test Automation with substantial hands-on Python experience, including demonstrated framework design, ownership, and test execution at scale (not only script-level contributions)
  • Experience in a regulated environment (financial services, healthcare, pharma) strongly preferred
  • Certifications in ISTQB (Foundation as baseline)
  • SAFe (SP, SSM, or equivalent), or DevOps disciplines are a plus
  • Exposure to AI/ML systems through testing, development, or applied projects is a strong plus; appetite to develop deep AI/ML testing expertise is essential
  • Fluency in English; Spanish is a plus
Responsibilities
  • Define and evolve the technical test automation approach and framework architecture for the ML and AI Architecture Release Train, aligned with the Bank's Test Strategy and Test Policy
  • Design reusable, scalable test automation patterns (page objects, API clients, test data builders) that other engineers across squads can adopt, ensuring technical consistency of test automation across the ART
  • Analyse and evaluate requirements, Features, and Stories for testability during PI Planning, Backlog Refinement, and Iteration Planning
  • Derive test cases from technical and risk analysis of both functional and non-functional requirements (reliability, performance, security, usability, robustness), selecting appropriate test techniques and automation scope based on risk, coverage goals, and ROI
  • Automate identified test cases using Python-based frameworks — Playwright-Python for UI, requests + pytest for APIs, Behave or pytest-bdd for BDD/Gherkin — applying clean code principles, reusability, readability, and stability
  • Design and implement AI/ML-specific test cases: evaluation pipelines for LLM outputs
  • Build and maintain contract tests (e.g. Pact) for platform APIs and microservice boundaries
  • Integrate and orchestrate automated tests in GitLab CI/CD pipelines, including merge request pipelines, GitLab runners
  • Leverage Docker and Kubernetes to provision isolated, reproducible test environments
  • Plan, schedule, and trigger automated test executions across environments (DEV, INT, UAT, pre-PROD) — including regression suites, smoke tests, release executions, and on-demand runs tied to merge requests and PI milestones
  • Monitor execution health, investigate and quarantine flaky tests, and maintain a low false-positive rate to keep quality signals trustworthy
  • Triage execution results, raise defects in Jira with evidence (logs, traces, screenshots, videos), and communicate quality signals to the squad, Product Owner, and Test Manager
  • Produce execution evidence (run metadata, artefacts, reports) suitable for audit and release governance, in line with the Bank's Test Policy and retention requirements
  • Contribute actively to PI Planning, System Demos, Inspect & Adapt, and other SAFe ceremonies as part of the ML & AI ART
  • Ensure end-to-end traceability from Jira Features and Stories →automated tests → defects → test results, leveraging the Bank's test management integration
  • Author and maintain BDD scenarios in Gherkin, linked to acceptance criteria on Stories
  • Collaborate closely with Product Owners, Scrum Masters, ML Engineers, MLOps Engineers, and Data Engineers across squads
  • Align work with the Bank's Test Strategy, and reporting requirements, supporting audit-ready artefacts, traceability matrices, and test progress reporting
  • Support root cause analysis of defects using logs and traces
  • Act as Test Automation Ambassador within the ML & AI ART consulting squads on automation design, framework usage, tooling choices, and test data strategy
  • Prepare test data, ensuring synthetic or anonymised data is used wherever possible to meet confidentiality expectations
  • Design AI/ML-specific test datasets where needed
  • Own test maintenance and refactoring in response to UI, API, model, or prompt changes, ensuring continued compliance with access controls and test environment policies

Julius Baer Group Ltd. is a Swiss private bank that serves high-net-worth individuals and families. It focuses on wealth management, investment advisory, discretionary mandates, financing, and related private banking services. Customers’ assets are managed through personalized investment strategies, custody, and tailored financial planning delivered by relationship managers and specialists."

Company Size

5,001-10,000

Company Stage

IPO

Headquarters

Switzerland

Founded

1890

Simplify Jobs

Simplify's Take

What believers are saying

  • Net new money inflows doubled to CHF 7.9 billion in H1 2025, driving growth.
  • Launched UK model portfolios in February 2026, led by Gareth Johnson on major platforms.
  • Appointed Winfried Daun from UBS as Global Head of Brand & Marketing on February 23, 2026.

What critics are saying

  • CFO Evie Kostakis departs end-2026, disrupting financial oversight after India head exit.
  • Key exits of Kostakis, Papneja by July 2026, and Zoutendijk impair client retention.
  • Board misses gender diversity targets post-Zoutendijk, inviting FINMA scrutiny by 2027.

What makes Julius Baer unique

  • Julius Baer specializes in pure-play wealth management for high-net-worth individuals since 1890.
  • Operates in 25 countries with 60 locations, focusing on Switzerland and Asia home markets.
  • Offers sustainable discretionary mandates as Swiss Sustainable Finance member.

Help us improve and share your feedback! Did you find this helpful?

Your Connections

People at Julius Baer who can refer or advise you

Benefits

Flexible Work Hours

Company News

Finews AG
Apr 10th, 2026
Explosive news at Julius Bär.

Explosive news at Julius Bär. Chief Financial Officer Evie Kostakis has announced her departure by the end of the year. She will take on a new international leadership position. Leaving Julius Bär by the end of 2026: Chief Financial Officer Evie Kostakis. (Image: Julius Bär) Friday, April 10, 2026 15:51 Julius Bär Chief Financial Officer (CFO) Evie Kostakis will step down from her role by the end of 2026. The succession plan is already underway, and her successor will be announced in due course, according to a statement from the bank on Friday afternoon. An orderly transition process is expected to take place in the second half of the year. She is stepping down to take on a new international leadership position, the statement adds. CFO since 2022 'I thank Evie Kostakis for her leadership and tireless dedication to our company,' says CEO Stefan Bollinger. 'During her 13 years at Julius Bär, including the last six first as deputy CFO and since 2022 as group CFO, she has played a key role in strategically optimizing our presence, enhancing our operational efficiency, and strengthening our investor base.' Kostakis took over the CFO position at Julius Bär in July 2022. The Greek-American dual citizen joined Julius Bär in 2013. With her departure, another key position at the bank will be filled, following last year's appointment of Stefan Bollinger as CEO. On the topic. To ensure you don't miss anything important: Daily and free top news.

Private Banker International
Apr 10th, 2026
Bank of Singapore hires Julius Baer exec as ASEAN private banking head.

Bank of Singapore hires Julius Baer exec as ASEAN private banking head. The appointment also fits within OCBC's corporate strategy, The Next Frontier, including an Asia Shift focused on Asian wealth flows. Bank of Singapore, the private banking subsidiary of OCBC, has appointed Vi Sun Yang from Julius Baer as its Head of Private Banking, ASEAN with effect from 29 June 2026. In the role, Yang will oversee the development of the bank's private banking business across ASEAN, which it identifies as its largest market. The appointment also fits within OCBC's corporate strategy, The Next Frontier, including an Asia Shift focused on Asian wealth flows. The bank said that in 2025 it exceeded the assets under management target of $145bn that had been set in 2023. It also reported growth of more than 20% in global AUM. Yang joins from Julius Baer, where she served as Market Head for Southeast Asia. She has more than 30 years of experience in wealth management. Earlier in her career, she spent 14 years at UBS Singapore, holding senior posts including Head of the Private Client Segment across seven Asian markets and Market Head for Indonesia. She has also worked at American Express, DBS and Standard Chartered. She will join the bank's global management committee and report to chief executive Mr Jason Moo. Moo said: "We look forward to welcoming Vi Sun to the Bank of Singapore family. Our continued ability to attract top talent like her underscores the strong appeal of our franchise and the confidence private bankers have in joining us on our growth journey. As a bank headquartered in Singapore, ASEAN is an important region for us, one where we consistently invest to enhance our capabilities and strengthen our client proposition. I am confident Vi Sun's wealth of experience and proven leadership will further uplift the momentum of our growing ASEAN business." The hire follows other senior appointments at the bank. In March 2026, Bank of Singapore named Eng Chien Chan as Market Group Head for Greater China and Bernard Heng as Head of Customised Solutions in its Investment Solutions Group. Yang has more than 30 years of experience in wealth management. Credit: Bank of Singapore. Give your business an edge with its leading industry insights.

Yahoo Finance
Mar 16th, 2026
Julius Baer announces board shake-up as Zoutendijk steps down, two new directors join

Julius Baer Group has announced that Olga Zoutendijk will step down from its board at the annual general meeting on 9 April 2026, after seven years of service. The Swiss wealth manager plans to nominate Urban Angehrn and Colin Bell as new board members. Bell, formerly group chief compliance officer at HSBC and UBS, brings extensive experience in compliance, risk management and regulatory relations. Board chairman Noel Quinn praised his expertise in building compliance programmes and business transformation. The changes mean Julius Baer will temporarily fall short of its gender diversity targets. The company is actively seeking qualified female candidates and aims to meet diversity requirements before the 2027 AGM. Julius Baer recently reported a 25% decline in net profit for 2025 to SFr764 million, attributed to one-off charges and credit losses.

Finews AG
Mar 16th, 2026
Bar nominates major bank compliance specialist for board of directors.

Bar nominates major bank compliance specialist for board of directors. Colin Bell, who has served as Chief Compliance Officer at both HSBC and UBS, is set to become a member of Julius Bar's board of directors. As he replaces a woman, the committee will become more male-dominated - the bank promises swift improvement. Colin Bell is to become a new board member at Julius Bar. (Image: LinkedIn) Monday, March 16, 2026 08:39 At Julius Bar, which presented its business report on Monday, there will be a change in the board of directors. Olga Zoutendijk will not stand for re-election at the general meeting on April 9, 2026, the group also announced on Monday - and immediately proposed Colin Bell as a replacement. In the communiqué, Bell is described as 'a highly qualified banking industry leader' with extensive experience in corporate governance and excellent expertise in anti-money laundering, financial crime compliance, and non-financial risk. Good connections with supervisory authorities and military career Bell recently ended his operational career to focus on advisory roles and board mandates. He previously served as Group Chief Compliance Officer at HSBC and as Group Chief Compliance Officer and Head of Non-Financial Risk at UBS. However, he did not start his career in the financial sector but rather in the British Army, where he held various leadership positions for 16 years, likely why Bar also highlights his 'geopolitical knowledge'. Bell has a good network with British supervisory authorities, the Financial Conduct Authority, Prudential Regulation Authority, and the European Central Bank. During his time at UBS, he also worked closely with Finma. Double with Urban Angehrn Noel Quinn, Chairman of the Board of Directors of the Julius Bar Group, commented on the nomination: 'He has extensive experience and will make significant contributions with his skills acquired in building and implementing demanding compliance programs, as well as his significant competencies in corporate and technology transformation.' Already in early February, Bar announced plans to propose Urban Angehrn (former director of Finma) as a new board member. Gender diversity: Target not achieved The group now notes that with these planned changes in the governing body, the self-set goals and guidelines regarding gender diversity 'unfortunately' would not be met. This is to change: 'The board of directors is actively engaged in searching for and selecting highly qualified female candidates who will further strengthen the expertise of the board and support its commitment to diversity.' Suitable nominations are to be submitted to shareholders 'preferably before the next ordinary general meeting in 2027.'

Yahoo Finance
Feb 25th, 2026
Julius Baer launches model portfolios for UK advisers led by ex-Brewin Dolphin chief

Julius Baer has launched a suite of model portfolios for UK financial advisers, led by Gareth Johnson, who previously spent 14 years running the Model Portfolio Service at Brewin Dolphin. The offering includes "active" and "passive+" portfolios covering risk profiles 3-8 as classified by Defaqto, Dynamic Planner and EV. A UK-based team will manage the models with support from Julius Baer's network of 600 investment professionals globally. The Swiss private bank cited rising demand for outsourced investment solutions driven by evolving client expectations and increasing regulatory complexity. The portfolios will launch on several platforms including Fidelity, Morningstar, Aberdeen, Quilter, Transact and Aviva. The move follows similar action by Edmond De Rothschild, which entered the UK model portfolio space in January.