At Julius Baer, we celebrate and value the individual qualities you bring, enabling you to be impactful, to be entrepreneurial, to be empowered, and to create value beyond wealth. Let’s shape the future of wealth management together.You will join our ML & AI ART as a Senior Test Automation Engineer, responsible for the technical test automation solution supporting our AI and MLOps platform. The platform powers AI-driven capabilities across the Bank including RAG systems, LLM-based assistants, agentic workflows, and ML pipelines serving business-critical use cases. You will own the architecture, implementation, and execution of our test automation frameworks, covering both traditional software components (APIs, UIs, data pipelines) and emerging AI/ML-specific behaviour, and act as the Test Automation Ambassador within the ART. You will work within the Bank's Test Strategy, while owning the technical depth and hands-on delivery of automation for your platform.YOUR CHALLENGEDefine and evolve the technical test automation approach and framework architecture for the ML & AI ART, aligned with the Bank's Test Strategy and Test Policy Design reusable, scalable test automation patterns (page objects, API clients, test data builders) that other engineers across squads can adopt, ensuring technical consistency of test automation across the ARTAnalyse and evaluate requirements, Features, and Stories for testability during PI Planning, Backlog Refinement, and Iteration PlanningDerive test cases from technical and risk analysis of both functional and non-functional requirements (reliability, performance, security, usability, robustness), selecting appropriate test techniques and automation scope based on risk, coverage goals, and ROIAutomate identified test cases using Python-based frameworks - Playwright-Python for UI, requests + pytest for APIs, Behave or pytest-bdd for BDD/Gherkin - applying clean code principles, reusability, readability, and stabilityDesign and implement AI/ML-specific test cases: evaluation pipelines for LLM outputsBuild and maintain contract tests (e.g. Pact) for platform APIs and microservice boundariesIntegrate and orchestrate automated tests in GitLab CI/CD pipelines, including merge request pipelines, GitLab runnersLeverage Docker and Kubernetes to provision isolated, reproducible test environmentsPlan, schedule, and trigger automated test executions across environments (DEV, INT, UAT, pre-PROD) - including regression suites, smoke tests, release executions, and on-demand runs tied to merge requests and PI milestonesMonitor execution health, investigate and quarantine flaky tests, and maintain a low false-positive rate to keep quality signals trustworthyTriage execution results, raise defects in Jira with evidence (logs, traces, screenshots, videos), and communicate quality signals to the squad, Product Owner, and Test ManagerProduce execution evidence (run metadata, artefacts, reports) suitable for audit and release governance,



in line with the Bank's Test Policy and retention requirementsContribute actively to PI Planning, System Demos, Inspect & Adapt, and other SAFe ceremonies as part of the ML & AI ARTEnsure end-to-end traceability from Jira Features and Stories → automated tests → defects → test results, leveraging the Bank's test management integrationAuthor and maintain BDD scenarios in Gherkin, linked to acceptance criteria on StoriesCollaborate closely with Product Owners, Scrum Masters, ML Engineers, MLOps Engineers, and Data Engineers across squadsAlign work with the Bank's Test Strategy, and reporting requirements, supporting audit-ready artefacts, traceability matrices, and test progress reportingSupport root cause analysis of defects using logs and tracesAct as Test Automation Ambassador within the ML & AI ART consulting squads on automation design, framework usage, tooling choices, and test data strategyPrepare test data, ensuring synthetic or anonymised data is used wherever possible to meet confidentiality expectationsDesign AI/ML-specific test datasets where neededOwn test maintenance and refactoring in response to UI, API, model, or prompt changes, ensuring continued compliance with access controls and test environment policiesYOUR PROFILEProven expertise in Python-based test automation: Playwright-Python (UI), Behave or pytest-bdd (Gherkin/BDD), requests + pytest (API/service validation practical equivalence to REST-Assured)Demonstrated ability to design and own test automation frameworks, not just write test scripts including reusable utilities and maintainability patternsHands-on experience integrating and executing automated tests within CI/CD pipelines, ideally GitLab or equivalent enterprise platformsExperience with distributed test execution, parallelisation, flaky-test management, and modern reporting tools (Allure, pytest-html, or equivalent)Solid grasp of Git and version control workflows, clean code principles, and code review cultureWorking knowledge of Docker; familiarity with Kubernetes basics (jobs, namespaces)Exposure to testing AI/ML systems, or strong motivation to develop this expertise: evaluation of LLM outputs, handling non-deterministic responses, evals for RAG and agentic workflowsUnderstanding of API design, microservices, event-driven architectures, and authentication layersSound understanding of SAFe and DevOps principles; experience operating in an Agile Release Train is a plusExperience with Jira for Story/Feature tracking and test management integration (Xray, Agile Hive)Demonstrated end-to-end thinking — connecting user journeys, data flows,



authentication layers, and system boundariesComfortable working within an established Test Strategy, collaborating with Test Managers on execution planning, reporting, and complianceDemonstrated awareness of information security, data privacy, and compliant test data handling in regulated environmentsCollaborative team player with strong ownership takes automation problems from analysis to execution to resolution with minimal supervisionStrong communication skills, able to work effectively with engineers, Product Owners, Scrum Masters, Architects, and Test ManagersStrong organisational skills, structured, reliableBachelor's or Master's degree in Computer Science, Engineering, or a related fieldMinimum 5-7 years in Test Automation with substantial hands-on Python experience, including demonstrated framework design, ownership, and test execution at scale (not only script-level contributions)Experience in a regulated environment (financial services, healthcare, pharma) strongly preferredCertifications in ISTQB (Foundation as baseline) SAFe (SP, SSM, or equivalent), or DevOps disciplines are a plusExposure to AI/ML systems through testing, development, or applied projects is a strong plus; appetite to develop deep AI/ML testing expertise is essentialFluency in English; German is a plusThe international reference in wealth management Julius Baer is the leading Swiss wealth management group. We focus on servicing and advising sophisticated private clients from around the world, taking into account what truly matters to them – in their business and personal life, today and for future generations.Headquartered in Zurich, we are present in around 60 locations worldwide, including Bangkok, Dubai, Dublin, Frankfurt, Geneva, Hong Kong, London, Luxembourg, Madrid, Mexico City, Milan, Monaco, Mumbai, Santiago de Chile, Shanghai, Singapore, Tel Aviv, and Tokyo.Why join Julius Baer?We are growing quickly, but we remain dedicated to maintaining our accessible structure with flat hierarchies, and approachable and supportive leaders.With offices around the world, we offer an international and stimulating work environment and the opportunity to work with a diverse team of highly motivated colleagues, bringing the best of the bank to our clients.Our core values of Care, Passion, and Excellence define the tone of how we interact with each other and our partners.Committed to your success Whether nurturing young talent with our renowned apprentice scheme, enabling ambitious university graduates to put theory into practice with our Graduate Programme, or providing first-class opportunities for experienced professionals, we look after our employees.We believe in continuous learning as a company and as individuals, which is why we put a focus on the health and well-being of our employees and offer versátil working options, a wide array of benefits, and extensive career development programmes.
#J-18808-Ljbffr

📌 Senior Test Automation Engineer 100% (f/m/d) (Madrid)
🏢 Bank Julius Bär Ltd.
📍 Madrid