Experteer Overview
In this role you will own the architecture and execution of automated testing for Julius Baer’s ML u0026amp; AI ART platform. You’ll enable AI-driven capabilities across the bank, including RAG systems, LLM-based assistants, and ML pipelines, by building scalable test automation frameworks and ensuring high-quality releases. You work closely with cross-functional teams to integrate tests into CI/CD, manage environments, and support audit-ready governance. This position offers the chance to shape AI/ML testing practices within a regulated financial setting.

Compensaciones / Ventajas
• Define and evolve the test automation framework aligned with the Bank's Test Strategy
• Design reusable patterns (page objects, API clients, test data builders) for cross-squad adoption
• Analyze requirements for testability and derive test cases across functional and non-functional areas
• Automate test cases using Python-based frameworks (Playwright-Python, requests + pytest, Behave/pytest-bdd)
• Create AI/ML-specific test cases for evaluation pipelines of LLM outputs and RAG/agentic workflows
• Build and maintain contract tests (Pact) for API/microservice boundaries
• Integrate tests into GitLab CI/CD pipelines and manage test environments with Docker/Kubernetes
• Plan and execute regression, smoke, and release tests across environments
• Monitor, triage, and address flaky tests; document defects with evidence in Jira
• Produce audit-ready test artefacts and ensure traceability across Jira features, stories, and tests




• Author and maintain BDD scenarios in Gherkin linked to acceptance criteria
• Collaborate with Product Owners, ML/MLOps/Data engineers; support SAFe ceremonies
• Ensure test data confidentiality, compliant test environments, and end-to-end traceability
• Act as Test Automation Ambassador, guiding tooling decisions and data strategy

Responsabilidades
• Proven Python-based test automation experience (Playwright-Python, Behave/pytest-bdd, requests/pytest)
• Experience designing and owning reusable test automation frameworks
• Hands-on CI/CD automation experience (GitLab or similar)
• Distributed test execution, flaky-test management, and modern reporting tools (Allure/pytest-html)
• Git and clean-code practices; code review experience
• Docker; familiarity with Kubernetes basics
• Exposure to AI/ML testing or strong motivation to develop it
• Understanding of API design, microservices, and authentication layers
• SAFe/DevOps awareness; Agile Release Train experience a plus
• Jira with test management integration (Xray/Agile Hive)
• Strong collaboration, communication, and organizational skills
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 5–7 years in Test Automation with hands-on Python and framework design
• Experience in regulated environments (financial services) preferred
• ISTQB Foundation certification; SAFe or DevOps exposure a plus
• English fluency; German a plus

Requisitos principales
•

📌 Senior Test Automation Engineer 100% (f/m/d) (Madrid)
🏢 Julius Bär
📍 Madrid