Experteer Overview In this role you will own the architecture and execution of automated testing for Julius Baer’s ML u0026amp; AI ART platform. You’llenable AI-driven capabilities across the bank, including RAG systems, LLM-based assistants, and ML pipelines, by building scalable test automation frameworks and ensuring high-quality releases. You work closely with cross-functional teams to integrate tests into CI/CD, manage environments, and support audit-ready governance. This position offers the chance to shape AI/ML testing practices within a regulated financial setting.Compensaciones / Ventajas
- Define and evolve the test automation framework aligned with the Bank's Test Strategy
- Design reusable patterns (page objects, API clients, test data builders) for cross-squad adoption
- Analyze requirements for testability and derive test cases across functional and non-functional areas
- Automate test cases using Python-based frameworks (Playwright-Python, requests + pytest, Behave/pytest-bdd)
- Create AI/ML-specific test cases for evaluation pipelines of LLM outputs and RAG/agentic workflows
- Build and maintain contract tests (Pact) for API/microservice boundaries
- Integrate tests into GitLab CI/CD pipelines and manage test environments with Docker/Kubernetes
- Plan and execute regression, smoke, and release tests across environments
- Monitor, triage, and address flaky tests; document defects with evidence in Jira
- Produce audit-ready test artefacts and ensure traceability across Jira features, stories, and tests




- Author and maintain BDD scenarios in Gherkin linked to acceptance criteria
- Collaborate with Product Owners, ML/MLOps/Data engineers; support SAFe ceremonies
- Ensure test data confidentiality, compliant test environments, and end-to-end traceability
- Act as Test Automation Ambassador, guiding tooling decisions and data strategyResponsabilidades
- Proven Python-based test automation experience (Playwright-Python, Behave/pytest-bdd, requests/pytest)
- Experience designing and owning reusable test automation frameworks
- Hands-on CI/CD automation experience (GitLab or similar)
- Distributed test execution, flaky-test management, and modern reporting tools (Allure/pytest-html)
- Git and clean-code practices; code review experience
- Docker; familiarity with Kubernetes basics
- Exposure to AI/ML testing or strong motivation to develop it
- Understanding of API design, microservices, and authentication layers
- SAFe/DevOps awareness; Agile Release Train experience a plus
- Jira with test management integration (Xray/Agile Hive)
- Strong collaboration, communication, and organizational skills
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 5–7 years in Test Automation with hands-on Python and framework design
- Experience in regulated environments (financial services) preferred
- ISTQB Foundation certification; SAFe or DevOps exposurea plus
- English fluency; German a plusRequisitosprincipales
-

📌 Senior Test Automation Engineer 100% (F/M/D) (Madrid)
🏢 Julius Bär
📍 Madrid