Experteer Overview

Asegúrese de leer la descripción completa a continuación y, si confía en que cumple todos los requisitos, envíe su solicitud de inmediato.

In this role you will own the architecture and execution of automated testing for Julius Baer’s ML u0026amp; AI ART platform. You’ll enable AI-driven capabilities across the bank, including RAG systems, LLM-based assistants, and ML pipelines, by building scalable test automation frameworks and ensuring high-quality releases. You work closely with cross-functional teams to integrate tests into CI/CD, manage environments, and support audit-ready governance.

This position offers the chance to shape AI/ML testing practices within a regulated financial setting.

Compensaciones / Incentivos

- Define and evolve the test automation framework aligned with the Bank's Test Strategy
- Design reusable patterns (page objects, API clients, test data builders) for cross-squad adoption
- Analyze requirements for testability and derive test cases across functional and non-functional areas
- Automate test cases using Python-based frameworks (Playwright-Python, requests + pytest, Behave/pytest-bdd)
- Create AI/ML-specific test cases for evaluation pipelines of LLM outputs and RAG/agentic workflows
- Build and maintain contract tests (Pact) for API/microservice boundaries
- Integrate tests into GitLab CI/CD pipelines and manage test environments with Docker/Kubernetes
- Plan and execute regression, smoke, and release tests across environments
- Monitor, triage, and address flaky tests; document defects with evidence in Jira




- Produce audit-ready test artefacts and ensure traceability across Jira features, stories, and tests
- Author and maintain BDD scenarios in Gherkin linked to acceptance criteria
- Collaborate with Product Owners, ML/MLOps/Data engineers; support SAFe ceremonies
- Ensure test data confidentiality, compliant test environments, and end-to-end traceability
- Act as Test Automation Ambassador, guiding tooling decisions and data strategy

Responsabilidades

- Proven Python-based test automation experience (Playwright-Python, Behave/pytest-bdd, requests/pytest)
- Experience designing and owning reusable test automation frameworks
- Hands-on CI/CD automation experience (GitLab or similar)
- Distributed test execution, flaky-test management, and modern reporting tools (Allure/pytest-html)
- Git and clean-code practices; code xugodme review experience
- Docker; familiarity with Kubernetes basics
- Exposure to AI/ML testing or strong motivation to develop it
- Understanding of API design, microservices, and authentication layers
- SAFe/DevOps awareness; Agile Release Train experience a plus
- Jira with test management integration (Xray/Agile Hive)
- Strong collaboration, communication, and organizational skills
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 5–7 years in Test Automation with hands-on Python and framework design
- Experience in regulated environments (financial services) preferred
- ISTQB Foundation certification; SAFe or DevOps exposure a plus
- English fluency; German a plus

Requisitos principales

•

📌 Senior Test Automation Engineer 100% (f/m/d) (Madrid)
🏢 Julius Bär
📍 Madrid