Postúlate en Kit Empleo: kitempleo.es/empleo/6l5x1r

Senior AI Test Automation Engineer - Hybrid Madrid

? We are looking for the very Top Talent…and we would be delighted if you were to join our team
More in details, UST is a multinational company based in North America, certified as a Top Employer and Great Place to Work company with over 35.000 employees all over the world and presence in more than 35 countries. We are leaders on digital technology services, and we provide large-scale technologic solutions to big companies.

? What we look for?
We are looking for a Senior AI Test Automation Engineer to lead and evolve the test automation strategy for an advanced AI & MLOps platform. You will combine strong hands-on expertise in Python-based automation with the ability to design scalable frameworks and ensure quality across complex systems, including APIs, UIs, data pipelines, and AI/ML-driven components such as LLMs and RAG systems.
You bring a product mindset, end-to-end ownership, and experience working in Agile/SAFe environments, with a strong focus on quality engineering, reliability, and automation at scale.



Exposure to AI/ML testing or a strong motivation to grow in this area is key.

? Main tasks and accountabilities will be:
- Own the design, architecture, and evolution of the test automation framework for the AI & MLOps platform
- Define and implement scalable, reusable automation patterns (UI, API, data, BDD)
- Automate test cases using Python stack (Playwright, pytest, requests, pytest-bdd/Behave) applying clean code practices
- Design and execute AI/ML-specific tests (e.g., LLM evaluation, RAG validation, non-deterministic outputs)
- Integrate and orchestrate automated tests within CI/CD pipelines (GitLab), ensuring reliable execution across environments
- Provision and manage test environments using Docker and Kubernetes
- Plan and execute regression, smoke, and release test suites across DEV, INT, UAT, and pre-PROD
- Monitor execution quality, manage flaky tests, and ensure trustworthy test results
-

Postúlate en Kit Empleo: kitempleo.es/empleo/6l5x1r

📌 Senior AI Test Automation Engineer (Gijón)
🏢 Ust
📍 Gijón