We are looking for aQA EngineerorSoftware Development Engineer in Test (SDET)who shares the same values of pragmatism, professionalism, and transparency that we do. Working from anywhere in Spain, we support our clients in many ways and you will have the opportunity to work on a wide range of projects.You will evaluate, validate and improve quality across teams, participate in developing and executing exploratory and automated tests to ensure software quality. You might also review system requirements and track quality assurance metrics (e.G. pass rate, defect densities and open defect counts.) as well as liaise with various stakeholders (technical and business) from Codurance and our client’s teams.ResponsibilitiesTake ownership of a Python LLM evaluation tool, diagnostic suite, and golden datasets, with the goal of raising pass rates on production AI agents.Refine scoring criteria and design multi-turn conversational evaluations for AI agents.Set up automated regression testing for core product flows using Playwright,



covering integrated workflows and third-party channels.Implement SonarQube quality gate monitoring and daily deviation reportingPartner with senior stakeholders on the QA strategy, standards, and continuous improvementEstimate, prioritize, plan, and coordinate testing activitiesStay up-to-date with new testing tools and test strategiesAt least4 years of experience in a similar roleFluent inSpanishand English (speaking and writing)Consultancyexperience and an open mind around what is quality (adapting to clients)Hands‑on experience withPlaywright, SonarQubeand other testing tools (Cucumber, Selenium, Appium, Jenkins)Knowledge of CI/CD tools and processesContinuous learning (keep up to date with advancements in the market), curiosityStrong programming skills withPython(other stacks are a plus)Practical experience inAI evaluation( LLM evals, agent testing, multi‑turn chat scoring, golden dataset management).It would be a bonus if you also have:QA strate

📌 Sdet / Qa Engineer (+Ai Evaluation) (Madrid)
🏢 Codurance
📍 Madrid