Descripción del puesto / Funciones Design and execute end-to-end testing strategies specifically tailored for Machine Learning models, Generative AI systems, RAG architectures, and Autonomous Agents. Validate model accuracy, fairness, bias detection, explainability, robustness, and performance across diverse and edge-case datasets. Execute adversarial testing, prompt-injection, jailbreaking, and red-teaming to evaluate prompt robustness and behavioral variations under stress. Validate agentic workflows, including multi-step reasoning paths, state transitions, tool execution, and fallback behaviors during service failures. Evaluate LLM outputs for correctness, grounding, factuality, consistency, safety, and hallucination reduction. Assess vector store behavior, document chunking logic, retriever configurations, and semantic search accuracy. Conduct API, performance, latency, throughput, and concurrency testing on AI inference endpoints and data pipelines. Ensure compliance with AI ethics, data privacy laws, business rules, and insurance regulatory guidelines,



maintaining audit-ready test evidence and behavioral reports. Define AI quality KPIs, establish test governance, and build automated testing frameworks integrated into CI/CD pipelines. Collaborate closely with Data Scientists, ML Engineers, SMEs, and Dev Ops teams while mentoring junior QA engineers and creating reusable test accelerators. Experience & Specialization: Proven senior/lead expertise in software quality engineering with a dedicated focus on AI/ML systems and Gen AI applications. Programming & Automation: Advanced proficiency in Python for test automation, data validation, and custom AI testing scripts. Gen AI & RAG Ecosystems: Hands-on experience with Gen AI frameworks, vector databases, chunking strategies, and retrieval evaluation. Model Evaluation & Metrics: Deep understanding of data validation, model evaluation metrics, fairness/bias testing, and drift detection (data and concept drift). API Te

📌 Lead Ai Quality Engineer (Barcelona)
🏢 Pasiona Consulting
📍 Barcelona