Descripción del puesto / Funciones * Design and execute end-to-end testing strategies specifically tailored for Machine Learning models, Generative AI systems, RAG architectures, and Autonomous Agents. * Validate model accuracy, fairness, bias detection, explainability, robustness, and performance across diverse and edge-case datasets. * Execute adversarial testing, prompt-injection, jailbreaking, and red-teaming to evaluate prompt robustness and behavioral variations under stress. * Validate agentic workflows, including multi-step reasoning paths, state transitions, tool execution, and fallback behaviors during service failures. * Evaluate LLM outputs for correctness, grounding, factuality, consistency, safety, and hallucination reduction. * Assess vector store behavior, document chunking logic, retriever configurations, and semantic search accuracy. * Conduct API, performance, latency, throughput, and concurrency testing on AI inference endpoints and data pipelines. * Ensure compliance with AI ethics, data privacy laws, business rules, and insurance regulatory guidelines,



maintaining audit-ready test evidence and behavioral reports. * Define AI quality KPIs, establish test governance, and build automated testing frameworks integrated into CI/CD pipelines. * Collaborate closely with Data Scientists, ML Engineers, SMEs, and DevOps teams while mentoring junior QA engineers and creating reusable test accelerators. * Experience & Specialization: Proven senior/lead expertise in software quality engineering with a dedicated focus on AI/ML systems and GenAI applications. * Programming & Automation: Advanced proficiency in Python for test automation, data validation, and custom AI testing scripts. * GenAI & RAG Ecosystems: Hands-on experience with GenAI frameworks, vector databases, chunking strategies, and retrieval evaluation. * Model Evaluation & Metrics: Deep understanding of data validation, model evaluation metrics, fairness/bias testing, and drift detection (data an

📌 Lead AI Quality Engineer (España)
🏢 Pasiona Consulting
📍 España