ResponsibilitiesDesign and implement automated and manual QA strategies for GenAI systemsBuild regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracyValidate prompt logic, model behavior and evaluation metricsExecute tests and debug pipelinesSupport deployment of GenAI productsLead system design reviewsCollaborate closely with data scientists and developersEstablish testing standards and workflows for continuous integration and deploymentConduct code reviews and document system design decisionsRequirements3+ years of experience as a software engineerFamiliarity with RAG & Graph frameworks5+ years of experience in production systems1+ year experience in GenAI systemsAdvanced Python skillsExperience with LLM-based systemsHands‑on experience with: LLM APIs, AWS Bedrock, Azure Foundry, GCPProven ability to implement test frameworksKnowledge of API testing, data validation, data pipeline testingExperience with version control (Git)Core CompetenciesDemonstrates expertise in designing and implementing QA strategies for GenAI systems, with advanced skills in Python and experience in LLM-based systems. Proficient in establishing testing standards, conducting code reviews, and collaborating with cross‑functional teams to ensure product quality.

📌 Senior Engineer – GenAI Quality Assurance (Cornellà de Llobregat)
🏢 Jobtailor
📍 Cornellà de Llobregat