Responsibilities- Design and implement automated and manual QA strategies for GenAI systems- Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy- Validate prompt logic, model behavior and evaluation metrics- Execute tests and debug pipelines- Support deployment of GenAI products- Lead system design reviews- Collaborate closely with data scientists and developers- Establish testing standards and workflows for continuous integration and deployment- Conduct code reviews and document system design decisionsRequirements- 3+ years of experience as a software engineer- Familiarity with RAG & Graph frameworks- 5+ years of experience in production systems- 1+ year experience in GenAI systems- Advanced Python skills- Experience with LLM-based systems- Hands‑on experience with: LLM APIs, AWS Bedrock, Azure Foundry, GCP- Proven ability to implement test frameworks- Knowledge of API testing, data validation, data pipeline testing- Experience with version control (Git)Core CompetenciesDemonstrates expertise in designing and implementing QA strategies for GenAI systems, with advanced skills in Python and experience in LLM-based systems. Proficient in establishing testing standards, conducting code reviews, and collaborating with cross‑functional teams to ensure product quality.#J-18808-Ljbffr

📌 Senior Engineer – Genai Quality Assurance (España)
🏢 Jobtailor
📍 España