Responsibilities
* Design and implement automated and manual QA strategies for GenAI systems
* Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy
* Validate prompt logic, model behavior and evaluation metrics
* Execute tests and debug pipelines
* Support deployment of GenAI products
* Lead system design reviews
* Collaborate closely with data scientists and developers
* Establish testing standards and workflows for continuous integration and deployment
* Conduct code reviews and document system design decisions Requirements
* 3+ years of experience as a software engineer
* Familiarity with RAG & Graph frameworks
* 5+ years of experience in production systems
* 1+ year experience in GenAI systems
* Advanced Python skills




* Experience with LLM-based systems
* Hands‐on experience with: LLM APIs, AWS Bedrock, Azure Foundry, GCP
* Proven ability to implement test frameworks
* Knowledge of API testing, data validation, data pipeline testing
* Experience with version control (Git) Core Competencies Demonstrates expertise in designing and implementing QA strategies for GenAI systems, with advanced skills in Python and experience in LLM-based systems. Proficient in establishing testing standards, conducting code reviews, and collaborating with cross‐functional teams to ensure product quality.

📌 Senior Engineer (Cornellà de Llobregat)
🏢 Johnson & Johnson
📍 Cornellà de Llobregat