OverviewAs AI QA Engineer in the AI for Coding Team, you will ensure reliability of both human and AI-generated code while shaping test strategies for AI-assisted development.
You collaborate with developers and ML engineers to validate AI performance and maintain quality gates across releases.
You design regression tests, oversee AI evaluation pipelines, and curate benchmarks to drive model improvement.
This role combines traditional QA rigor with AI-focused evaluation in a fast-paced, mission-driven tech hub.
Compensaciones / BeneficiosHybrid remote-office workplace
Adaptable schedule
Private Health insurance
Restaurant Ticket for 170/month
24 Holiday days per year
* Referral reward
ResponsabilidadesDefine and execute test plans for human-written and AI-generated code
Design regression testing for AI-assisted development workflows
Collaborate with ML engineers to evaluate precision, recall, and correctness metrics




Monitor automated test pipelines with AI evaluation steps
Curate benchmark datasets for fine-tuning (SFT/DPO) based on QA insights
Define and maintain quality thresholds for PR bot output
Promote a data-driven QA culture focused on continuous AI model improvement
Requisitos principales3+ years of experience as a QA Engineer testing web or mobile applications
Solid understanding of software testing principles and automation frameworks (Cypress, Playwright)
Experience with CI/CD pipelines and test integration tools
Ability to analyze metrics and interpret AI outputs
Hands-on experience with API testing tools (Postman, Charles Proxy)
Interest in LLM evaluation and model monitoring workflows
collaboration with cross-functional teams
data-driven mindset
proactive communication
Cypress
Playwright
CI/CD tooling

📌 Ai Qa Engineer (España)
🏢 Melza Consulting
📍 España