02 oct
|
Jobgether
|
España
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Product Manager based in Spain.
Lead the product strategy for evaluating and improving the quality of AI-generated advertising creative at scale.
You’ll own the full Evals & Quality product area, from defining what “good” means to building reliable systems that measure it.
The role combines product discovery, measurement methodology, human and automated evaluation, and customer-facing commercial enablement.
You’ll work closely with AI and agent teams to make quality metrics an integral part of how new capabilities are developed and launched.
A key focus will be creating scalable evaluation loops, representative datasets, and judging frameworks for a highly subjective creative domain.
You’ll also translate quality evidence into customer-facing assets, helping demonstrate product capabilities through RFPs, enablement materials, and public evaluations.
This is a remote opportunity for an experienced product leader who enjoys ambiguity,
measurable outcomes, fast iteration, and AI-powered products.
Accountabilities
- Own the overall charter for Evals & Quality, defining the long-term problem, success metrics, priorities, and clear scope boundaries.
- Define and improve core quality metrics, including first-pass-right performance, evaluation coverage, and regression detection.
- Own the methodology for evaluating creative quality, including quality rubrics and calibration processes that maintain alignment between automated judges and human reviewers.
- Design and manage scalable human quality-control processes, determining where human review adds value and how those judgments can improve automated evaluation systems.
- Own the golden dataset, including its curation, representativeness across formats and client contexts, versioning, and ongoing maintenance.
- Build reusable evaluation loops that enable product and engineering teams to e
📌 Senior Product Manager (España)
🏢 Jobgether
📍 España