Official role description

Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Spanish law. We are hiring experienced in-house counsel to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric. — What you'll do

- Run the same set of prompts across two AI (LLM) platforms

- Compare the outputs from both platforms side by side

- Score each response against a standardized rubric we provide

- Submit concise written feedback for every evaluation — Requirements

- 5+ years as in-house legal counsel practising in Spain

- Strong command of Spanish law, especially commercial and contract matters

- Sharp attention to detail and precise written communication

- Able to work independently to a rubric and to deadlines — Logistics

- Initial commitment: ~10 hours, with strong potential for more

- Confidentiality: all work is covered by NDA

Relevant skills

AI evaluation

📌 In-House Counsel (Spain) (Madrid)
🏢 HumaniTapp
📍 Madrid