Responsibilities
- Evaluate AI-generated coding interactions end to end.
- Judge whether outputs are useful, correct at a high level, and aligned with strong engineering thinking.
- Assess the quality of explanations, reasoning, preambles, and coding-agent behavior without necessarily executing the code or reviewing every line.
- Distinguish between different levels of response quality and help define what excellent interactions look like.
- Provide clear, opinionated written feedback and record short video explanations about what worked, failed, or felt misleading.
Requirements
- Senior, Staff, or Principal-level software engineering experience, or equivalent experience.
- Strong background in TypeScript, JavaScript, or Python.
- Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.
- Deep familiarity with modern AI-assisted development workflows.
- Ability to evaluate code without executing it or reviewing every line.
- Strong written and spoken English at B2 level or above.
- Comfort giving direct, opinionated feedback and applying rigorous engineering judgment.
Benefits
- Remote worldwide contract engagement.
- Versátil schedule of 10–20 hours per week.
- Ongoing projects typically lasting about two weeks to a few months, with new projects offered to successful evaluators.
- Start as soon as the take-home exercise is completed and a project has an opening.
- Selection process consists of one take-home evaluation exercise with a recorded Loom walkthrough and no interview.
📌 Senior Software Engineer, AI Training (España)
🏢 G2i
📍 España