- Write realistic, self-contained prompts for client-side web applications, games, tools, and simulations.
- Create precise, binary evaluation rubrics tagged by verification type.
- Ensure rubric items are pass/fail and verifiable through screenshot and code inspection.
- Develop high-quality datasets focused on UI behavior, interactivity, robustness, and state management.
- Apply frontend engineering expertise to evaluate correctness and user experience.
- Collaborate asynchronously with research and review teams.
Requirements
- Professional experience in frontend or full-stack development.
- Strong proficiency in JavaScript, TypeScript, React, or vanilla JS.
- Ability to write clear technical specifications and structured evaluation criteria.
- Strong analytical thinking and attention to detail.
- Comfortable working independently in a remote, deliverables-driven environment.
- Bachelor’s degree in Software Engineering, Computer Science, or related field preferred.