This role focuses on improving the quality, usefulness, and reliability of advanced conversational AI systems used across real-world and professional applications. Emphasis is placed on evaluating how models reason about code, generate solutions, and explain technical concepts across varying levels of complexity.

¿Tiene las cualificaciones y habilidades adecuadas para este trabajo? Descúbralo a continuación y pulse en "solicitar" para ser considerado.

Position

Software Engineering & Data Science Experts

Type

Hourly Contract (Full-time or Part-time)

Engagement

Remnote General | Part-time

Compensation

$60 –$100/hour

Location

Remote (US & Non-US)

Role Responsibilities

Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness

Perform fact-checking using trusted public sources and authoritative references

Execute code to validate outputs and ensure correctness

Annotate responses by identifying strengths, weaknesses, and inaccuracies

Assess code quality, readability, and algorithmic efficiency

Ensure responses align with expected conversational and system guidelines

Apply consistent evaluation standards using defined benchmarks and frameworks





Qualifications

Must-Have:

BS, MS, or PhD in Computer Science or a related field

3+ years of hands‑on experience in software engineering or similar roles

Ability to solve medium to hard‑level coding problems independently

Experience with open‑source contributions (merged pull requests preferred)

Familiarity with LLMs in coding workflows and understanding of their limitations

High attention to detail with the ability to identify subtle bugs and logical issues

Nice-to-Have

Experience with RLHF, model evaluation, or data annotation xhfqzwm

Background in competitive programming

Experience reviewing production‑level code

Exposure to multiple programming paradigms or ecosystems

Ability to explain complex technical concepts clearly

Application & Onboarding Process

Upload resume

AI interview: A short, 15‑minute conversational session to understand background, experience, and interest in the role

Follow‑up communication within a few days with next steps and onboarding details

Hay opciones de teletrabajo/trabajo desde casa disponibles para este puesto.

📌 Senior Software Engineer Remote - $60 - $100 An Hour - Part Time - Remote (Madrid)
🏢 Remnote Global
📍 Madrid