AI Technical Consultant, LLM Safety Evaluation, Digital Impact Division, Digital Guardrails, Home-based, Valencia, Spain, 6 Months and 20 days #596213Job no: 596213Contract type: ConsultantDuty Station: ValenciaLevel: ConsultancyLocation: SpainCategories: Information Communication TechnologyUNICEF works in over 190 countries and territories to save children’s lives, defend their rights, and help them fulfill their potential, from early childhood through adolescence.At UNICEF, we are committed, passionate, and proud of what we do for as long as we are needed. Promoting the rights of every child is not just a job – it is a calling.UNICEF is a place where careers are built. We offer our staff diverse opportunities for professional and personal development that will help them reinforce a sense of purpose while serving children and communities across the world. We welcome everyone who wants to belong and grow in a diverse and passionate culture., coupled with an attractive compensation and benefits package.Visit our website to learn more about what we do at UNICEF.For every child,



the right to FutureHow can you make a difference?Prepare, clean and structure the agreed test prompt set.Conduct extensive testing of agreed prompts across multiple LLM providers and configurations, and curate the most informative model responses for expert review.Run evaluations under different approved safety/content-filter configurations and document how these settings affect model behaviour.Capture model responses and relevant test metadata.Troubleshoot API, model, safety-filter or platform issues.Develop and maintain code to call commercial LLM APIs and, where required, deploy and interact with open-source models for evaluation.Conduct targeted reviews of state-of-the-art child-safety and AI-safety research to identify relevant prompts, failure modes and emerging risks.Organise outputs into a simple format for expert review.Support simple rating, ranking and reviewer comments.Capture revie

📌 Ai Technical Consultant, Llm Safety Evaluation, Digital Impact Division, Digital Guardrails, Home-Ba (Madrid)
🏢 UNICEF - United Nations Children’s Fund
📍 Madrid