Runpod, the AI Developer Cloud, is seeking an ML Systems Engineer focused on inference.
Las cualificaciones, habilidades y toda la experiencia relevante necesaria para este puesto se pueden encontrar en la descripción completa a continuación.
You will own end-to-end LLM serving performance, measure throughput and latency, and drive optimizations across models and hardware generations.
This is a hands-on role dedicated to reducing cost per token and improving reliability in production.
You’ll work with vLLM and SGLang, optimize for API-level xghoner latency, and collaborate with product and infra teams to craft scalable, production-grade runtimes and
#J-18808-Ljbffr
📌 Lead ml inference systems engineer (España)
🏢 Runpod
📍 España