Описание

Social Discovery Group is a group of social discovery companies that addresses loneliness, isolation, and disconnection by transforming virtual intimacy into the new normal. Its products are social entertainment platforms designed to connect people online across different cultures and regions.

Задачи
- Speed up and scale LLM inference in production using SGLang, KV and prefix caching, batching, quantization, and speculative decoding
- Run distributed inference for very large models with up to 1T+ parameters across multi-GPU and multi-node setups
- Benchmark new GPU servers and hardware, bring them into production, and adapt serving code to them
- Lead the NLP and CV teams technically by reviewing experiments, setting direction, and stepping in early when needed
- Train and fine-tune language models, and improve the agent harnesses and chat algorithm that run on them
- Track cutting-edge research and open-source work in inference and post-training, and turn it into the ML roadmap
- Collaborate with validation, content,



and dataset preparation teams to design experiments and measure model quality

Требования
- Deep hands-on experience optimizing LLM inference in production with SGLang, vLLM, or TensorRT-LLM
- Experience with distributed inference or training of large models, including MoE, tensor/expert/pipeline parallelism, and multi-node GPU clusters
- Strong understanding of inference performance, including KV cache, attention kernels, batching, quantization, and GPU profiling
- Experience training and fine-tuning LLMs, including post-training such as RLHF or DPO
- Proven technical leadership, including guiding engineers through reviews, mentoring, and technical decisions while continuing to write code
- Proficiency with PyTorch, transformers, and related libraries
- Advanced English or Russian
- Будет плюсом: experience at AI-focused startups or companies such as Character AI or OpenAI, backend engineering experience with Python, Go, or C#, knowledge of

📌 ml engineer for LLM inference (España)
🏢 HireHi
📍 España