05 sep
|
Barcelona Supercomputing Center
|
Madrid
05 sep
Barcelona Supercomputing Center
Madrid
Barcelona Supercomputing Center in Barcelona is seeking a Senior Pre-training Engineer (RE3) to lead multilingual pre-training pipelines on multi-node HPC infrastructure. You will drive distributed training strategies and prototype novel architectures for large language models. The role requires deep expertise in Megatron-LM, DeepSpeed, PyTorch FSDP or NeMo, and strong Python and English language skills. You will work in a cutting-edge HPC environment with access to MareNostrum, Leonardo, and
#J-18808-Ljbffr
📌 Lead Distributed Pre-Training Engineer for Multilingual LLMs (Madrid)
🏢 Barcelona Supercomputing Center
📍 Madrid