Software Engineer (LLMOps) (Manises)

Software Engineer (LLMOps) (Manises)

18 nov
|
Maisa AI
|
Manises

18 nov

Maisa AI

Manises

What you will do

- Build and optimise LLM serving infrastructure using technologies such as vLLM, SGLang, or equivalent inference engines.

- Manage GPU infrastructure, including orchestration, scaling, load balancing, capacity planning, and high availability.

- Optimise inference performance and costs through batching, quantisation, caching, and GPU utilisation improvements.

- Build monitoring and observability for model serving, covering infrastructure health, latency, errors, and model output degradation.

- Support enterprise deployments into on-premise, private, and air-gapped environments, ensuring security and reliability.

- Develop model governance infrastructure, including model registries, versioning, LLM gateways, logging, and auditing.

- Build and maintain CI/CD pipelines and infrastructure-as-code for automated, reliable model deployments.

- Troubleshoot production issues and collaborate with Applied AI, Foundational AI, and SRE/Platform teams.

What We're Looking For

- Strong background in Infrastructure Engineering, Platform Engineering, MLOps, or LLMOps, with experience running ML/LLM workloads in production.

- Hands-on experience with LLM serving technologies such as vLLM, SGLang, or similar.

- Practical knowledge of GPU infrastructure, orchestration, scaling, and inference optimisation.

- Strong production experience with Kubernetes, Docker, Terraform,



and CI/CD.

- Proficiency in Python and/or Go.

- Experience with monitoring, observability, and troubleshooting production systems.

- Understanding of inference cost, latency, throughput, and performance trade-offs.

- Strong ownership mindset and ability to collaborate across engineering teams.

Nice to Have

- Experience with on-premise, air-gapped, or regulated enterprise environments.

- Familiarity with LiteLLM, Langfuse, Prometheus, Grafana, or similar tools.

- Experience with model registries, prompt versioning, and LLM governance.

- Knowledge of distributed inference and advanced GPU optimisation.

Why Join Maisa?

- Work on cutting-edge enterprise AI with real-world applications and major enterprise customers.

- Solve challenging engineering problems involving GPU infrastructure, inference performance, and secure deployments.

- Take ownership and make an impact on the architecture, reliability, and cost-efficiency of our AI platform.

- Collaborate with talented AI and engineering teams in a fast-growing, ambitious company.

- Remote when you want flexibility. Together when you want connection. And a culture you can help shape from day one.

Join us in building the infrastructure that makes enterprise AI reliable, scalable, and accessible.

📌 Software Engineer (LLMOps) (Manises)
🏢 Maisa AI
📍 Manises

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: software engineer (llmops) (manises) / manises

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: software engineer (llmops) (manises) / manises