About OrbioOrbio is an AI-native human capital management platform building aDigital Workforce for HR .We design and deploy agentic systems that take ownership of operational execution across hiring, onboarding, and employee operations — while keeping humans in control.We work with large, complex organizations across staffing, retail, hospitality, and healthcare. Our customers rely on Orbio to reduce operational friction, improve speed and quality, and scale their teams without proportional headcount growth.Orbio is not a system of record. We sit on top of existing HR systems and own theexecution and coordination layer— where day-to-day work actually happens.Position OverviewOrbio is looking for anAI Agent Engineerto build, operate, and continuously improve the reliability of our agentic AI systems in production.In this role, you will focus on how agentsbehave, decide, fail, recover, and scalein real enterprise environments. Your work will ensure that LLM-powered agents are observable, testable, cost-efficient, and trustworthy when handling real operational workflows.You will help build an end-to-end, production-grade B2B platform with a strong focus on LLMs, autonomous agents, and conversational AI, contributing to the technical foundations that scale across customers and use cases.All the desired Technical Skills we are looking forAgent Testing & EvaluationBuilding agent evaluation pipelines (consistency, accuracy, reliability)Designing test harnesses for non-deterministic systemsRegression testing for prompt and model changesSynthetic data generation for agent testingPerformance benchmarking and latency profilingAgent Monitoring & Operations at ScaleObservability for agent systems (tracing, logging,



metrics)Cost tracking and optimization across model callsAlerting on agent failures, hallucinations, and degraded performanceDebugging complex multi-step agent behaviors in productionGuardrails, safety layers, and graceful degradation strategiesLLM ExpertisePrompt engineering, chaining, and caching strategiesRAG pipelines and vector databasesModel selection, fine-tuning, and cost optimizationUnderstanding of evaluation metrics and benchmarksPython & BackendAsync programming, Django/Channels, real-time ASGIProduction-grade application developmentMessage queues (Celery + Redis) and high-throughput systemsTesting, logging, and performance optimizationConversational AIVoice pipelines: STT, TTS, turn-taking, interruption handlingTelephony integration (Twilio) with latency optimizationConversation flow design and fallback strategiesFull-Stack & DevOpsFrontend experience (React preferred)CI/CD pipelines and cloud deployment (AWS/GCP)Deploying and operating AI systems in productionWhat Success Looks Like at OrbioAgents behave consistently and predictably across customers and workflowsFailures, edge cases, and degraded behavior are detectable and recoverableAgent performance, latency, and cost are measurable and actively optimizedNew agent capabilities ship safely without breaking existing behaviorCustomer trust in autonomous workflows increases over timeCulture at OrbioOrbio is a high-bar, high-intensity environment. We optimize for impact, speed, and ownership — not comfort.We operate as one team, with a flat structure and extreme ownership. We ship fast, learn from production, and challenge each other directly because we care about building systems that hold up under real-world complexity. Titles matter less than outcomes. Customers come first. Momentum matters.#J-18808-Ljbffr

📌 Ai Agent Engineer (Python) / Full-Stack Experience (Madrid)
🏢 Orbio
📍 Madrid