Overview

As a Principal AI Engineer, you own the end-to-end improvement loop for the Context Engine, shaping how agents, automations and skills behave in production. You define evaluation, telemetry, and safe deployment practices, ensuring customer impact and reliability. You collaborate with data scientists, engineers, product and UX to translate measurements into shipping decisions. Your work directly influences how customers build on Elastic’s AI-enabled platform, in an open-code environment.

Compensaciones / Incentivos
- health coverage for you and family
- flexible locations and schedules
- generous vacation days
- donation matching up to $2000
- volunteering time (up to 40 hours/year)
- parental leave (16 weeks)

Responsabilidades
- Own the production improvement loop for Context Engine, diagnosing failures from telemetry and user feedback and delivering fixes
- Define safe iteration processes for agents, prompts, skills, and automations, including versioning, rollout, regression coverage, and guardrails
- Design telemetry for data-informed engineering decisions,



capturing agent traces, tool calls and retrieval data and integrating with Elasticsearch for dashboards and feedback
- Collaborate with data science on evaluation strategy (golden datasets, evaluators) to gate quality, latency and cost
- Mentor engineers, review designs and PRs, and draft technical proposals to shape the roadmap

Requisitos principales
- 10+ years of software engineering experience with AI-driven production products
- Experience diagnosing agent/LLM behavior from traces and user feedback; designing evaluations and shipping fixes
- Hands-on experience building agents with state and memory; iterating prompts, skills, and tool behavior in production
- Familiarity with MCP, including exposing public MCP servers and tools
- Experience designing telemetry for AI systems and using it to influence engineering/product decisions
- Experience running product experiments end-to-end (instrumenta

📌 Principal AI Engineer (País Vasco)
🏢 Elastic
📍 País Vasco