Overview
As a Principal AI Engineer, you own the end-to-end improvement loop for the Context Engine, shaping how agents, automations and skills behave in production. You define evaluation, telemetry, and safe deployment practices, ensuring customer impact and reliability. You collaborate with data scientists, engineers, product and UX to translate measurements into shipping decisions. Your work directly influences how customers build on Elastic's AI-enabled platform, in an open-code environment.
Compensaciones / Incentivos health coverage for you and family
flexible locations and schedules
generous vacation days
donation matching up to $2000
volunteering time (up to 40 hours/year)
parental leave (16 weeks)
Responsabilidades Own the production improvement loop for Context Engine, diagnosing failures from telemetry and user feedback and delivering fixes
Define safe iteration processes for agents, prompts, skills, and automations, including versioning, rollout, regression coverage, and guardrails
Design telemetry for data-informed engineering decisions, capturing agent traces,
tool calls and retrieval data and integrating with Elasticsearch for dashboards and feedback
Collaborate with data science on evaluation strategy (golden datasets, evaluators) to gate quality, latency and cost
Mentor engineers, review designs and PRs, and draft technical proposals to shape the roadmap
Requisitos principales 10+ years of software engineering experience with AI-driven production products
Experience diagnosing agent/LLM behavior from traces and user feedback; designing evaluations and shipping fixes
Hands-on experience building agents with state and memory; iterating prompts, skills, and tool behavior in production
Familiarity with MCP, including exposing public MCP servers and tools
Experience designing telemetry for AI systems and using it to influence engineering/product decisions
Experience running product experiments end-to-end (instrumentation, unattended execution, interpreti
📌 Principal AI Engineer (Palma)
🏢 Elastic
📍 Palma