07 sep
|
FirstIgnite
|
O Chazo
07 sep
FirstIgnite
O Chazo
About FirstIgnite
FirstIgnite makes software for university tech transfer offices. Those are the people who take research
coming out of a university lab and get it patented, licensed, or spun out into a company.
The role
Were hiring a Senior AI Agent Engineer. Youll build the agents in our product, and youll build the
evals that tell us whether each change made them better or worse.
The work is document-heavy rather than chat. The agents run multi-step, call tools, read long and
inconsistently formatted source material, check it against existing records, and produce output that a
person reviews before anything happens with it.
Accuracy matters more here than speed or novelty. Most of the engineering effort goes into precision,
traceability, and getting the agent to hand off to a human at the right moment.
Youll report to the Head of Engineering and work with product and the full-stack team. If youve
shipped agents before, youve probably had the experience of changing a prompt and having no idea
whether you improved anything. That problem is most of this job.
What youll do
- Design and ship long-running, multi-step, tool-using agents on various AI SDKs and tooling, included but not limited to the OpenAI Agents SDK, the Anthropic Agent SDK, the Vercel AI SDK, LangGraph, MCP, and Temporal Cloud.
- Wrap our APIs and our partners APIs as tools an agent can call over MCP. Some of those systems are old, single-tenant, and outside our control, so a fair amount of the work is translation.
- Get structured data out of long documents and match it against records that already exist. Expect entity resolution and fuzzy matching, and expect much of it to run in batch.
- Stand up eval suites using various evaluation frameworks and tooling, included but not limited to Promptfoo, Braintrust, LangSmith, DeepEval, LLM-as-judge methods, and custom harnesses. Measure tool-use correctness, trajectory quality, and whether the agent finished the task.
- Every agent here produces a draft tha
📌 Senior AI Agent Engineer (O Chazo)
🏢 FirstIgnite
📍 O Chazo