Descripción del trabajo
Key Responsibilities Specification-Driven Extraction Engineering
- Design and maintain declarative extraction specifications—using Pydantic models, JSON schemas, or domain-specific languages—that describe exactly which fields to capture, their types, and validation rules.
- Implement pipelines that translate these specifications into executable extraction plans, leveraging both classical (Scrapy, Playwright) and AI-augmented (LLM-based semantic parsing) backends.
- Build reusable specification libraries for recurring data types (product prices, tariff codes, regulatory texts) to accelerate onboarding of new sources.
- Design and implement autonomous data extraction agents that can make decisions about source selection, retry logic, and parsing strategies

Autonomous & Self-Healing Systems
- Deploy self-healing spiders that automatically detect website layout changes and repair themselves using Model Context Protocol (MCP) servers (e.g., Scrapy MCP Server, Playwright MCP).
- Integrate semantic extraction (Scrapy-LLM, custom LLM pipelines)



to eliminate selector brittleness—spiders rely on field descriptions, not fragile XPaths.
- Hands-on experience building AI agents and orchestration systems.
- Orchestrate complex, multi-step browsing workflows with agentic frameworks (BMAD/TEA, AutoGPT-like agents) that reason about page state, adapt to anti-bot measures, and correct their own behaviour in real time.

Platform Thinking & Reusability
- Move beyond one-off scrapers: build a component-based extraction platform where selectors, login handlers, and pagination logic are shared, versioned, and tested.
- Implement monitoring, alerting, and automatic rollback for failed extraction runs.
- Champion ethical crawling by design—rate limiting, robots.txt respect, and compliance with GDPR/CCPA are built into the specification layer, not retrofitted.

Collaboration & Continuous Innovation
- Partner with data scientists and domain experts to refine extractio

📌 Ai Data Engineer (Barcelona)
🏢 PST.AG
📍 Barcelona