Experteer Overview

Asegúrese de presentar su candidatura con toda la información solicitada, tal como se expone en la descripción del puesto a continuación.

In this role you design and evolve scalable scraping architectures to extract data from thousands of domains, turning raw sources into actionable insights for retailers and brands. You work with cross-functional teammates to push technical boundaries, diagnose blockers, and drive automation at scale. You leverage advanced anti-bot techniques and tooling to keep crawlers effective in dynamic environments.

Your contribution helps NIQ deliver high-quality data faster, shaping product capabilities and strategy.

Compensaciones / Beneficios

- Design and build distributed scraping architectures scalable across thousands of domains
- Reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, burp, and similar tools
- Detect anti-bot measures and build crawlers that mimic human behavior
- Lead technical innovation in scraping by identifying edge cases and prototyping new approaches




- Set up anomaly detection and monitoring to catch blockers or failures early

Responsabilidades

- 5+ years of Python experience with large-scale scraping projects
- Deep understanding of anti-bot technologies, fingerprinting, WAFs, JavaScript challenges, etc.
- Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers
- Proficiency in handling proxies (residential, datacenter, rotating), session management, cookie injection, xugodme TLS tweaking
- Strong debugging skills across browser, HTTP traffic, and device-level interactions
- Independent thinker with strong problem-solving abilities
- Familiarity with Parquet, Avro, or real-time stream processing
- Knowledge of databases like MongoDB, InfluxDB, and Redis and how to optimize them

Requisitos principales

- Versátil working environment
- Volunteer time off
- LinkedIn Learning
- Employee-Assistance-Program (EAP)

📌 Senior Software Engineer (Web Scraping, Data acquisition, Data collection) (Barcelona)
🏢 NielsenIQ
📍 Barcelona