Experteer Overview

Asegúrese de presentar su candidatura con toda la información solicitada, tal como se expone en la descripción del puesto a continuación.
In this role you design and evolve scalable scraping architectures to extract data from thousands of domains, turning raw sources into actionable insights for retailers and brands. You work with cross-functional teammates to push technical boundaries, diagnose blockers, and drive automation at scale. You leverage advanced anti-bot techniques and tooling to keep crawlers effective in dynamic environments. Your contribution helps NIQ deliver high-quality data faster, shaping product capabilities and strategy.

Compensaciones / Ventajas
• Design and build distributed scraping architectures scalable across thousands of domains
• Reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, burp, and similar tools
• Detect anti-bot measures and build crawlers that mimic human behavior
• Lead technical innovation in scraping by identifying edge cases and prototyping new approaches




• Set up anomaly detection and monitoring to catch blockers or failures early

Responsabilidades
• 5+ years of Python experience with large-scale scraping projects
• Deep understanding of anti-bot technologies, fingerprinting, WAFs, JavaScript challenges, etc.
• Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers
• Proficiency in handling proxies (residential, datacenter, rotating), session management, cookie injection, xqbhyrx TLS tweaking
• Strong debugging skills across browser, HTTP traffic, and device-level interactions
• Independent thinker with strong problem-solving abilities
• Familiarity with Parquet, Avro, or real-time stream processing
• Knowledge of databases like MongoDB, InfluxDB, and Redis and how to optimize them

Requisitos principales
• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)

📌 Senior Software Engineer (Web Scraping, Data acquisition, Data collection) (Barcelona)
🏢 NielsenIQ
📍 Barcelona