Experteer Overview
In this role you design and evolve scalable scraping architectures to extract data from thousands of domains, turning raw sources into actionable insights for retailers and brands. You work with cross-functional teammates to push technical boundaries, diagnose blockers, and drive automation at scale. You leverage advanced anti-bot techniques and tooling to keep crawlers effective in dynamic environments. Your contribution helps NIQ deliver high-quality data faster, shaping product capabilities and strategy.

Compensaciones / Ventajas
• Design and build distributed scraping architectures scalable across thousands of domains
• Reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, burp, and similar tools
• Detect anti-bot measures and build crawlers that mimic human behavior
• Lead technical innovation in scraping by identifying edge cases and prototyping new approaches
• Set up anomaly detection and monitoring to catch blockers or failures early

Responsabilidades




• 5+ years of Python experience with large-scale scraping projects
• Deep understanding of anti-bot technologies, fingerprinting, WAFs, JavaScript challenges, etc.
• Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers
• Proficiency in handling proxies (residential, datacenter, rotating), session management, cookie injection, TLS tweaking
• Strong debugging skills across browser, HTTP traffic, and device-level interactions
• Independent thinker with strong problem-solving abilities
• Familiarity with Parquet, Avro, or real-time stream processing
• Knowledge of databases like MongoDB, InfluxDB, and Redis and how to optimize them

Requisitos principales
• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)

📌 Senior Software Engineer (Web Scraping, Data acquisition, Data collection) (Barcelona)
🏢 NielsenIQ
📍 Barcelona