Experteer Overview
In this role you design and scale distributed scraping systems to deliver high-quality data for retailers and brands. You’ll work within a cross-functional Ru0026amp;D team to innovate, tackle edge cases, and maintain robust monitoring and anomaly detection. Your work directly impacts actionable insights and data availability at scale. The opportunity combines engineering, problem-solving, and a culture that values experimentation and ownership.

Compensaciones / Beneficios
• Design and build scalable distributed scraping architectures across thousands of domains
• Reverse engineer APIs and mobile apps using specialized tools
• Detect and adapt to anti-bot measures to keep crawlers effective
• Lead technical innovation in scraping and share knowledge with the team
• Set up anomaly detection and monitoring to catch blockers early

Responsabilidades




• 5+ years of Python experience with large-scale scraping projects
• Deep understanding of anti-bot technologies and bypass techniques
• Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browsers
• Proficiency with proxies (residential, datacenter, rotating), session management, cookie injection, TLS tweaking
• Strong debugging skills across browser, HTTP traffic, and device-level interactions
• Familiarity with Parquet, Avro or real-time stream processing
• Knowledge of databases like MongoDB, InfluxDB, and Redis and optimization know-how

Requisitos principales
• Versátil working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)

📌 Senior Software Engineer (Web Scraping, Data acquisition, Data collection) (Madrid)
🏢 NielsenIQ
📍 Madrid