Experteer Overview In this role you design and scale distributed scraping systems to deliver high-quality data for retailers and brands. You’ll work within a cross-functional Ru0026amp;D team to innovate, tackle edge cases, and maintain robust monitoring and anomaly detection. Your work directly impacts actionable insights and data availability at scale. The opportunity combines engineering, problem-solving, and a culture that values experimentation and ownership.
Compensaciones / Beneficios • Design and build scalable distributed scraping architectures across thousands of domains • Reverse engineer APIs and mobile apps using specialized tools • Detect and adapt to anti-bot measures to keep crawlers effective • Lead technical innovation in scraping and share knowledge with the team • Set up anomaly detection and monitoring to catch blockers early
Responsabilidades • 5+ years of Python experience with large-scale scraping projects • Deep understanding of anti-bot technologies and bypass techniques • Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browsers • Proficiency with proxies (residential, datacenter, rotating), session management, cookie injection, TLS tweaking • Strong debugging skills across browser, HTTP traffic, and device-level interactions • Familiarity with Parquet, Avro or real-time stream processing • Knowledge of databases like MongoDB, InfluxDB, and Redis and optimization know-how
Requisitos principales • Versátil working environment • Volunteer time off • LinkedIn Learning • Employee-Assistance-Program (EAP)
📌 Senior Software Engineer (Web Scraping, Data acquisition, Data collection) (Madrid)
🏢 NielsenIQ
📍 Madrid
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.