Senior Web Scraper (Scrapy) (Madrid)

Senior Web Scraper (Scrapy) (Madrid)

21 nov
|
NielsenIQ
|
Madrid

21 nov

NielsenIQ

Madrid

Job Description

You'll join a team of 60+ scrapers, engineers, analysts, and data lovers from across the globe. As part of our scraping and R&D; team, you’ll have space to experiment, push boundaries, and bring bold ideas to life. You’ll collaborate closely with Customer Success, Operations, and Data to ensure we extract high-quality, actionable data — fast and at scale.

This isn’t just a coding job. You’ll need to think like a hacker, move like an engineer, and act like an inventor

Job Description

- Design and build distributed scraping architectures that can scale across thousands of domains.

- Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and many more.

- Detect common anti-bot measures (like JavaScript checks or browser behavior detection) to build crawlers that adjust to appear more human-like.

- Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share knowledge with the team.

- Set up anomaly detection and monitoring to detect blockers or failures early

Qualifications

- 5+ years of experience with Python and large-scale scraping projects.

- Deep understanding of anti-bot technologies and how to bypass them, fingerprinting, WAFs, JavaScript challenges, etc.

- Experience working with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers.

- Skilled at handling proxies (residential, datacenter,



rotating), session management, cookie injection, and TLS tweaking.

- Strong debugging skills across browser, HTTP traffic, and device-level interactions.

- You think independently and enjoy solving problems no one has solved before.

- Familiarity with structured storage formats (Parquet, Avro), or real-time stream processing.

- Good knowledge of databases like MongoDB, InfluxDB, and Redis, including how they work and how to optimize them.

➕ Bonus Skills

- Experience with real-device simulation for mobile scraping.

- Comfortable building and maintaining distributed task queues (Celery, Kafka, etc.).

- Experience scraping high-security platforms or mobile-first environments.

- Exposure to Linux or cloud environments (AWS, GCP, etc.).

- Basic understanding of Kubernetes, Cloud Run, and Cloud Functions to deploy and orchestrate scraping workloads.

Why Join NIQ Digital shelf

- You'll have ownership and freedom to experiment, backed by a team that thrives on innovation.

- You'll work with people who are truly passionate about data and know how to use it well.

- Your ideas will shape our strategy, tools, and success — you won’t just follow the Playbook; you’ll write about it.

- Friendly and transparent work culture, competitive salary, versátil hours, and the chance to grow fast in a high-impact role.

📌 Senior Web Scraper (Scrapy) (Madrid)
🏢 NielsenIQ
📍 Madrid

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: senior web scraper (scrapy) (madrid) / madrid

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: senior web scraper (scrapy) (madrid) / madrid