Overview In this role you will design and scale distributed scraping architectures to process billions of data points for retailers and brands. You will reverse-engineer APIs and mobile apps, tackle anti-bot defenses, and push technical innovation in scraping. You’ll implement monitoring to catch blockers early and collaborate with cross-functional teams to deliver high-quality data at speed. This is a hands-on, problem-solving role at the intersection of engineering and data insights, with a strong impact on visibility and decision-making for customers.

Compensaciones / BeneficiosFlexible working environmentVolunteer time offLinkedIn LearningEmployee-Assistance-Program (EAP) ResponsabilidadesDesign and build scalable distributed scraping architectures for thousands of domainsReverse-engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, burp,



and similar toolsIdentify and circumvent anti-bot measures to create more human-like crawlersLead technical innovation in scraping by prototyping approaches and sharing knowledgeSet up anomaly detection and monitoring to detect blockers or failures early Requisitos principales5+ years of Python experience and large-scale scraping projectsDeep understanding of anti-bot technologies and bypass techniques (fingerprinting, WAFs, JavaScript challenges)Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless driversProficiency in handling proxies (residential/datacenter/rotating), session management, cookie injection, TLS tweakingStrong debugging across browser, HTTP traffic, and device-level interactionsIndependent problem solver who enjoys tackling unusual challengesFamiliarity with Parquet/Avro or real-time stream processingKnowledge of databases like MongoDB, InfluxDB, and Redis and optimization basicsIndependent thinkerProblem-solving orientationCollaborative mindsetFridamitmproxyCharles Proxy

📌 Senior Software Engineer (Web Scraping, Data acquisition, Data collection) - NielsenIQ (Barcelona)
🏢 Jobrapido
📍 Barcelona