Overview As Senior Python Developer in our scraping team, you will optimize data collection by building robust Scrapy spiders and ensuring resilient crawlers against website changes. You will uphold code and data quality through reviews and validation, and design sophisticated crawling solutions that navigate anti-bot measures. You’ll contribute to major builds across codebases, documenting clearly and sharing knowledge with relevant teams. This role sits in a fast-growing, start-up–spirited NIQ for Digital Commerce, focused on real-time retail insights.

Compensaciones / Incentivos

Flexible working environment Volunteer time off LinkedIn Learning Employee-Assistance-Program (EAP)

Responsabilidades

Design, implement and document robust Scrapy spiders Perform code reviews and data validation to ensure quality Develop web crawling solutions that bypass advanced anti-bot measures Architect new features across multiple codebases with clear documentation Provide training and knowledge sharing to relevant teams





Requisitos principales

Master's degree in Computer Science, IT, or related field At least 3 years of professional software engineering experience Knowledge of BeautifulSoup or Scrapy Familiarity with HTML and JavaScript, understanding of single-page applications Experience with RESTful and/or GraphQL APIs Hands-on experience with Django, FastAPI, or similar Python web frameworks Knowledge of Scrapy is a plus Experience with time series databases (InfluxDB) is advantageous Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting Experience with AWS, GCP, or Azure Enthusiastic, motivated, autonomous; enjoys tackling challenging software problems Passionate about tech and continuous learning enthusiastic autonomous mentally-stimulating problem solving BeautifulSoup Scrapy HTML/JavaScript for SPAs

📌 Senior Web Scraper | BeautifulSoup or Scrapy (Barcelona)
🏢 NielsenIQ
📍 Barcelona