Data Engineer en StyleSage - RD87

Data Engineer en StyleSage - RD87

01 ago
|
jobFluent
|
Madrid

01 ago

jobFluent

Madrid

YOUR JOB



As an engineer in the Data Engineering team, you will be responsible for ensuring that our data is always good quality, fresh and available by:



- Developing processes and services for our data pipeline.



- Maintain and enhance current processes.



- Develop QA tools.





YOUR SKILLS



In order to maintain and create new pieces of the data pipeline, you will need to bring your skills and knowledge around these technologies:



- Python, as it is the base of our tech stack at many levels.



- Django or Flask, because many of the processes and services leverage these frameworks.



- SQL, PostgreSQL, we work with data, you know.



- Linuxshell command line,

don't need to be a sysadmin but we expect you to be able to navigate yourself in your local machine and in a server box.





BONUS POINTS



You will learn on many of the other tech pieces we use. Of course it will be easier if you are already familiar with any them:



- Celery, RabbitMQ



- Docker



- AWS



- Serverless Lambdas



- MongoDb



- Spark





THE TEAM



Data Engineering team is responsible for collecting massive amounts of data from fashion related websites and placing it into our analytics data repository. There is a whole data pipeline that starts with hundreds of spiders (python/scrapyd) that continuously crawl websites, continues with a series of data quality and data enrichment processes (python, celery, rabbitMQ, SQL...) and ends dumping clean, validated and normalized product information for our customers to analyze. As an example, the pipeline includes data enriching with machine learned models and massively parallel processing using Spark. The pipeline consists of many pieces that need to be monitored, scaled up and down, maintained, deployed, enhanced and adapted to new business needs continuously. The database already contains more than 500 millions of products (refreshed daily) and we see 1-2M of new products every week.





THE COMPANY



Our motto is "We love data". And we love technology that deals with data because it enables us to do incredible things... things that are valuable for our customers and that sustain a business.





StyleSage is (no longer) a startup founded 5 years ago with offices in New York and Madrid. Madrid is the home for our core technical team of around 20 people. It's an open, diverse and inclusive team of very skilled and talented individuals that are happy to collaborate, share knowledge and enjoy building great software together. We are looking forward to welcoming additional members for this team.





WHAT WE OFFER





- First and foremost: permanent contract and competitive salary.



- Teams are made of people, not resources.



- Open, diverse and inclusive environment.



- A challenging and fun project to work and grow with, with the latest technologies, best practices and light speed evolution, all in a friendly, relaxed and positive environment.



- Fixed yearly training budget to spend on english classes, courses, books, or conferences your brand new laptop with OS of your choice (we recommend MacOSX or any flavor of Linux).



- A team of colleagues that will share a lot of knowledge with you (we have weekly in-depth internal talks).



- A place to work in the center of Madrid (we have an Office in a co-working space quite close to Avenida de América metro station).



- Working hours are flexible and you can work remotely when needed, although you will miss the fruit and coffee/tea we stock in the Office.

El anuncio original lo puedes encontrar en Kit Empleo:
https://www.kitempleo.es/empleo/13825686/data-engineer-stylesage-rd87-madrid/?utm_source=html

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:
Escribe tu dirección de correo electrónico, te permitirá de estar al tanto de los últimos empleos por: data engineer en stylesage - rd87
Publica un nuevo anuncio gratuito
Necesitas publicar un anuncio? Con más de 1 millón de usuarios únicos al mes en corto encontrarás el candidato ideal para tu empresa, ¿qué estás esperando!
Publica ahora

Suscribete a esta alerta