We are looking for a Senior Data Engineer with +6 years of experience to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture . This role is focused on Data Products development. The successful candidate will build pipelines in ADF, DAGs in Airflow and work closely with POs to refine business requirements and transform business needs into reliable Data Products in Databricks.
Responsibilities:
Implement scalable, reliable and reusable data pipelines using Azure Data Factory and Apache Airflow.
Develop data transformations in Azure Databricks (PySpark / SQL) to create/extend data products following the Medallion Architecture layers:Bronze (raw ingestion)Silver (cleansed & conformed)Gold (business-ready data products)Optimize performance, cost, and reliability of data workloads.
Raise important questions during business maturation in order to detect risks before development stage.
Collaborate with Architects, Product Owners in data product technical maturation.
Support & Operations (Run Team Collaboration)Provide support to the Run/Operations team for production pipelines and data products for complex topics.
Troubleshoot and resolve data incidents, failures, and performance issues.
Participate in incident management, root cause analysis, and post-mortems.
Contribute to improving runbooks, monitoring, and operational processes.
Requirements:
Technical Skills6+ years of experience in data engineering.
Python (PySpark)SQL (advanced level)Hands-on experience with Azure-based Data Platform including:DatabricksUnity CatalogApache AirflowAzure Data FactoryReporting and BI tools (Power BI, Tableau or similar)Solid understanding of data modelling fundamentals, main architectures and design patterns:Data Warehouse, Data Lake and Data Lakehouse architecturesMedallion architectureMetadata-driven architectureETL/ELT design patternsUnderstanding of:Designed reusable ETL frameworks.
Led an Airflow implementation or migration.
Implemented observability and data quality platforms.
Acted as a lead engineer or senior individual contributor in a modern Lakehouse environment.
Why you'll love working with us€1,200/year for your professional development (trainings, events, certifications...)Monthly feedback sessions with your team to keep learning and growingPrivate health insurance fully covered by CapitolePayflow benefits (meal, transport, childcare vouchers)Wellhub subscriptionDiscounts with top brands through Capitole ClubLife at CapitoleTeam buildings every two months (our summer party and Christmas dinner are legendary)capitole-consulting.
Glassdoor ReviewsThe employee will adhere to information security policies:Will have access to confidential information related to Capitole and the project they are working on.
Must comply with the security and internal policies of both the company and the client.
📌 Hibrido Bcn (Barcelona)
🏢 Capitole Consulting
📍 Barcelona
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.