08 nov
|
Capitole
|
Madrid
Responsibilities:Raise important questions during business maturation in order to detect risks before development stage.DescripciónCapitole is growing fast, and we want you to be part of the journey!We are looking for aSenior Data Engineerwith+6 years of experienceto help drive the evolution of ourAzure-based Data PlatformandLakehouse architecture .This role is focused on Data Products development. The successful candidate will build pipelines in ADF, DAGs in Airflow and work closely with POs to refine business requirements and transform business needs into reliable Data Products in Databricks.Responsibilities:Hands-on Data Product developmentImplement scalable, reliable and reusable data pipelines using Azure Data Factory and Apache Airflow.Develop data transformations in Azure Databricks (PySpark / SQL) to create/extend data products following the Medallion Architecture layers:Bronze (raw ingestion)Silver (cleansed & conformed)Gold (business-ready data products)Optimize performance, cost,
and reliability of data workloads.Raise important questions during business maturation in order to detect risks before development stage.Technical LeadershipParticipate in architecture reviews and technical decision-making.Promote engineering excellence through code reviews and design reviews.Collaborate with Architects, Product Owners in data product technical maturation.Support & Operations (Run Team Collaboration)Provide support to the Run/Operations team for production pipelines and data products for complex topics.Troubleshoot and resolve data incidents, failures, and performance issuesParticipate in incident management, root cause analysis, and post-mortems.Ensure proper handover, documentation, and operational readiness of developed solutions.Contribute to improving runbooks, monitoring, and operational processes.Requirements:Technical Skills6+ years of experience in data engineeringStrong technical expertise with:Python (PySpark)SQL (advanced level)Hands-on experience with Azure-based Data Platform including:DatabricksUnity CatalogApache AirflowAzure Data FactoryReporting and BI tools (Power BI, Tableau or similar)Solid understanding of data modelling fundamentals, main architectures and design patternsData Warehouse, Data Lake and Data Lakehouse#J-18808-Ljbffr
📌 Hibrido Bcn - Senior Data Engineer (Madrid)
🏢 Capitole
📍 Madrid