Overview In this Lead Data Engineer role, you will own end-to-end data pipelines across Bronze, Silver and Gold layers, enabling scalable data products for the Procurement domain. You will drive DevOps-centric deployment practices in Azure DevOps and GitHub, collaborating with modelers, stewards, and business partners to deliver production-grade solutions. You’ll work with dbt, Databricks, PySpark, and CI/CD automation to shape data architecture and governance at scale. This position offers leadership opportunities, cross-functional impact, and exposure to cutting-edge data engineering practices in a integral setting.

Compensaciones / Beneficiosgrowth opportunitiesglobal teamworkculture of collaborationlearning and developmentvoice and influence in shaping futureopportunity to impact millions ResponsabilidadesDesign and implement end-to-end data pipelines for ingestion, transformation, and storage across Bronze, Silver, and Gold layersDevelop and manage data ingestion processes from source systems via ETL and API-based methodsBuild modular transformation frameworks using dbt, PySpark, and SQL with staging models and load metadata in alignment with Data Vault 2.0Design, build, and maintain CI/CD and DevOps processes in Azure DevOps and GitHub Actions with automated testing and governanceImplement IaC and deployment automation for data platform resources (dbt, Databricks, clusters,



dependencies)Establish monitoring, observability, and operational excellence for pipeline reliability and rapid issue resolutionDrive data quality, governance, and compliance with automated testing, lineage, and FAIR data principlesProvide technical leadership and cross-functional collaboration across data engineers, modelers, stewards, BI developers, data scientists, and business SMEs Requisitos principalesStrong technical expertise in dbt, SQL, Python, Spark (PySpark), Databricks, Git, Azure DevOps, and GitHubProven experience designing and maintaining production-grade data pipelines (5+ years)Deep CI/CD and automation experience with Azure DevOps Pipelines and GitHub Actions; IaC knowledge (Terraform, Bicep) is a plusAdvanced Git and repository management; governance across Azure DevOps and GitHubCloud data engineering experience (Azure) with Databricks jobs, clusters, and workflowsExtensive knowledge of Data Vault 2.0 architecture (Raw Vault, Business Vault, Gold-layer models)Experience with data ingestion patterns (batch ETL, incremental, CDC, API-based ingestion)Strong focus on data governance and quality; exposure to scientific datasets is a plusLeadership mindset with ability to lead teams, manage projects, and collaborate across functions and geographiesleadershipcollaborationcuriositydbtSQLPython

📌 Lead Data Engineer (Cross Domain) (Barcelona)
🏢 Jobrapido
📍 Barcelona