09 ago
|
Allianz
|
Barcelona
Experteer Overview As a Data Engineer in the SimpliFi Data Pool program, you will own end-to-end data pipelines across ingestion, transformation, and loading within Azure-based, governance-driven environments. You’ll work with Databricks, Azure Synapse, and IDMC to deliver a harmonized data model and reliable data flows for financial reporting. You will ensure data quality, support governance gate processes, and collaborate with data modellers, MDM/RDM specialists, and IT leads to scale and maintain the platform. This role offers impact through shaping data architecture, improving lineage, and enabling trusted decision-making at scale.Compensaciones / Incentivos
- Design and implement end-to-end data pipelines across Raw Data Vault, Business Data Vault, UJT, and CORE layers
- Hands-on development with Databricks, Azure Synapse, and IDMC to build and maintain ingestion, transformation, and loading flows
- Embed data quality checks and resolve issues early to prevent downstream propagation
- Review code from junior and mid-level engineers and share best practices
- Collaborate with Data Modellers, MDM/RDM specialists, and IT leads to translate constraints for planning
- Ensure pipelines comply with data governance requirements, including lineage, classification, and access controls
- Support gate processes (DAB/CCP)
with accurate technical evidence and documentation
- Participate in sprint planning and delivery cadence, estimate effort, and manage dependenciesResponsabilidades
- Extensive experience building and operating large-scale data pipelines (batch and streaming)
- Proficiency with Apache Spark, Databricks, and cloud-native equivalents
- Experience with enterprise ETL/ELT patterns and modern lakehouse/warehouse platforms (Databricks, Azure Synapse)
- Strong SQL, Python, and PySpark; experience with data quality scripting and monitoring (DQX, Great Expectations)
- Knowledge of data modelling paradigms (Data Vault 2.0, Medallion, Kimball) and metadata capture/data lineage implementations (IDMC, Purview)
- Familiarity with SAP MDG or Informatica MDM is a plus; understanding of master/reference data flows
- CI/CD for data pipelines (GitHub Actions); infrastructure-as-code basics (Terraform)
- Ability to read architecture documents and engage with architects without hand-holding
- Nice to have: exposure to machine learning conceptsRequisitos principales
- hybrid work model
- up to 25 days abroad
- bonus scheme
- pension
- employee shares program
- learning and career development programs
📌 Senior Data Engineer (M/F/D) (Barcelona)
🏢 Allianz
📍 Barcelona