04 ago
|
Allianz
|
Barcelona
Experteer Overview
¿Todo listo para enviar su solicitud? Asegúrese de comprender todas las responsabilidades y tareas asociadas a este puesto antes de continuar.
As a Data Engineer in the SimpliFi Data Pool program, you will own end-to-end data pipelines across ingestion, transformation, and loading within Azure-based, governance-driven environments. You’ll work with Databricks, Azure Synapse, and IDMC to deliver a harmonized data model and reliable data flows for financial reporting. You will ensure data quality, support governance gate processes, and collaborate with data modellers, MDM/RDM specialists, and IT leads to scale and maintain the platform. This role offers impact through shaping data architecture, improving lineage, and enabling trusted decision-making at scale.
Compensaciones / Ventajas
• Design and implement end-to-end data pipelines across Raw Data Vault, Business Data Vault, UJT, and CORE layers
• Hands-on development with Databricks, Azure Synapse, and IDMC to build and maintain ingestion, transformation, and loading flows
• Embed data quality checks and resolve issues early to prevent downstream propagation
• Review code from junior and mid-level engineers and share best practices
• Collaborate with Data Modellers, MDM/RDM specialists, and IT leads to translate constraints for planning
• Ensure pipelines comply with data governance requirements, including lineage,
classification, and access controls
• Support gate processes (DAB/CCP) with accurate technical evidence and documentation
• Participate in sprint planning and delivery cadence, estimate effort, and manage dependencies
Responsabilidades
• Extensive experience building and operating large-scale data pipelines (batch and streaming)
• Proficiency with Apache Spark, Databricks, and cloud-native equivalents
• Experience with enterprise ETL/ELT patterns and modern lakehouse/warehouse platforms (Databricks, Azure Synapse)
• Strong SQL, Python, and PySpark; experience with data quality scripting and monitoring (DQX, Great Expectations)
• Knowledge of xqbhyrx data modelling paradigms (Data Vault 2.0, Medallion, Kimball) and metadata capture/data lineage implementations (IDMC, Purview)
• Familiarity with SAP MDG or Informatica MDM is a plus; understanding of master/reference data flows
• CI/CD for data pipelines (GitHub Actions); infrastructure-as-code basics (Terraform)
• Ability to read architecture documents and engage with architects without hand-holding
• Nice to have: exposure to machine learning concepts
Requisitos principales
• hybrid work model
• up to 25 days abroad
• bonus scheme
• pension
• employee shares program
• learning and career development programs
📌 Senior Data Engineer (m/f/d) (Barcelona)
🏢 Allianz
📍 Barcelona