12 ago
|
Allianz
|
Barcelona
Experteer Overview ¿Todo listo para enviar su solicitud? Asegúrese de comprender todas las responsabilidades y tareas asociadas a este puesto antes de continuar. As a Data Engineer in the SimpliFi Data Pool program, you will own end-to-end data pipelines across ingestion, transformation, and loading within Azure-based, governance-driven environments. You’ll work with Databricks, Azure Synapse, and IDMC to deliver a harmonized data model and reliable data flows for financial reporting. You will ensure data quality, support governance gate processes, and collaborate with data modellers, MDM/RDM specialists, and IT leads to scale and maintain the platform. This role offers impact through shaping data architecture, improving lineage, and enabling trusted decision-making at scale.Compensaciones / Ventajas• Design and implement end-to-end data pipelines across Raw Data Vault, Business Data Vault, UJT, and CORE layers• Hands-on development with Databricks, Azure Synapse, and IDMC to build and maintain ingestion, transformation, and loading flows• Embed data quality checks and resolve issues early to prevent downstream propagation• Review code from junior and mid-level engineers and share best practices• Collaborate with Data Modellers, MDM/RDM specialists, and IT leads to translate constraints for planning• Ensure pipelines comply with data governance requirements, including lineage,
classification, and access controls• Support gate processes (DAB/CCP) with accurate technical evidence and documentation• Participate in sprint planning and delivery cadence, estimate effort, and manage dependenciesResponsabilidades• Extensive experience building and operating large-scale data pipelines (batch and streaming)• Proficiency with Apache Spark, Databricks, and cloud-native equivalents• Experience with enterprise ETL/ELT patterns and modern lakehouse/warehouse platforms (Databricks, Azure Synapse)• Strong SQL, Python, and PySpark; experience with data quality scripting and monitoring (DQX, Great Expectations)• Knowledge of xqbhyrx data modelling paradigms (Data Vault 2.0, Medallion, Kimball) and metadata capture/data lineage implementations (IDMC, Purview)• Familiarity with SAP MDG or Informatica MDM is a plus; understanding of master/reference data flows• CI/CD for data pipelines (GitHub Actions); infrastructure-as-code basics (Terraform)• Ability to read architecture documents and engage with architects without hand-holding• Nice to have: exposure to machine learning conceptsRequisitos principales• hybrid work model• up to 25 days abroad• bonus scheme• pension• employee shares program• learning and career development programs
📌 Senior Data Engineer (m/f/d) (Barcelona)
🏢 Allianz
📍 Barcelona