13 sep
|
Zurich Insurance Group
|
Barcelona
13 sep
Zurich Insurance Group
Barcelona
Experteer Overview
In this role you will own and evolve Zurich’s Databricks platform to support the Integral Finance Data Hub, ensuring scalable, secure, and cost-conscious data solutions. You will build and maintain ingestion and processing pipelines, govern data with Unity Catalog, and implement CI/CD and IaC practices in a collaborative, tech-driven environment. You’ll work with cross-functional teams to deliver a robust enterprise data platform that accelerates Zurich’s data strategy and operational efficiency. This is a chance to shape a world-class data foundation within a global insurer.
Compensaciones / Beneficios
• Own and evolve the Databricks platform underpinning the Global Finance Data Hub with focus on scalability, reliability, security, and cost efficiency
• Design, build, and maintain data ingestion frameworks for batch, streaming, API, and CDC across multiple sources
• Develop and manage Delta Live Tables pipelines with data quality, schema enforcement, and CDC
• Administer and optimize Delta Lake environments (performance, schema evolution, time travel, VACUUM, OPTIMIZE)
• Implement Unity Catalog governance (access controls, lineage, classification, namespaces)
• Build, deploy, and support Databricks Workflows for complex pipelines and event-driven processing
• Establish CI/CD pipelines using Git and Databricks Asset Bundles across dev/test/prod
• Collaborate with cloud/infrastructure teams on IaC using CloudFormation or CDK
• Manage authentication/authorization (IAM roles, profiles, service principals, secrets)
• Monitor platform health and costs with Databricks system tables, CloudWatch, Grafana
• Define cluster policies, compute strategies, and DBU governance for optimization
• Ensure security (PrivateLink, VPC endpoints, row/column security)
• Partner with data engineering, finance, architecture, and product teams to deliver scalable data platform
• Drive best practices, automation, and continuous improvement across the data ecosystem
Responsab
📌 Databricks Platform Engineer (Barcelona)
🏢 Zurich Insurance Group
📍 Barcelona