Описание

Zurich Insurance Group is a global insurance company. Its Technology Delivery Center in Barcelona provides technological solutions and support to local and global business units, covering software development, data analytics, cybersecurity, and IT infrastructure.
Задачи

Own and evolve the Databricks platform supporting the Zurich General Finance Data Hub, ensuring scalability, reliability, security, and cost efficiency;
Design, build, and maintain batch, streaming, API, and CDC data ingestion frameworks across multiple source systems;
Develop and manage Delta Live Tables pipelines with data quality controls, expectations, schema enforcement, and change data capture;
Administer and optimise Delta Lake environments, including performance tuning, schema evolution, time travel, VACUUM, and OPTIMIZE operations;
Implement and manage Unity Catalog governance practices, including access controls, data lineage, data classification, and namespace management;
Build, deploy, and support Databricks Workflows for complex multi-task pipeline orchestration,



dependency management, retries, and event-driven processing;
Establish and maintain CI/CD pipelines using Git-based development practices and Databricks Asset Bundles across development, testing, and production environments;
Collaborate with cloud and infrastructure teams to implement Infrastructure as Code solutions using AWS CloudFormation or CDK;
Manage authentication and authorisation mechanisms, including AWS IAM roles, instance profiles, service principals, secret management, and credential rotation;
Monitor platform health, performance, operational metrics, and costs using Databricks system tables, CloudWatch, Grafana, and related observability tools;
Define and enforce cluster policies, compute strategies, and DBU governance controls to optimise platform utilisation and expenditure;
Ensure platform security through PrivateLink, VPC endpoints, row-level security, and column-level security controls;
Partner with

📌 platform engineer for financial data platforms (Madrid)
🏢 Enfint
📍 Madrid