15 oct
|
Zurich Insurance
|
Cataluña
15 oct
Zurich Insurance
Cataluña
Описание Zurich Insurance Group is a integral insurance company. Its Technology Delivery Center in Barcelona provides technological solutions and support to local and global business units, covering software development, data analytics, cybersecurity, and IT infrastructure. Задачи * Own and evolve the Databricks platform supporting the Zurich Global Finance Data Hub, ensuring scalability, reliability, security, and cost efficiency; * Design, build, and maintain batch, streaming, API, and CDC data ingestion frameworks across multiple source systems; * Develop and manage Delta Live Tables pipelines with data quality controls, expectations, schema enforcement, and change data capture; * Administer and optimise Delta Lake environments, including performance tuning, schema evolution, time travel, VACUUM, and OPTIMIZE operations; * Implement and manage Unity Catalog governance practices, including access controls, data lineage, data classification, and namespace management; * Build, deploy, and support Databricks Workflows for complex multi-task pipeline orchestration,
dependency management, retries, and event-driven processing; * Establish and maintain CI/CD pipelines using Git-based development practices and Databricks Asset Bundles across development, testing, and production environments; * Collaborate with cloud and infrastructure teams to implement Infrastructure as Code solutions using AWS CloudFormation or CDK; * Manage authentication and authorisation mechanisms, including AWS IAM roles, instance profiles, service principals, secret management, and credential rotation; * Monitor platform health, performance, operational metrics, and costs using Databricks system tables, CloudWatch, Grafana, and related observability tools; * Define and enforce cluster policies, compute strategies, and DBU governance controls to optimise platform utilisation and expenditure; * Ensure platform security through PrivateLink, VPC endpoints, row-level security, and column-level security c
📌 platform engineer for financial data platforms (Cataluña)
🏢 Zurich Insurance
📍 Cataluña