10 sep
|
Intellias
|
Castro Urdiales
10 sep
Intellias
Castro Urdiales
Senior Data Engineer(Databricks) Location: Remote from Spain (an indefinite Spanish employment contract) We are hiring a Senior Data Engineer to join an Intellias delivery team on a large-scale enterprise data platform migration programme for a financial services client. This is a hands-on senior role. You will write production code every week, own architectural decisions on your workstream, and mentor a paired mid-level engineer. Project Overview : Our client is an independent, active general asset manager with over R3 trillion in assets under management. They are executing a firm-wide data strategy to govern, manage and engineer data as a product across more than 70 business-owned sub-domains. As part of this, they are migrating to Databricks as the foundational layer of their Enterprise Data Platform, adopting a lakehouse architecture built on open formats, declarative pipelines and Unity Catalog. Requirements: * 6+ years of data engineering experience, with at least the last three years on Databricks in production.
* Deep hands-on experience with medallion / Lakehouse architecture, Delta Lake, Unity Catalog, Lakeflow Declarative Pipelines and Databricks Asset Bundles. * Strong python, PySpark and SQL, comfortable diagnosing performance issues on large workloads through Spark UI and Photon. * Real production experience with streaming ingestion (Kafka Structured Streaming, Auto Loader) and CDC patterns. * Experience implementing data quality at scale (Great Expectations or equivalent), plus lineage, cataloguing and access control. * CI/CD on data platforms through Azure DevOps or GitHub Actions, with infrastructure as code (Terraform or equivalent). * Fluent working English. Nice to have * Active Databricks certifications * Prior exposure to investment management platforms, asset management operations data, market data feeds from major providers * CDMP DAMA certification or equivalent data governance credential. * Experience applying agentic engineering tooling to
📌 Senior Data Engineer(Databricks) (Castro Urdiales)
🏢 Intellias
📍 Castro Urdiales