Databricks Data Engineer | 12 Month+ B2B Contract | Fully Remote | €500 per day

I'm partnering with a general technology consultancy on a large data transformation programme for a well-established organisation in the insurance sector. on Databricks Data Engineer to join the delivery team on a long?term contract.

The end client is moving away from legacy data warehousing and scattered on?You'll design and build scalable data pipelines, migrate legacy workloads, and help set the engineering standards the wider platform will be built on.

You'll work closely with architects, analysts and business stakeholders across the underwriting, claims, policy and finance data domains.

You should be comfortable writing production?grade PySpark and SQL every day.

The Project

Migrating legacy data warehouse and ETL workloads (SQL Server, SSIS, Informatica or similar) onto Databricks

Rolling out Unity Catalog for central governance, lineage and access control

Delivering curated, trusted data products for actuarial, risk, claims and regulatory reporting

Introducing CI/CD, automated testing and infrastructure as code across the platform

Enabling downstream BI, analytics and future AI/ML use cases

Design, build and maintain scalable batch and streaming pipelines on Databricks using PySpark, Spark SQL and Delta Lake

Migrate legacy ETL processes and data models onto the Lakehouse, keeping data accurate and reconciled throughout

Orchestrate workflows using Databricks Workflows, Delta Live Tables, Azure Data Factory or Airflow

Work within Unity Catalog to enforce governance,



security and lineage

Optimise Spark jobs and cluster configurations for performance and cost

Build data quality checks, monitoring and alerting into pipelines

Contribute to CI/CD and infrastructure as code using Databricks Asset Bundles, Terraform, Azure DevOps or GitHub Actions

Turn business requirements into robust data solutions alongside architects, analysts and insurance stakeholders

5+ years of commercial experience as a Data Engineer

Advanced Python and PySpark

Advanced SQL and data modelling (dimensional, Data Vault or similar)

Cloud platform experience, ideally Azure (AWS also considered)

Building and orchestrating ETL/ELT pipelines at scale

Git-based workflows and CI/CD for data engineering

Experience on a data migration or transformation programme

Confident communicator, comfortable working on your own in a remote team

Unity Catalog implementation or migration

Databricks Asset Bundles and Terraform

Insurance data domains such as policy, claims, underwriting and actuarial

dbt, Azure Data Factory or Airflow

Data quality frameworks such as Great Expectations or DLT expectations

Databricks Certified Data Engineer Professional

12 month+ initial contract with a strong chance of extension

Fully remote working

€profile programme with a global consultancy and a major insurance client

this role is not suited to purely BI or reporting profiles, or to architects and delivery leads who no longer code day to day. Candidates must be able to work on a B2B contract basis.

#

📌 Data Engineer con AWS - REMOTO (Huelva)
🏢 TechShack
📍 Huelva