03 nov
|
Square One Resources
|
Madrid
03 nov
Square One Resources
Madrid
I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.
This is a hands‑on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.
Key Responsibilities
- Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
- Build scalable data processing solutions using Databricks and PySpark
- Implement data ingestion from multiple sources, including APIs, databases and files
- Work with Medallion Architecture - Bronze, Silver and Gold layers
- Perform data transformation using PySpark and SQL
- Process and manage large-scale datasets
- Optimise pipeline performance and Databricks workloads
- Ensure data quality,
reliability and maintainability
Required Skills
- Strong hands‑on experience with Databricks
- Advanced PySpark development
- Strong SQL and data transformation experience
- Experience with data ingestion from APIs, databases, files and other sources
- Experience implementing Medallion Architecture
- Strong understanding of pipeline performance and optimisation
- Strong spoken and written English and Spanish language skills
- Hybrid working environment in Madrid
- Availability to attend the Madrid office on specific days and for important collaborative meetings
📌 Databricks Data Engineer (Madrid)
🏢 Square One Resources
📍 Madrid