02 oct
|
Square One Resources
|
Madrid
02 oct
Square One Resources
Madrid
Databricks Data Engineer
Presente su candidatura después de leer los siguientes requisitos de habilidades y cualificaciones para este puesto.
Location: Madrid, Spain - Hybrid
Contract: Initial 6 months
Day Rate: €275-€300 per day
I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.
This is a hands-on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.
Key Responsibilities
-
- Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
- Build scalable data processing solutions using Databricks and PySpark
- Develop robust Python-based data engineering solutions
- Implement data ingestion from multiple sources, including APIs, databases and files
- Work with Medallion Architecture - Bronze, Silver and Gold layers
- Perform data transformation using PySpark and SQL
- Process and manage large-scale datasets
- Optimise pipeline performance and Databricks workloads
- Ensure data quality,
reliability and maintainability
Required Skills
-
- Strong hands-on experience with Databricks
- Advanced PySpark development
- Strong Python programming skills
- Strong SQL and data transformation experience
- Proven experience building end-to-end data pipelines
- Experience with data ingestion from APIs, databases, files and other sources
- Experience implementing Medallion Architecture
- Experience handling large-scale data processing
- Strong understanding of pipeline performance and optimisation
- Strong spoken and written English and Spanish language skills
Working Environment
-
- Hybrid working environment in Madrid
- Availability to attend the Madrid office on specific days and for important collaborative meetings
The Adecuado Profile
The client is specifically looking for a hands-on Data Engineer who is comfortable writing PySpark and Python code and can independently implement pipelines
📌 DataBricks Engineer (Madrid)
🏢 Square One Resources
📍 Madrid