Madrid - 2 days a week on site Key Responsibilities
Design and develop end-to-end data pipelines, from source systems through to Gold layer datasets. Implement data ingestion, transformation and optimisation using Databricks. Build scalable and efficient data processing pipelines using PySpark. Ingest and process data from multiple sources, including APIs, databases and files. Implement and maintain Medallion architecture across Bronze, Silver and Gold layers. Develop and optimise data transformations using SQL and Python. Process large-scale datasets efficiently while maintaining data quality and reliability. Ensure pipelines are maintainable, scalable and optimised for performance. Mandatory Skills & Experience
Strong hands-on experience with Databricks.
Advanced PySpark development skills. Strong Python programming experience. Proven experience building end-to-end data pipelines. Expertise in data ingestion from multiple sources, including APIs, databases and files. Experience implementing Medallion architecture (Bronze, Silver and Gold layers). Strong SQL skills and experience in data transformation. Experience handling large-scale data processing. Adecuado Candidate
The ideal candidate will be a hands-on Data Engineer who can take ownership of data pipeline development, from source ingestion through to gold layer delivery, with a strong focus on scalability, performance, data quality and maintainability.
#J-18808-Ljbffr
📌 DataBricks Engineer (Madrid)
🏢 JobServe
📍 Madrid
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.