Описание We are looking for an experienced Databricks Data Engineer to join our growing data team in Barcelona. In this role, you will design, build, and optimise scalable data pipelines and data platforms using Databricks, Apache Spark, and cloud technologies. You will work closely with data architects, analysts, data scientists, and business stakeholders to transform complex datasets into reliable, high-quality data solutions that drive business value.Задачи Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark.Build and optimise data processing workflows using PySpark and SQL.Develop and manage data lakehouse architectures using Delta Lake and the Databricks Lakehouse Platform.Integrate data from multiple sources, ensuring data quality, consistency, and reliability.Implement data transformation, orchestration, and workflow automation.Optimise pipeline performance, scalability, and cost efficiency.Apply data governance, security, and access control best practices.Collaborate with cross-functional teams to deliver robust,



production-ready data solutions.Monitor, troubleshoot, and improve existing data pipelines and data platforms.Требования Proven experience as a Data Engineer working with Databricks.Strong proficiency in Python, PySpark, and SQL.Hands-on experience with Apache Spark and Delta Lake.Experience designing and implementing ETL/ELT data pipelines.Knowledge of cloud data platforms, preferably Azure, AWS, or Google Cloud.Experience with data modelling, data warehousing, and lakehouse architectures.Familiarity with Git, CI/CD, and data pipeline orchestration.Strong analytical, problem-solving, and communication skills.Ability to work effectively within an Agile, collaborative environment.Будет плюсом Experience with Azure Databricks and Microsoft Azure data servicesKnowledge of Delta Live Tables / Lakeflow Declarative Pipelines and Unity CatalogExperience with Terraform, infrastructure as code, or automated deployment p

📌 Data Engineer (Barcelona)
🏢 TechYard
📍 Barcelona