Data Architect / Senior Data Engineer - Azure & Databricks (España)

Data Architect / Senior Data Engineer - Azure & Databricks (España)

18 sep
|
Infoser New Technologies
|
España

18 sep

Infoser New Technologies

España

We are looking for an experienced Data Architect / Senior Data Engineer to join an international technology project, 100 % remote, focused on designing, building and evolving a scalable Lakehouse data platform on Databricks and Azure.

You will combine strong hands-on Data Engineering expertise with Data Architecture and technical leadership, helping define architectural standards, build reliable data pipelines and establish best practices across a multi-repository data ecosystem.

? What will you work on?

- Design and evolve Lakehouse architectures on Databricks using Medallion Architecture (Bronze/Silver/Gold).
- Design and maintain data models, schemas and catalog structures using Unity Catalog and Delta Lake.
- Build and maintain scalable data ingestion, transformation and processing pipelines using Apache Spark and PySpark.
- Implement and manage cloud data storage solutions using Azure Data Lake Storage (ADLS) and Unity Catalog managed/external tables.
- Define and implement CI/CD strategies for multi-repository and multi-environment data platforms. Automate deployments using Databricks Asset Bundles, including branching strategies, release processes and approval gates.
- Develop and maintain data quality frameworks to ensure data integrity, consistency, reliability and security.
- Monitor and optimize data pipelines and Big Data workloads for performance, scalability and cost efficiency.
- Collaborate with Data Analysts and Data Engineers to translate analytical and business requirements into robust, reusable data solutions.




- Participate in architecture reviews and technical decision-making across the data engineering team.
- Mentor other Data Engineers and promote best practices around code quality, testing, CI/CD and data architecture.
- Troubleshoot complex production issues and continuously improve the reliability and maintainability of the platform.

?️ What are we looking for?

- 5+ years of professional experience in Data Engineering, with previous experience designing or contributing to production-grade data architectures.
- Strong professional experience with Python and Apache Spark / PySpark.
- Strong knowledge of SQL, including joins, aggregations, subqueries, temporary tables and query optimization.
- Hands-on production experience with Databricks.
- Experience with Databricks Asset Bundles and automated deployment processes.
- Strong knowledge of Unity Catalog and Delta Lake.
- Experience designing and operating cloud data platforms, preferably Microsoft Azure.
- Experience with Azure Data Lake Storage (ADLS).
- Experience implementing CI/CD and DevOps practices using Azure DevOps, GitHub Actions, Jenkins or similar tools.
- Experience working with multi-repository and multi-environment deployment pipelines.



Knowledge of data orchestration tools such as Azure Data Factory, Airflow, Control-M or similar. Strong knowledge of Git and version control workflows.
- Proven experience providing technical guidance and mentoring to other engineers.
- Strong analytical, critical-thinking and problem-solving skills.
- Degree or higher vocational qualification in Computer Engineering, Computer Science or a related field.

➕ Nice to have

- Experience with Java or Scala for Big Data processing.
- Experience with Jira and Confluence for project management and technical documentation. Knowledge of Power BI, Grafana or other data visualization/observability tools.
- Experience with Docker and Kubernetes.
- Experience working with Agile methodologies.
- Databricks Certified Data Engineer, Azure Data Engineer Associate or other relevant cloud/Big Data certifications.
- Previous experience working in international and multicultural teams.

? Technology Stack

Databricks · Azure · Apache Spark · PySpark · Python · Unity Catalog · Delta Lake · Azure Data Lake Storage (ADLS) · Databricks Asset Bundles · Azure DevOps · Git · GitHub · Azure Data Factory · Airflow · Control-M · SQL · Docker · Kubernetes

If you enjoy solving complex data challenges and want to work at the intersection of Data Engineering, Data Architecture, Cloud and Big Data, while having an impact on technical standards and the evolution of a modern Lakehouse platform, we would love to hear from you.

? Apply or contact us to learn more about the project.

📌 Data Architect / Senior Data Engineer - Azure & Databricks (España)
🏢 Infoser New Technologies
📍 España

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: data architect / senior data engineer - azure & databricks (españa) / españa

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: data architect / senior data engineer - azure & databricks (españa) / españa