04 oct
|
Infoser Technological Solutions, Hardware, Big Data Experts
|
Madrid
04 oct
Infoser Technological Solutions, Hardware, Big Data Experts
Madrid
We are looking for an experienced Data Architect / Senior Data Engineer to join an international technology project, 100 % remote, focused on designing, building and evolving a scalable Lakehouse data platform on Databricks and Azure.
You will combine strong hands-on Data Engineering expertise with Data Architecture and technical leadership, helping define architectural standards, build reliable data pipelines and establish best practices across a multi-repository data ecosystem.
?
What will you work on?
- Design and evolve Lakehouse architectures on Databricks using Medallion Architecture (Bronze/Silver/Gold).
- Design and maintain data models, schemas and catalog structures using Unity Catalog and Delta Lake.
- Build and maintain scalable data ingestion, transformation and processing pipelines using Apache Spark and PySpark.
- Implement and manage cloud data storage solutions using Azure Data Lake Storage (ADLS) and Unity Catalog managed/external tables.
- Define and implement CI/CD strategies for multi-repository and multi-environment data platforms.
Automate deployments using Databricks Asset Bundles, including branching strategies, release processes and approval gates.
- Develop and maintain data quality frameworks to ensure data integrity, consistency, reliability and security.
- Monitor and optimize data pipelines and Big Data workloads for performance, scalability and cost efficiency.
- Collaborate with Data Analysts and Data Engineers to translate analytical and business requirements into robust, reusable data solutions.
- Participate in architecture reviews and technical decision-making across the data engineering team.
- Mentor other Data Engineers and promote best practices around code quality, testing, CI/CD and data architecture.
- Troubleshoot complex production issues and continuously improve the reliability and maintainability of the platform.
?️
What are we looking for?
- 5+ years of professional experience in Data Engineering, with previous exp
📌 Data Architect (Madrid)
🏢 Infoser Technological Solutions, Hardware, Big Data Experts
📍 Madrid