Databricks Data Platform Architect

Role Overview

We are looking for a senior, hands-on Databricks Architect to lead the design and delivery of an enterprise data lakehouse. The role will establish a secure, scalable platform and drive adoption of Databricks capabilities across data engineering, governance, analytics, and AI readiness.

Key Responsibilities

- Own lakehouse architecture and implementation roadmap, including workspaces, cloud integration, storage, networking, identity, and compute.

- Design batch, streaming, and CDC pipelines using Delta Lake, Auto Loader, and Lakeflow, with layered data architecture, modeling, data quality, and reliable incremental processing.

- Establish Unity Catalog governance covering access controls, sensitive-data protection, lineage, discovery, and auditability.

- Enable Databricks SQL, BI integration, curated data products, and governed business metrics; assess Genie and AI/ML capabilities against business needs.

- Lead performance and cost optimization, CI/CD, infrastructure automation, monitoring, failure recovery, and disaster recovery.

- Guide client stakeholders and engineering teams through architecture decisions, implementation reviews, production readiness, and knowledge transfer.





Essential Skills & Experience

- Proven ownership of enterprise Databricks platforms delivered into production.

- Strong hands-on expertise in Spark, PySpark, Python, SQL, Delta Lake, Unity Catalog, and pipeline orchestration.

- Experience with lakehouse modeling, streaming, CDC, schema evolution, deduplication, and safe pipeline recovery.

- Strong AWS or Azure expertise, including platform security, networking, storage, and enterprise integration.

- Demonstrated performance troubleshooting, cost optimization, automated testing, CI/CD, and infrastructure-as-code experience.

- Strong client-facing communication and technical leadership, with clear examples of architecture trade-offs and production outcomes.

Preferred

- Databricks Data Engineer Professional certification.

- Experience with serverless compute, Terraform, Declarative Automation Bundles, and warehouse migration.

- Exposure to AI/BI Genie, MLflow, model serving, vector search, or RAG on governed enterprise data.

Idóneo Candidate A hands-on architect who can build the lakehouse foundation, lead delivery, and expand Databricks adoption in line with business priorities.

📌 Databricks architect (España)
🏢 Atain
📍 España