Databricks Data Platform Architect
Role Overview
We are looking for a senior, hands-on Databricks Architect to lead the design and delivery of an enterprise data lakehouse. The role will establish a secure, scalable platform and drive adoption of Databricks capabilities across data engineering, governance, analytics, and AI readiness.
Key Responsibilities
• Own lakehouse architecture and implementation roadmap, including workspaces, cloud integration, storage, networking, identity, and compute.
• Design batch, streaming, and CDC pipelines using Delta Lake, Auto Loader, and Lakeflow, with layered data architecture, modeling, data quality, and reliable incremental processing.
• Establish Unity Catalog governance covering access controls, sensitive-data protection, lineage, discovery, and auditability.
• Enable Databricks SQL, BI integration, curated data products, and governed business metrics; assess Genie and AI/ML capabilities against business needs.
• Lead performance and cost optimization, CI/CD, infrastructure automation, monitoring, failure recovery, and disaster recovery.
• Guide client stakeholders and engineering teams through architecture decisions, implementation reviews, production readiness, and knowledge transfer.
Essential Skills & Experience
• Proven ownership of enterprise Databricks platforms delivered into production.
• Strong hands-on expertise in Spark, PySpark, Python, SQL, Delta Lake, Unity Catalog, and pipeline orchestration.
• Experience with lakehouse modeling, streaming, CDC, schema evolution, deduplication, and safe pipeline recovery.
• Strong AWS or Azure expertise, including platform security, networking, storage, and enterprise integration.
• Demonstrated performance troubleshooting, cost optimization, automated testing, CI/CD, and infrastructure-as-code experience.
• Strong client-facing communication and technical leadership, with clear examples of architecture trade-offs and production outcomes.
Preferred
• Databricks Data Engineer
📌 Databricks architect (España)
🏢 Atain
📍 España