Overview

In this Lead Data Mesh Engineer role, you drive the architecture and hands-on delivery of a high-throughput, event-driven data mesh across multi-cloud environments. You will shape the Data-in-Motion backbone, enabling declarative, Git-driven assets and automated pipelines. Your work enables scalable, policy-driven data governance and efficient cross-cloud data movement. This opportunity combines advanced streaming, IaC, and governance to transform enterprise IT and data platforms.

Compensaciones / Beneficios

- Generous PTO
- Unplugged Days
- Adaptable WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement
- Continued Career Development

Responsabilidades

- Architect, provision, and maintain multi-AZ AWS MSK clusters and NiFi runtimes on EKS using Terraform and GitOps patterns
- Enforce schema contracts and governance via vendor-neutral registries (Avro, AsyncAPI) in the Governance Hub




- Optimize data movement and compute with partitioning, dynamic storage, and local compression
- Build fault-tolerant DLQ flows and ensure distributed tracing context across services

Requisitos principales

- BSc/MSc in related field or equivalent experience
- 6+ years of experience with Apache Kafka (AWS MSK) and Apache NiFi in Kubernetes (EKS)
- Advanced Terraform and GitOps tooling with ArgoCD or Flux
- Expertise in Apache Avro, AsyncAPI, and schema registries for MDM enforcement
- Experience connecting cloud event meshes to data lakehouses or big-data monoliths (Cloudera CDP, Hadoop, Hive)
- Knowledge of OpenTelemetry and distributed tracing
- Exposure to policy-as-code tools (Open Policy Agent / Rego)

- AWS MSK
- Apache NiFi
- Kubernetes (EKS)
- Terraform
- GitOps (ArgoCD or Flux)
- Apache Avro

📌 Lead Data Mesh Engineer - Cloudera (Barcelona)
🏢 Cloudera
📍 Barcelona