17 oct
|
Cloudera
|
Barcelona
17 oct
Cloudera
Barcelona
Overview In this Lead Data Mesh Engineer role, you drive the architecture and hands-on delivery of a high-throughput, event-driven data mesh across multi-cloud environments. You will shape the Data-in-Motion backbone, enabling declarative, Git-driven assets and automated pipelines. Your work enables scalable, policy-driven data governance and efficient cross-cloud data movement. This opportunity combines advanced streaming, IaC, and governance to transform enterprise IT and data platforms. Compensaciones / Incentivos * Generous PTO * Unplugged Days * Flexible WFH Policy * Mental & Physical Wellness programs * Phone and Internet Reimbursement * Continued Career Development Responsabilidades * Architect, provision, and maintain multi-AZ AWS MSK clusters and NiFi runtimes on EKS using Terraform and GitOps patterns * Enforce schema contracts and governance via vendor-neutral registries (Avro, AsyncAPI)
in the Governance Hub * Optimize data movement and compute with partitioning, dynamic storage, and local compression * Build fault-tolerant DLQ flows and ensure distributed tracing context across services Requisitos principales * BSc/MSc in related field or equivalent experience * 6+ years of experience with Apache Kafka (AWS MSK) and Apache NiFi in Kubernetes (EKS) * Advanced Terraform and GitOps tooling with ArgoCD or Flux * Expertise in Apache Avro, AsyncAPI, and schema registries for MDM enforcement * Experience connecting cloud event meshes to data lakehouses or big-data monoliths (Cloudera CDP, Hadoop, Hive) * Knowledge of OpenTelemetry and distributed tracing * Exposure to policy-as-code tools (Open Policy Agent / Rego) * AWS MSK * Apache NiFi * Kubernetes (EKS) * Terraform * GitOps (ArgoCD or Flux) * Apache Avro
📌 Lead Data Mesh Engineer (Barcelona)
🏢 Cloudera
📍 Barcelona