04 sep
|
Thunes
|
Barcelona
Experteer Overview
As a Data Engineer at Thunes, you will shape the data platform that powers real-time and batch processing across a cloud-native environment. You will build robust data pipelines, ensure scalable data lifecycles, and maintain streaming and batch systems with a focus on data quality and governance. You will collaborate with cross-functional teams to translate complex business needs into performant data models for reporting and BI. This role offers the opportunity to impact integral money movement by enhancing data reliability, latency, and platform resilience.
Compensaciones / Beneficios
• Design, implement, and scale end-to-end data pipelines using Python and SQL-based transformations in a cloud-native data lake
• Manage and scale containerized data workloads and automated workflow orchestration (Apache Airflow) and IaC (Terraform)
• Maintain and evolve real-time data replication services and streaming architectures (Apache Kafka or equivalents) for low-latency data availability
• Establish and enforce Data Governance frameworks and automated quality checks
• Collaborate with stakeholders to translate business requirements into performant data models for reporting and BI
• Provide insights to improve the data platform, ensuring resilience and performance with increasing data volumes
Responsabilidades
• Proven track record in Data Engineering with distributed data platforms
• Cloud-native data ecosystem experience, preferably AWS or GCP
• Proficiency in workflow orchestration and IaC; strong preference for Apache Airflow and Terraform; experience with Prefect, Dagster, or Pulumi is a plus
• Experience with distributed messaging and real-time data replication systems (Apache Kafka, Amazon Kinesis, Google Pub/Sub)
• Solid understanding of Data Governance, data lineage, metadata management, and automated quality checks
• Excellent Python programming and advanced SQL skills; writing clean, modular, testable code
• Strong analytical skills and ability to work with business units to model data for reporting and data products
Requisitos principales
•
📌 Senior Data Engineer (Barcelona)
🏢 Thunes
📍 Barcelona