04 sep
|
Preply
|
Barcelona
Experteer Overview
As a Data Engineer in the Data Ingestion and Enrichment team, you will build and maintain Preply’s data lake and production-grade pipelines that power analytics, ML, and product features. You will ensure data ownership, quality, and clear data contracts across ingestion layers, enabling observable and reusable datasets. You’ll work with cross-functional teams to scale reliable batch and streaming pipelines while embedding governance and observability. This role offers the chance to influence AI-driven learning at global scale and shape the data foundation for growth.
Compensaciones / Ventajas
• Build and maintain components of the data lake and data-as-a-product foundations with clear ownership, schemas, and quality expectations.
• Develop end-to-end batch and streaming ingestion pipelines supporting real-time and analytical use cases.
• Define raw, standardized, and consumption layers with lineage, retention, and responsibility boundaries.
• Implement data contracts, validation, anomaly detection, and quality checks early in ingestion lifecycles.
• Build enrichment logic to standardize and contextualize data across domains with dataset versioning.
• Instrument ingestion pipelines for observability (freshness, latency, quality, cost)
and contribute to SLOs, alerts, and incident playbooks.
• Apply governance by design (access control, privacy protections, auditable data flows).
• Enable self-service ingestion templates and documentation to improve discoverability and reduce tribal knowledge.
• Collaborate with Product, Backend, Analytics, and ML teams; mentor juniors and promote data quality standards.
Responsabilidades
• Hands-on experience building large-scale data pipelines and APIs.
• Experience in platform or data engineering within multi-stakeholder environments.
• Familiarity with cloud platforms (AWS/GCP) and modern DevOps practices.
• Hands-on with real-time and batch processing using Spark, Flink, Spark Streaming, Kafka, Debezium, etc.
• Experience with orchestration tools like Airflow or dbt.
• Strong problem-solving, proactive mindset, and cross-functional collaboration.
• English level B2+.
Requisitos principales
• monthly lesson allowance
• Learning u0026 Development budget
• relocation package to Barcelona
• equity and health insurance
• mental health support platforms
• gym u0026 wellness access in Spain
📌 Data Engineer (Barcelona)
🏢 Preply
📍 Barcelona