Senior Data EngineerLocation:Madrid, Community of Madrid, SpainSalary:€45,000.00-€60,000.00Seniority level:Mid-Senior levelEmployment type:Full-timeJob function:Information TechnologyIndustries:Research ServicesFrontiers is one of the world’s largest and most impactful research publishers, dedicated to making peer-reviewed, quality‑certified science openly accessible. Our engineering team builds and maintains high‑quality data systems that are the backbone of our publishing and peer review pipelines.Our data products are used by hundreds of internal users across editorial, publishing, and review workflows. These systems manage complex, heterogeneous, and high-volume datasets, enabling smooth operations and supporting data‑driven decisions across the organization.What We Can Offer You4 additional wellbeing days in addition to existing annual leave allowanceAccess to learning platforms and dedicated learning & development timeA range of wellbeing initiatives, including free online yoga classes and an employee assistance planEmployees can dedicate three days each year to volunteerAdditional benefits depending on your location (e.G. pension plan and private medical care)Role OverviewAs aSenior Data Engineer, you will design, build, and optimise large‑scale data pipelines and systems on Azure. You’ll be responsible for delivery, architecture, scalability, testing, and cost‑efficiency of our data platform. You will ensure our data is accurate, secure, and reliable while playing a strategic role in influencing technical direction. Beyond hands‑on engineering, you will mentor peers, collaborate with data scientists and analysts,



and contribute to shaping the future of our data ecosystem.ResponsibilitiesArchitecture & Design: Shape data models, define engineering standards, and design pipelines optimized for performance, scalability, and cost efficiency.Pipeline Development: Build and maintain scalable data pipelines using Databricks, Delta Lake, Python, SQL, and Spark.Performance Tuning: Optimize pipelines for high‑throughput workloads (billions of records) and explore near‑real‑time streaming where relevant.Cloud Cost Optimization: Monitor and optimise Azure costs to ensure efficient resource usage.Workflow Orchestration: Build and optimise pipelines in Azure Data Factory.Quality & Testing: Apply dbt for data quality checks and implement testing frameworks (unit, integration, data validation) to ensure robust pipelines.CI/CD: Implement CI/CD for data pipelines with Azure DevOps.Collaboration: Work closely with data scientists and analysts to deliver pipelines that power advanced analytics and machine learning.Strategic Input: Contribute to technical direction and roadmap planning beyond execution.Documentation & Mentorship: Document complex systems, mentor junior engineers, and foster a collaborative culture.Trade‑off Evaluation: Weigh complexity, costs, scalability,



and coordination overhead when proposing solutions.Requirements4–8 years of experience in Data Engineering or related fields.Strong expertise in SQL and Apache Spark.Proven hands‑on experience with Databricks and Delta Lake (most critical skills).Experience with BigQuery (nice to have).Experience with dbt (for data quality checks).Good understanding of Docker and containerised environments.Experience with CI/CD pipelines (Azure DevOps).Experience with testing data pipelines (e.G., Great Expectations, dbt tests, unit/integration testing in Spark or Python).Deep understanding of data engineering principles, data governance, and quality standards.Strong problem‑solving and analytical skills, with attention to detail.Ability to collaborate across teams and communicate with both technical and non‑technical stakeholders.Leadership and mentoring experience.Ability to balance trade‑offs and apply judgment in complex technical decisions.Nice to have: Understanding of statistics for data validation and analysis; familiarity with graph databases (Neo4j).Apply NowPlease click the 'apply' button on this page and submit your application in English. Please inform us if you require any special accommodations to participate fully in our recruitment experience. You can contact us at [email protected] for any additional support.Equal Opportunity StatementFrontiers actively embraces diversity and is a safe and welcoming workplace. Recruitment is free from discrimination – including based on race, national or ethnic origin, age, religion, disability, sex, gender identity or sexual orientation. With employees from more than 50 different nations, our diversity creates vibrant teams and constantly challenges us to appreciate multiple perspectives.#J-18808-Ljbffr

📌 Senior Data Engineer - €45.000 - €60.000 A Year (Madrid)
🏢 Frontiers
📍 Madrid