18 oct
|
Robert Walters
|
Barcelona
18 oct
Robert Walters
Barcelona
Freelance Data Engineer - PySpark & AWS
Location:
Spain
Contract:
Freelance / Autónomo
Project Duration:
Long-term engagement
Work Model:
Hybrid / Remote, depending on project requirements
Availability:
Immediate or short notice preferred
Project Overview
We are looking for an experienced
Freelance Data Engineer with strong expertise in PySpark and AWS
to join a long-term data engineering project within a dynamic, technology-driven environment.
The successful candidate will contribute to the design, development, and optimization of scalable data pipelines and cloud-based data processing solutions, supporting the efficient integration, transformation, and exploitation of large volumes of data.
This is an excellent opportunity for a hands-on professional seeking a stable, long-term collaboration within a technically challenging environment.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark and Python.
- Build and optimize data processing workflows within the AWS cloud ecosystem.
- Develop ETL/ELT processes to integrate,
transform, and validate data from multiple sources.
- Work with large datasets, ensuring data quality, performance, scalability, and reliability.
- Optimize Spark jobs and distributed data processing workloads.
- Collaborate with Data Engineers, Data Architects, Data Scientists, and other technical stakeholders.
- Contribute to data architecture improvements, best practices, and continuous optimization.
- Ensure code quality, documentation, testing, and adherence to engineering standards.
Required Experience
- Proven experience as a Data Engineer in complex data environments.
- Strong hands-on expertise in
PySpark, Apache Spark, and Python
.
- Solid experience with
AWS data services
, such as Amazon S3, AWS Glue, EMR, Lambda, or Athena.
- Experience building and maintaining ETL/ELT pipelines and processing large volumes of data.
- Strong SQL skills and experience working with structured and semi-struc
📌 Freelance Data Engineer (Barcelona)
🏢 Robert Walters
📍 Barcelona