Freelance Data Engineer - PySpark & AWS

Location: Spain

Contract: Freelance / Autónomo

Project Duration: Long-term engagement

Work Model: Hybrid / Remote, depending on project requirements

Availability: Immediate or short notice preferred

Project Overview

We are looking for an experienced Freelance Data Engineer with strong expertise in PySpark and AWS to join a long-term data engineering project within a dynamic, technology-driven environment.

The successful candidate will contribute to the design, development, and optimization of scalable data pipelines and cloud-based data processing solutions, supporting the efficient integration, transformation, and exploitation of large volumes of data.

This is an excellent opportunity for a hands-on professional seeking a stable, long-term collaboration within a technically challenging environment.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines using PySpark and Python.

- Build and optimize data processing workflows within the AWS cloud ecosystem.

- Develop ETL/ELT processes to integrate, transform, and validate data from multiple sources.

- Work with large datasets, ensuring data quality, performance, scalability, and reliability.

- Optimize Spark jobs and distributed data processing workloads.

- Collaborate with Data Engineers, Data Architects, Data Scientists, and other technical stakeholders.

- Contribute to data architecture improvements, best practices, and continuous optimization.

- Ensure code quality, documentation, testing, and adherence to engineering standards.





Required Experience
- Proven experience as a Data Engineer in complex data environments.

- Strong hands-on expertise in PySpark, Apache Spark, and Python.

- Solid experience with AWS data services, such as Amazon S3, AWS Glue, EMR, Lambda, or Athena.

- Experience building and maintaining ETL/ELT pipelines and processing large volumes of data.

- Strong SQL skills and experience working with structured and semi-structured data.

- Understanding of data lake and cloud data architecture concepts.

- Experience with Git, CI/CD, and automated testing practices.

- Ability to work independently in a freelance capacity and collaborate effectively with distributed teams.

Nice to Have

- Experience with AWS Step Functions, Redshift, or other AWS analytics services.

- Knowledge of Terraform or Infrastructure as Code.

- Experience with Databricks or modern data lakehouse architectures.

- Familiarity with data governance, monitoring, and observability practices.

What the Project Offers
- Long-term freelance engagement in Spain.

- Opportunity to contribute to large-scale cloud data engineering initiatives.

- Collaboration with experienced technical teams.

- Competitive daily rate, depending on experience and expertise.

- Adaptable working arrangements, depending on project needs.

Interested? If you are an experienced Data Engineer with strong PySpark and AWS expertise and are looking for your next long-term freelance project, we would be happy to discuss the opportunity with you.

📌 Freelance Data Engineer (PySpark & AWS) (Barcelona)
🏢 Robert Walters
📍 Barcelona