22 sep
|
Lawrence Harvey
|
Barcelona
22 sep
Lawrence Harvey
Barcelona
We are looking for one of our clients for a talented Data Engineer with a strong software engineering mindset and hands-on experience building modern data and machine learning platforms.
Your Responsibilities
- Design, build, and maintain scalable data pipelines, ML solutions, and event-driven architectures using Python, PySpark, and Databricks
- Develop and optimize batch and streaming data solutions across GCP and Azure environments
- Work with
BigQuery and Snowflake for large-scale data processing and analytics
- Build and deploy
ML pipelines and ML engines
, including model lifecycle management with MLflow
- Apply strong software engineering practices and implement CI/CD pipelines using Azure DevOps and/or GitLab CI
Your Profile
- 4+ years of hands-on experience in
Data Engineering, Software Engineering, MLOps, or similar roles
- Strong programming skills in
Python
,
including object-oriented programming (OOP)
- Strong hands-on experience with
PySpark and Databricks
- Very good
SQL skills and experience working with
BigQuery and/or Snowflake
- Experience working across cloud environments, particularly
GCP and Azure
- Hands-on experience with
CI/CD
, ideally Azure DevOps and/or GitLab CI
Nice to Have
- Experience with
MLflow and MLOps practices
- Experience with
Docker and Kubernetes
- Knowledge of
LLMs and Applied AI
, including tools such as LangChain
- Experience developing APIs using
FastAPI or Flask
- Experience with event-driven or streaming architectures
Location:
Barcelona
Working model:
Hybrid
📌 Software Engineer - Data (Barcelona)
🏢 Lawrence Harvey
📍 Barcelona