21 sep
|
Lawrence Harvey
|
Barcelona
21 sep
Lawrence Harvey
Barcelona
We are looking for one of our clients for a talented Data Engineer with a strong software engineering mindset and hands-on experience building modern data and machine learning platforms.
Your Responsibilities
- Design, build, and maintain scalable data pipelines, ML solutions, and event-driven architectures using Python, PySpark, and Databricks
- Develop and optimize batch and streaming data solutions across GCP and Azure environments
- Work with BigQuery and Snowflake for large-scale data processing and analytics
- Build and deploy ML pipelines and ML engines, including model lifecycle management with MLflow
- Apply strong software engineering practices and implement CI/CD pipelines using Azure DevOps and/or GitLab CI
Your Profile
- 4+ years of hands-on experience in Data Engineering, Software Engineering, MLOps, or similar roles
- Strong programming skills in Python,
including object-oriented programming (OOP)
- Strong hands-on experience with PySpark and Databricks
- Very good SQL skills and experience working with BigQuery and/or Snowflake
- Experience working across cloud environments, particularly GCP and Azure
- Hands-on experience with CI/CD, ideally Azure DevOps and/or GitLab CI
Nice to Have
- Experience with MLflow and MLOps practices
- Experience with Docker and Kubernetes
- Knowledge of LLMs and Applied AI, including tools such as LangChain
- Experience developing APIs using FastAPI or Flask
- Experience with event-driven or streaming architectures
Location: Barcelona
Working model: Hybrid
📌 Software Engineer - Data (Barcelona)
🏢 Lawrence Harvey
📍 Barcelona