AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you ABOUT THE ROLE We are looking for a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows. MUST HAVES - Strong software engineering fundamentals. - 3+ years of hands-on Python development experience. - Advanced SQL, including complex joins, CTEs, window functions, and performance tuning. - Snowflake data modeling. - Apache Airflow — developing and testing pipelines in Airflow and Python. - Iceberg and Parquet data formats. - AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies). - Testing strategy experience, with the ability to hands-on debug and test code.
- At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark. - Overlap until 12 PM Pacific Time. NICE TO HAVES - Hands-on experience with Snowflake migrations (data warehouse modernization, performance and cost optimization). - Experience with Apache Airflow migrations (version upgrades, executor changes, or platform migrations). WHAT YOU WILL DO - Work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort. - Execute the migration of approximately 1,000 datasets to Snowflake. - Adapt existing pipelines to Snowflake, following the core architecture and technical approach defined by the internal team. - Ensure data quality and reliability throughout the migration process. - Support workflow scheduling and monitoring in Apache Airflow 3. - Execute time-sensitive migrations, i
📌 Ingeniero/a de Datos AWS (Galicia)
🏢 AgileEngine
📍 Galicia
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.