09 ago
|
EPAM Systems
|
Sevilla
09 ago
EPAM Systems
Sevilla
We are looking for a seasoned Senior Data Platform Engineer to join EPAM, a company at the forefront of shaping digital solutions for Fortune 1000 businesses.As a critical part of our team, the adecuado candidate will bring deep expertise in Databricks and experience across multi-cloud environments. This role will focus on building, optimizing, and maintaining innovative, high-performance data platforms that enable powerful data insights and drive meaningful business transformations.This position offers a hybrid work setup with flexibility to work from Malaga or Madrid, with occasional office visits required.ResponsibilitiesArchitect and deploy robust data platforms using Databricks, focusing on optimal performance and securityCreate solutions that are cloud-agnostic across AWS, Azure, and GCP to ensure system flexibility and resilienceDesign and implement comprehensive data pipelines involving data lakes, warehouses, and streaming technologiesUtilize Databricks SQL, Delta Lake, MLflow,
and Spark for data interaction and performance enhancementsCollaborate with various teams to implement and maintain workflows based on Databricks best practicesDevelop CI/CD pipelines tailored for data platform deployment and testingSet up and manage frameworks for monitoring, logging, and alerting to ensure infrastructure healthOptimize compute and storage resources to balance cost-efficiency and performanceTroubleshoot Databricks and Spark performance issuesMentor team members on effective cluster management and resource allocation in Databricks environmentsMaintain compliance and security standards throughout platform operationsDrive adoption of advanced Databricks capabilities like Photon and Graviton instancesRegularly refine architectures to align with evolving business and technology requirementsRequirementsExtensive experience in Databricks, Apache Spark, and distributed data processing systemsStrong programming skills in Python, Scala, SQLProficiency in data engineering service
📌 Senior Data Platform Engineer (Sevilla)
🏢 EPAM Systems
📍 Sevilla