03 nov
|
T-Systems
|
Reus
Job Description We are looking for a skilled Junior Data Engineer to join our team in DBIZ. The Technik Value Stream teams are responsible for Data Ingest on ODE, development of the relevant data products on ODE, and Operations of the data products on ODE.
Your Task
We are looking for a skilled Junior Data Engineer to join our team in DBIZ. The Technik Value Stream teams are responsible for Data Ingest on ODE, development of the relevant data products on ODE, and Operations of the data products on ODE.
Responsibilities
- Infrastructure Deployment & Management: Efficiently deploy and manage infrastructure on Google Cloud Platform (GCP) including network architectures (Shared VPC, Hub-and-Spoke), security implementations (IAM, Secret Manager, firewalls,
Identity-Aware Proxy), DNS configuration, VPN, and Load Balancing.
- Data Processing & Transformation: Utilize Hadoop cluster with Hive for querying data, and PySpark for data transformations. Implement job orchestration using Airflow.
- Core GCP Services Management: Work extensively with services like Google Kubernetes Engine (GKE), Cloud Run, BigQuery, Compute Engine, and Composer, all managed through Terraform.
- Application Implementation: Develop and implement Python applications for various GCP services.
- CI/CD Pipelines:
📌 Data Engineer (m/f/d) (Reus)
🏢 T-Systems
📍 Reus