Python/Spark or AI Developer (Madrid)

Python/Spark or AI Developer (Madrid)

20 nov
|
HRBaires
|
Madrid

20 nov

HRBaires

Madrid

Location

Europe (Remote) — must work South Africa hours (UTC+2) Employment:

Full-time Seniority:

Mid-Senior Level Salary:

$80,000 – $120,000 (estimate; client hasn’t disclosed range) About The Company A fast-growing privacy-preserving data collaboration fintech (Series A, backed by a integral credit bureau and a major retailer), with teams spanning South Africa, the UK, the US, the UAE and Brazil. Banks and lenders use the platform to work with retailer and telco data without raw personal data changing hands — mainly to help people with no credit history access credit. The role The Data Team Is Migrating Legacy SQL Server / Azure Synapse Stored‑procedure Pipelines Onto Open‑source Apache Spark And Delta Lake.

You Will

Rebuild T‑SQL logic as typed, tested PySpark pipelines Prove the new pipelines match legacy outputs Build FastAPI services that run and report on pipeline jobs Add provider‑neutral LLM features (local and hosted models) into data workflows Spec-first codebase: design docs and ADRs,



with tests and documentation shipped alongside every change. Core stack

Python, PySpark, Spark SQL, Delta Lake, FastAPI, pytest, Docker, T‑SQL, LLM integration Required

Modern typed Python (3.10+) as primary production language, with type hints passing pyright/mypy and Pydantic models — writes maintainable, tested code, not only notebooks 2+ years production Apache Spark / PySpark — DataFrame API and Spark SQL, including partitioning and performance tuning Based in Europe or South Africa, able to work South Africa hours (UTC+2) Nice to have

SQL Server / Synapse migration to Spark with validated output parity Open‑source or self‑managed Spark (Kubernetes, EMR, Dataproc, Spark Connect) FastAPI, LLM integration, privacy/data governance (PII tokenisation, GDPR/POPIA), fintech/banking/credit background Skills: apache spark,credit,fastapi,pipelines,apache,azure,fintech,data,sql,python,spark,english

📌 Python/Spark or AI Developer (Madrid)
🏢 HRBaires
📍 Madrid

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: python/spark or ai developer (madrid) / madrid

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: python/spark or ai developer (madrid) / madrid