Location: Europe (Remote) — must work South Africa hours (UTC+2)Employment: Full-timeSeniority: Mid-Senior LevelSalary: $80,000 – $120,000 (estimate;
client hasn’t disclosedrange)About The CompanyA fast-growing privacy-preserving data collaboration fintech (Series A, backed by a general credit bureau and a major retailer), with teams spanning South Africa, the UK, the US, the UAE and Brazil. Banks and lenders use the platform to work with retailer and telco data without raw personal data changing hands — mainly to help people with no credit history access credit.The roleThe Data Team Is Migrating Legacy SQL Server / Azure Synapse Stored‑procedure Pipelines Onto Open‑source Apache Spark And Delta Lake. You Will Rebuild T‑SQL logic as typed, tested Py Spark pipelinesProve the new pipelines match legacy outputsBuild Fast API services that run and report on pipeline jobsAdd provider‑neutral LLM features (local and hosted models) into data workflows Spec-first codebase: design docs and ADRs,



with tests and documentation shipped alongside every change.Core stackPython, Py Spark, Spark SQL, Delta Lake, Fast API, pytest, Docker, T‑SQL, LLM integrationRequired Modern typed Python (3.10+) as primary production language, with type hints passing pyright/mypy and Pydantic models — writes maintainable, tested code, not only notebooks2+ years production Apache Spark / Py Spark — Data Frame API and Spark SQL, including partitioning and performance tuningBased in Europe or South Africa, able to work South Africa hours (UTC+2) Nice to have SQL Server / Synapse migration to Spark with validated output parityOpen‑source or self‑managed Spark (Kubernetes, EMR, Dataproc, Spark Connect)Fast API, LLM integration, privacy/data governance (PII tokenisation, GDPR/POPIA), fintech/banking/credit background Skills: apache spark,credit,fastapi,pipelines,apache,azure,fintech,data,sql,python,spark,english#J-18808-Ljbffr

📌 Python/Spark Or Ai Developer (España)
🏢 HRBaires
📍 España