Senior Data Engineer (Metadata & Lineage Integration) Location: Remote from Spain (an indefinite Spanish employment contract) Our client is a leading general investment management company headquartered in London. It manages over $228 billion in assets and serves institutional investors, pension funds, wealth managers, and other sophisticated clients worldwide. The firm specializes in quantitative investing, alternative investments, systematic trading strategies, and technology-driven asset management.

Data science, machine learning, and AI are core components of its investment and research processes.

Agentic

Security and AI-Ready Data Foundations.

Project Overview: We build the data foundations that make AI useful and safe inside regulated financial firms. The value of AI is capped by the data its agents can reach: if an agent cannot find, interpret, trace or be correctly permissioned against data, the capability is useless, or worse, unsafe. This is a hands-on senior role for an excellent Python engineer with strong data-engineering skills who is genuinely comfortable building with AI agents.

You will design and build the catalogue, semantic, entitlement and analytical layers that turn large on-premise data estates into something agents can use. 5+ years building production data systems in Python, with strong engineering fundamentals (testing, code review, performance) and solid SQL. ~ Experience building crawlers, harvesters or connector frameworks that extract inventories, schemas, field dictionaries and lineage from databases, filesystems,



message platforms and API surfaces, in addition to conventional data pipelines. ~ Event-driven integration with Kafka or similar, including secure producer patterns (mTLS or equivalent) and schema-managed topics. ~ Elasticsearch, OpenSearch, MongoDB or similar). ~ Experience applying LLMs to metadata work, such as drafting descriptions and classifications for human review, including quality evaluation of the generated output. ~ Fluent English for written and spoken communication with client teams. Time-series and tick stores (e.g. kdb+ or similar columnar time-series databases), market-data vendor schema APIs, symbology and asset-class concepts (market-data opening). MS SQL Server estates, reporting and BI systems, inventory extraction from application metadata tables (reporting opening).

Columnar and lake formats (Parquet or similar), large object stores, orchestration platforms (Airflow or similar). Working-level knowledge of graph databases; data contracts and data quality frameworks; Day-to-day use of AI coding agents; building data services consumed by AI agents. Build extraction, enrichment and registration paths that populate domain catalogues from live estates (databases, time-series stores,



streaming platforms, filesystems, internal and vendor APIs) and connect them to the client's central catalogue through its existing mechanisms.

Extend an existing scraping capability from bare dataset and symbol inventories to full metadata: descriptions, field-level dictionaries, date ranges, asset-class and cadence tags, vendor provenance. Seed report and dataset inventories from existing application metadata tables and ETL sources; Integrate lineage into the client's lineage backend across batch, streaming and cross-system report chains, completing the client's existing registration designs. Implement the federation contract defined by the architect: stable identities, ownership, hierarchy, links and availability state exposed by each local catalogue to the central layer.

Keep metadata current through scheduled and event-driven refresh, with explicit staleness detection and quality signals. This role sits at the intersection of data engineering, AI, and financial services, solving one of the most important challenges in enterprise AI: enabling agents to securely access and reason over trusted data. You'll have the opportunity to design and build foundational platforms that combine large-scale data systems, governance, and AI technologies in highly regulated environments.

It offers significant technical ownership, exposure to cutting-edge AI agent architectures, and the chance to shape how organisations safely unlock value from their data.

📌 Data Science Senior Engineer (Islas Baleares)
🏢 Intellias
📍 Islas Baleares