04 nov
|
Graitec
|
Barcelona
Описание: The Data Platform Engineer builds and runs the platform that all of Graitec's reporting, analytics and AI depend on: the Microsoft Fabric data lake, the pipelines that feed it, and the controls that keep it reliable, secure and affordable. Задачи:
* Design, build and run the Microsoft Fabric platform: lakehouses, warehouses, pipelines and dataflows.
* Ingest and integrate data from Dynamics 365, CRM, Kantata, licensing and telemetry, using standard connectors and APIs where they fit.
* Build a layered, medallion-style data model that turns raw data into certified, reusable datasets.
* Resolve customer and product identities across CRM, ERP, licensing and telemetry, so every report counts the same customer once.
* Monitor pipelines and automate data quality tests for completeness, freshness, uniqueness and referential integrity, with alerting and clear ownership of failures.
* Manage platform capacity and cost, separating workloads and scaling only when justified.
* Run source control, environments and deployment pipelines for data and BI content.
* Implement access, classification, row
- and column-level security, masking and privacy controls with Information Security.
* Protect sensitive data such as compensation, using anonymisation and restricted workspaces.
* Maintain lineage and documentation, supporting the data governance the business agrees.
* Set engineering standards and coach BI developers and analysts in using them.
* Work with the Enterprise Architect and R&D; on integration patterns, master data and telemetry.
* Prepare data for AI,
exposing governed, well-described data to agents and models through controlled interfaces. Требования:
* 6+ years of experience in Data Engineering, including at least two years working with Microsoft Fabric, Azure Synapse, or Databricks.
* Strong experience with SQL and Python or PySpark, and data modelling for analytics.
* Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Notebooks, and OneLake.
* Experience integrating ERP and CRM data, ideally from Dynamics 365 Finance & Operations and Dataverse.
* Experience with master data management and entity resolution, including matching customers and products across multiple systems.
* Practical experience implementing security and governance, including Entra ID, row-level security, and Microsoft Purview.
* Experience managing capacity and costs on a shared analytics platform.
* Uses AI tools such as Copilot in day-to-day work for code generation, testing, and documentation.
* Strong communication skills, with the ability to document effectively and explain technical trade-offs to non-engineering stakeholders.
* Strong proficiency in SQL and Python/PySpark development.
* Expertise in analytics-focused data modelling and data architecture.
* Deep knowledge of Microsoft Fabric technologies, including Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake Experience with source control and CI/CD practices for data platforms, including Git and Azure DevOps.
* Knowledge of enterprise security, governance, and compliance frameworks, including Entra ID, Row-Level Security (RLS), Microsoft Purview Understanding of data platform operations, including performance, scalability, and cost optimization.
* Practical application of AI-assisted development tools such as Copilot. Будет плюсом:
* Experience with product telemetry or event-driven data;
* Experience preparing data for AI solutions, including retrieval, vector search, and governed access for agents (for example through MCP);
* Experience with other modern data platforms and tools such as dbt, Snowflake, or Databricks, and with infrastructure as code;
* Microsoft Fabric Data Engineer (DP-700);
* Microsoft Fabric Analytics Engineer (DP-600);
* Familiarity with modern AI data architectures, including Retrieval-Augmented Generation (RAG), Vector Search, MCP-enabled data access and governance;
* Knowledge of modern data engineering ecosystems, including dbt, Snowflake, Databricks, Infrastructure as Code (IaC) practices Условия: Role Targeted Variable Pay Mix: 10% Minimum Annual On Target Earning: € 40,000 Maximum Annual On Target Earning: € 60,000
📌 Data platform engineer for analytics and AI (Barcelona)
🏢 Graitec
📍 Barcelona