Connecting Talent to opportunity

Connecting Talent to opportunity

Senior Data Engineer

Apply

Job Description:

We are seeking an experienced Senior Data Engineer / Engineering Lead with deep expertise in the Microsoft Fabric ecosystem to deliver governed, production-ready data products for a critical enterprise public sector environment.

You will lead the implementation of end-to-end ingestion and ETL patterns, enforce Medallion Architecture standards (Bronze/Silver/Gold), and ensure seamless integration with Purview data governance frameworks.

Key Responsibilities

  • Pipeline & Data Product Delivery: Design, build, and deploy 1–2 production-grade data products within an existing MS Fabric platform to validate core ingestion and ETL/ELT frameworks.
  • Architecture Implementation: Implement Medallion Architecture patterns across OneLake, Lakehouses, and Data Warehouses to transform raw inputs into structured, business-ready datasets.
  • Data Integration: Build and maintain scalable orchestration pipelines using MS Fabric Dataflows Gen2, Pipelines, PySpark/Notebooks, and integration tools such as Matillion.
  • Governance & Metadata Support: Collaborate with the Data Architect and Metadata Lead to implement lineage tracking, security controls, and metadata capture natively integrated with Microsoft Purview.
  • Environment Validation: Participate in early-phase platform reviews to validate capacity setup, workspace configuration, and technical readiness before scaling out.

Required Experience & Skills

  • MS Fabric Core: Hands-on experience building solutions on Microsoft Fabric (OneLake, Lakehouse, Dataflows Gen2, Fabric Pipelines, DirectLake/Semantic Models).
  • Data Engineering Stack: Strong proficiency in PySpark, T-SQL, Python, and Delta Lake optimizations (partitioning, OPTIMIZE/VACUUM patterns).
  • ETL/ELT Tools: Experience with modern ingestion platforms, metadata-driven pipelines, and cloud connectors (experience with Matillion is a strong bonus).
  • Data Architecture Knowledge: Practical application of Medallion Architecture standards and star-schema dimensional modeling.
  • Governance Awareness: Familiarity with Microsoft Purview for data cataloging, sensitivity labeling, and access control execution.
  • Public Sector / Enterprise background: Experience operating within complex enterprise frameworks, structured change processes, and data privacy environments.

Candidate Deliverables for Submission

Please provide profiles highlighting:

  1. Specific MS Fabric / Azure Lakehouse projects executed.
  2. Experience leading ingestion design (specifically ETL patterns and Medallion implementation).
  3. Availability for an immediate part-time start leading into full-time work.
  • Job Type

    Permanent, Full Time

  • Work Authorisation

    No

  • Industry Sector IT & Internet

Apply for this position

Thank you for your application

Why don't you search for some more vacancies...