img
Permanent

Lead Data Engineer

Glasgow
money-bag 70000.00-70000.00 Annual
3072099964
Posted 3 days ago

Lead Data Engineer (Azure / Databricks)NO VISA REQUIREMENTSMUST BE BASED NEAR GLASGOW TO WORK 3 DAYS ONSITEMy FMCG client is undergoing a major transformation of their entire data landscape-migrating from legacy systems and manual reporting into a modern Azure + Databricks Lakehouse. They are building a secure, automated, enterprise-grade platform powered by Lakeflow Declarative Pipelines, Unity Catalog and Azure Data Factory. They are looking for a Lead Data Engineer to help deliver high-quality pipelines and curated datasets used across Finance, Operations, Sales, Customer Care and Logistics.What You''ll DoLakehouse Engineering (Azure + Databricks)Build and maintain scalable ELT pipelines using Lakeflow Declarative Pipelines, PySpark and Spark SQL.Work within a Medallion architecture (Bronze ? Silver ? Gold) to deliver reliable, high-quality datasets.Ingest data from multiple sources including ChargeBee, legacy operational files, SharePoint, SFTP, SQL, REST and GraphQL APIs using Azure Data Factory and metadata-driven patterns.Apply data quality and validation rules using Lakeflow Declarative Pipelines expectations.Curated Layers and Data ModellingDevelop clean and conforming Silver and Gold layers aligned to enterprise subject areas.Contribute to dimensional modelling (star schemas), harmonisation logic, SCDs and business marts powering Power BI datasets.Apply governance, lineage and permissioning through Unity Catalog.Orchestration and ObservabilityUse Lakeflow Workflows ..... full job details .....

Other jobs of interest...

Akkodis
Glasgow1 week ago
money-bag75000.00-75000.00 Annual
Boyd Recruitment
Glasgow2 weeks ago
money-bag22.00-22.00 Hourly

Perform a fresh search...

  • Create your ideal job search criteria by
    completing our quick and simple form and
    receive daily job alerts tailored to you!

Jobs. Straight to your inbox!