Permanent

Data Engineer - SC Cleared

cLogo
Lorien

Job Description

Data Engineer
6 Month Contract
Hybrid - London (50% onsite)
Please note: Active SC Clearance is required for this role


A leading organisation within the UK financial sector is embarking on a major data transformation programme. They are looking for an experienced Data Engineer to help design and deliver a modern, cloud-first data platform that will underpin some of the organisation's most critical functions.

Responsibilities:

  • Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage.
  • Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake.
  • Champion strong data quality, governance and observability practices.
  • Modernise Legacy systems and support large-scale migrations into Azure.
  • Provide technical leadership, set engineering standards and contribute to architectural decisions.
  • Mentor engineers and foster a culture of continuous improvement.
  • Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs.

Minimum Criteria

  • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
  • Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong ..... full job details .....