Job Description
Data Engineer
6 Month Contract
Hybrid - London (50% onsite)
Please note: Active SC Clearance is required for this role
A leading organisation within the UK financial sector is embarking on a major data transformation programme. They are looking for an experienced Data Engineer to help design and deliver a modern, cloud-first data platform that will underpin some of the organisation's most critical functions.
Responsibilities:
- Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage.
- Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake.
- Champion strong data quality, governance and observability practices.
- Modernise Legacy systems and support large-scale migrations into Azure.
- Provide technical leadership, set engineering standards and contribute to architectural decisions.
- Mentor engineers and foster a culture of continuous improvement.
- Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs.
Minimum Criteria
- Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
- Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong ..... full job details .....