DV Data Engineering Lead - London

Data Engineering Lead4 days onsite in London6 months initial contract Key Responsibilities:Data engineering and product delivery-Design, build and deliver new data products in response to operational needs -Develop, maintain and improve data pipelines.-Use predominantly open-source technologies to create practical data solutions.-Build solutions from the ground up within short and potentially changing delivery timescales.-Contribute to data cataloguing and the effective organisation of data assets.-Adapt designs and engineering priorities when operational requirements change.Platforms and engineering practices-Contribute to the platform and infrastructure supporting data products.-Work in Linux or Unix environments.-Apply continuous integration and continuous delivery practices.-Use containerisation and orchestration technologies when developing and deploying solutions.-Support engineering within an Azure Stack Hub environment.-Evaluate or work with emerging technologies where relevant, including pipeline orchestration and graph database tools.Essential-Python-Open-source data engineering technologies-Data pipeline development-Linux or Unix-Continuous integration and continuous delivery-Containerisation-KubernetesPreferred-Apache Airflow-OpenSearch-Azure-Azure Stack Hub-Apache Kafka-Data cataloguing tools and practices-Apache NiFi-Graph databasesDue to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most ..... full job details .....