Contract

Senior Data Engineer

cLogo
Alexander Mann Solutions - Public Sector Resourcing

Job Description

On behalf of BEIS, we are looking for a Senior Data Engineer Inside IR35 for a 4 months contract based REMOTELY. As a Senior Data Engineer, your main responsibilities will be: PLEASE NOTE: SC/DV Clearance is an essential requirement for this role, as a minimum you must be willing and eligible to undergo checks. Please note, due to the exceptional requirements of this position (short-term nature of this role and speed at which we require a postholder in situ) preference may be given to candidates who meet all of the essential criteria and hold active security clearance. Key Responsibilities. Develop, test and maintain data ingestion and transformation pipelines using Microsoft Fabric, OneLake and Azure services. Build and support reusable data engineering components and data integration patterns. Design and optimise data models, datasets and data products for reporting, analytics and AI use cases. Integrate data from Dynamics 365, Dataverse and other enterprise applications. Develop API-based and event-driven data integration solutions. Implement data quality, validation and reconciliation processes within pipelines. Monitor, troubleshoot and optimise data platform performance. Support CI/CD, automated testing and DataOps practices. Maintain technical documentation, metadata and data lineage information. Collaborate with technical teams, business stakeholders and third-party suppliers. Investigate and resolve data quality, integration and platform issues. Contribute to ..... full job details .....