Senior Data Engineer - Python, SQL, AWS, Terraform. Hybrid, SC Cleared.

Our client within the public sector requires a proven Senior Data Engineer to build and maintain pipelines to extract from operational systems and load data to their Analytical Platform You will be modelling the data using dimensional modelling principles to provide useful and usable data to downstream users, including analysts, performance teams, and data scientists. Establishing connectivity with downstream data systems, exploring a new data layer for LAA, and conducting a detailed analysis of user needs in a single area to inform dimensional model design. By developing in a flexible manner with the right level of abstraction, this will enable expansion to bring a full range of analytically useful legal aid data onto the platform and eventual migration towards modern API-based data extraction. Essential Requirements: Excellent Python, SQL, and Jinja skills Experience with cloud platforms, ideally AWS Experience of orchestration tools, ideally Airflow Experience in building CI/CD workflows, ideally with GitHub Actions Experience in ensuring practices are up to date with the latest developments in data engineering Experience in designing and developing data pipelines Experience of working with business stakeholders and cross-functional teams Experience with infrastructure as code, ideally Terraform Active SC Clearance is required for this role. Minorities, women, LGBTQ+ candidates, and individuals with disabilities are encouraged to apply. Interviews will take place ..... full job details .....
Other jobs of interest...
Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!