Job Description
Senior Data Engineer - Python, Databricks and Counterparty Credit Risk Location: London - Hybrid We are recruiting for an experienced Senior Data Engineer to join a leading global banking organisation, working across a highly technical data environment supporting Counterparty Credit Risk (CCR), Credit Risk and wider risk data. This is a hands-on engineering position requiring strong expertise across Python, PySpark, SQL and Databricks, alongside experience designing, building and optimising scalable data pipelines and Lakehouse solutions. Candidates should ideally have previously worked with Counterparty Credit Risk or Credit Risk data, including areas such as counterparty/exposure data, risk analytics, regulatory risk or associated banking risk datasets. Key Responsibilities Design, develop and maintain scalable data pipelines using Python, PySpark and Databricks Build and optimise ETL/ELT workflows using Spark and Delta Lake Engineer and transform data supporting Counterparty Credit Risk, Credit Risk and wider risk functions Work with datasets relating to areas such as counterparties, credit exposures, limits, collateral and risk analytics Design robust data models and architectures across Lakehouse / Medallion environments Develop and manage Databricks notebooks, jobs and workflows Optimise large-scale distributed data processing and troubleshoot Spark performance Implement strong data quality, reconciliation, governance and monitoring controls Build reliable logging ..... full job details .....