Lead Data Engineer - Pyspark/AWS/Python/SAS - Financial SectorAs a Lead PySpark Engineer, you will design, develop, and fix complex data processing solutions using PySpark on AWS. You will work hands-on with code, modernising Legacy data workflows and supporting large-scale SAS-to-PySpark migrations. The role requires strong engineering discipline, deep data understanding, and the ability to deliver production-ready data pipelines in a financial services environment.Essential SkillsPySpark andamp; Data EngineeringMinimum 5+ years of hands-on PySpark experience.SAS to Pyspark migration experienceProven ability to write production-ready PySpark code.Strong understanding of data and data warehousing concepts, including: ETL/ELT, Data models, Dimensions and facts, Data marts, SCDsSpark Performance andamp; OptimisationStrong knowledge of Spark execution concepts, including partitioning, optimisation, and performance tuning.Experience troubleshooting and improving distributed data processing pipelines.Python andamp; Engineering QualityStrong Python coding skills with the ability to refactor, optimise, and stabilise existing codebases.Experience implementing parameterisation, configuration, logging, exception handling, and modular design.SAS andamp; Legacy AnalyticsStrong foundation in SAS (Base SAS, SAS Macros, SAS DI Studio).Experience understanding, debugging, and modernising Legacy SAS code.Data Engineering andamp; TestingAbility to understand end-to-end data flows, ..... full job details .....