Your new companyWorking for a renowned financial services organisation Your new roleWe''re looking for a Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/ high-level data platforms that power analytical and business insights. This is a hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services.Using , Big Data tools and Spark development you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses and data lakes, contributing to a robust, scalable, and resilient enterprise data ecosystem.What you''ll need to succeedStrong Data Engineering expertise with Big Data technologies.Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design.Strong Spark development experience.Hands-on experience with Hadoop - configuring multi-node Hadoop clusters, including resource management, security, and performance tuning.Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools.Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB.Proven delivery of streaming pipelines and real-time data processing solutions.Delivered streaming pipelines and real-time data processing solutions.What you''ll get in returnFlexible working options ..... full job details .....