Permanent

Senior Data Engineer - Databricks

cLogo
hireful

Job Description

UK HQ based & fast-growing software business (400+ staff, globally), serving hundreds of enterprise customers worldwide, are looking for a Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business.


Location: UK, remote with very occasional visits to the office in London. Salary: Up to £85,000 basic, plus 10% bonus and an extensive benefits package.


What you'll be doing


  • Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
  • Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
  • Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
  • Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions.
  • Embed data quality, governance and access controls throughout the data lifecycle.
  • Mentor a junior engineer and help mature a growing data function.


What you need to bring