Permanent
Data Engineer
City of London

223895692
Posted Yesterday
Data Engineer - Permanent
As a data Engineer, you will shape next-gen data architecture, build smart solutions with Web and Data Science teams, and harness Gen AI to move faster and smarter. You will be experienced in AI and enjoy writing code.
Responsibilities
- Build and maintain scalable distributed systems using Scala and Java
- Design complex Spark jobs, asynchronous APIs, and parallel processes
- Use Gen AI tools to enhance development speed and quality
- Collaborate in Agile teams to improve their data collection pipelines
- Apply best practices like TDD, SOLID, and their engineering standards
- Design relational and non-relational databases and data models
- Support the Data Science team in deploying machine learning models to production
- Leverage data structures, algorithms, and design patterns effectively
- Foster empathy and collaboration within the team and with customers
Preferred Experience
- Degree in Computer Science or equivalent practical experience
- Commercial experience with Spark, Scala, and Java (Python is a plus)
- Strong background in distributed systems (Hadoop, Spark, AWS)
- Skilled in SQL/NoSQL (PostgreSQL, Cassandra) and messaging tech (Kafka, RabbitMQ)
- Experience with orchestration tools (Chef, Puppet, Ansible) and ETL workflows (Airflow, Luigi)
- Familiarity with cloud platforms (AWS, GCP) and monitoring tools (ELK stack)
- Proven problem-solving mindset and ability to adapt solutions to complex challenges
- Hands-on use of Gen AI tools for coding, debugging, or system design
Fully Remote
Brilliant benefits package
Please send me a copy of your CV if you meet all of the requirements
Other jobs of interest...
CV-Library
City of LondonYesterday

Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!