Senior Data Engineer

Date Posted
5th May 2018
Job Type
City of London, London
£70,000 to £85,000 Per Annum

Lead Data Engineer - Greenfield project, using AWS, Spark Streaming, Kafka, and the programming language of your choice!)
Central London

An established and still growing eCommerce Company based in Central London are looking for a Lead Data Engineer to design and build their data lake from scratch. You will work independently from their data warehousing team, specifically building a solution to work in real-time and incorporate new data sources for data science and advanced analytics. The platform will be built in AWS and using Spark, however other technology choices will be down to you.

You will work closely with their Head of Data to work with the business to scope out requirements and build the solution accordingly. This is a great opportunity for a Lead Data Engineer to take on a greenfield project with no legacy code, or for a Senior Data Engineer to take the step up into a lead role.


You will be joining a dress-down culture, with a flat reporting structure and the opportunity to make a real impact without much red tape. The business is also growing rapidly (over doubled in size in the last 2 years) and you expect excellent investment and career opportunities as a result.

THE ROLE - Lead Data Engineer

As Lead Data Engineer, you will:

  • Design and develop the Data Lake and Architecture in AWS, including Data Ingestion, streaming services (Kafka / Kinesis).
  • Work with distributed computing technologies, specifically Spark
  • Deploy Data Science Solutions and Analytics solutions
  • Work with stakeholders to understand business requirements
  • The programming language is up to you, although some Python will be needed as that is what the analytics team use


To qualify for this Lead Data Engineer role, you will need:

  • Excellent programming skills in either Python or Scala, with at least some knowledge of Python
  • Good knowledge of AWS data technologies, including experience in Data Lakes
  • Distributed Computing experience (Hadoop or Spark)
  • Knowledge of streaming technology, e.g. AWS Kensis or Kafka
  • Passionate about high quality coding practices and testing


To apply for this Lead Data Engineer role, please do so via this site. For more information on this or other Big Data Engineering roles, reach out to Ross at Harnham.

KEYWORDS: AWS, Data Lake, Data Engineering, Hadoop, Spark, Kafka, Kenisis

Register and Apply

Login and Apply

Profile Options

Location(s) you would like to work in*:
Job Type*:
Most Recent Position*:
My Top 5 skills
Skill 1:
Skill 2:
Skill 3:
Skill 4:
Skill 5:
Role(s) Sought:
Minimum salary required*:
Willing to Relocate*:
By submitting this form you agree to our terms of use

Copyright © 2018 Daylight Resources Ltd

Site design by Zero One Design Ltd