Senior Data Engineer

Advertiser
Harnham
Company
Harnham
Date Posted
5th May 2018
Reference
32384/RW
Job Type
Permanent
Location
City of London, London
Salary
£70,000 to £85,000 Per Annum

Lead Data Engineer - Greenfield project, using AWS, Spark Streaming, Kafka, and the programming language of your choice!)
eCommerce
Central London

An established and still growing eCommerce Company based in Central London are looking for a Lead Data Engineer to design and build their data lake from scratch. You will work independently from their data warehousing team, specifically building a solution to work in real-time and incorporate new data sources for data science and advanced analytics. The platform will be built in AWS and using Spark, however other technology choices will be down to you.

You will work closely with their Head of Data to work with the business to scope out requirements and build the solution accordingly. This is a great opportunity for a Lead Data Engineer to take on a greenfield project with no legacy code, or for a Senior Data Engineer to take the step up into a lead role.

THE COMPANY

You will be joining a dress-down culture, with a flat reporting structure and the opportunity to make a real impact without much red tape. The business is also growing rapidly (over doubled in size in the last 2 years) and you expect excellent investment and career opportunities as a result.

THE ROLE - Lead Data Engineer

As Lead Data Engineer, you will:

  • Design and develop the Data Lake and Architecture in AWS, including Data Ingestion, streaming services (Kafka / Kinesis).
  • Work with distributed computing technologies, specifically Spark
  • Deploy Data Science Solutions and Analytics solutions
  • Work with stakeholders to understand business requirements
  • The programming language is up to you, although some Python will be needed as that is what the analytics team use

YOUR SKILLS AND EXPERIENCE

To qualify for this Lead Data Engineer role, you will need:

  • Excellent programming skills in either Python or Scala, with at least some knowledge of Python
  • Good knowledge of AWS data technologies, including experience in Data Lakes
  • Distributed Computing experience (Hadoop or Spark)
  • Knowledge of streaming technology, e.g. AWS Kensis or Kafka
  • Passionate about high quality coding practices and testing

HOW TO APPLY

To apply for this Lead Data Engineer role, please do so via this site. For more information on this or other Big Data Engineering roles, reach out to Ross at Harnham.

KEYWORDS: AWS, Data Lake, Data Engineering, Hadoop, Spark, Kafka, Kenisis

Register and Apply

Login and Apply

Profile Options

Location(s) you would like to work in*:
Job Type*:
Most Recent Position*:
My Top 5 skills
Skill 1:
Skill 2:
Skill 3:
Skill 4:
Skill 5:
Role(s) Sought:
Education/Qualification*:
Minimum salary required*:
Willing to Relocate*:
By submitting this form you agree to our terms of use

Copyright © 2018 Daylight Resources Ltd

Site design by Zero One Design Ltd