Data Engineering Manager

Posted 9 November by Harnham
Easy Apply


£80,000 - £100,000 + 20% BONUS


This data driven company in the retail sector are offering the chance to lead an agile squad working with the newest AWS technology and one of the biggest data sets based on spark in the U.K.


With vast amounts of data coming into their AWS data lake compared to competitors, this company have recognised that they have a unique advantage, provided they can get great people in to work with their data. Using a tribe model with 10 agile squads this company is handing back ownership to their data engineers. Each team is run like an individual start-up so as lead data engineer this is a unique opportunity to work with vast data lakes and all the best technology without compromising on autonomy.


As a data engineering manager at this company you'll be managing a team of six data engineers working on individual projects. The team will be in charge of building data pipelines with Kafka to stream data from the main AWS data lake. Once built, they'll be using Kubernetes and docker for containerisation. They'll then be structuring the data in smaller data lakes ready for analysts to take over.


The successful data engineering manager will have the following experience:

  • Educated to degree level
  • Experience managing a team
  • Commercial experience streaming data from vast AWS data lakes
  • Commercial experience coding with Python, Pyspark or Spark
  • Commercial experience using Kafka to structure data
  • Experience with Kubernetes, Jenkins or CircleCI preferred


  • £80,000 - £100,000
  • 20% bonus
  • Flexible working
  • Working with one of the biggest data sets in the U.K.
  • Upskilling opportunities


Please register your interest by sending your CV to Olivia Woodward via the Apply link on this page.

Required skills

  • python
  • AWS
  • Data engineer
  • senior manager
  • Kafka
  • data engineering manager

Reference: 39330404

Bank or payment details should never be provided when applying for a job. For information on how to stay safe in your job search, visit SAFERjobs.

Report this job