Data Engineering Manager

Posted 9 November by Harnham
Easy Apply

DATA ENGINEERING MANAGER

£80,000 - £100,000 + 20% BONUS

LONDON

This data driven company in the retail sector are offering the chance to lead an agile squad working with the newest AWS technology and one of the biggest data sets based on spark in the U.K.

THE COMPANY

With vast amounts of data coming into their AWS data lake compared to competitors, this company have recognised that they have a unique advantage, provided they can get great people in to work with their data. Using a tribe model with 10 agile squads this company is handing back ownership to their data engineers. Each team is run like an individual start-up so as lead data engineer this is a unique opportunity to work with vast data lakes and all the best technology without compromising on autonomy.

THE ROLE

As a data engineering manager at this company you'll be managing a team of six data engineers working on individual projects. The team will be in charge of building data pipelines with Kafka to stream data from the main AWS data lake. Once built, they'll be using Kubernetes and docker for containerisation. They'll then be structuring the data in smaller data lakes ready for analysts to take over.

SKILLS AND EXPERIENCE

The successful data engineering manager will have the following experience:

  • Educated to degree level
  • Experience managing a team
  • Commercial experience streaming data from vast AWS data lakes
  • Commercial experience coding with Python, Pyspark or Spark
  • Commercial experience using Kafka to structure data
  • Experience with Kubernetes, Jenkins or CircleCI preferred

THE BENEFITS

  • £80,000 - £100,000
  • 20% bonus
  • Flexible working
  • Working with one of the biggest data sets in the U.K.
  • Upskilling opportunities

HOW TO APPLY

Please register your interest by sending your CV to Olivia Woodward via the Apply link on this page.

Required skills

  • python
  • AWS
  • Data engineer
  • senior manager
  • Kafka
  • data engineering manager

Reference: 39330404

Bank or payment details should never be provided when applying for a job. For information on how to stay safe in your job search, visit SAFERjobs.

Report this job