This job has ended. Find similar jobs.

Data Engineer - Technical Lead

Posted 6 February by Harnham Ended

Data Engineer - Technical Lead - Spark, Scala / Java, AWS, Kafka
West London


One of the UK's most widely recognised eCommerce Companies, known for being one of the most cutting-edge technology company in their sector.

Alongside some of the best Data Scientists in the industry, you'll help to develop a high performance & highly scalable Big Data platform to enable a variety of new analytics use cases, including sentiment/social media analytics, data streaming & geospatial analytics.


As Technical Lead you'll be leading the development of a complex, highly scalable Cloudera platform, hosted on AWS. The project is all greenfield so you won't have to deal with any scrappy legacy code and you'll have the opportunity to design new features and introduce new tools.

The bulk of the work will be done with Spark (written in Scala), as well as number of other Cloudera tools, including Impala, Kafka and Flume to name a few - you'll help to choose the right tech depending on which brings the best technical and commercial benefits.

The plan is to build a cross-functional team of Data Scientists and Big Data Engineers so you'll likely gain exposure to advanced analytics and Machine Learning, using e.g. Spark MLlib.

Given the greenfield nature of the role, there are lots of career routes on offer to you, including Data Science, team leadership or Data Architecture.


  • Strong experience developing a production level Big Data platform, preferably Cloudera or Hortonworks, and experience with a number of Hadoop/Spark ecosystem tools
  • Solid Scala or Java programming skills
  • Experience with both batch and stream processing is preferable
  • Any experience with analytics/data science would be really useful but not necessary


Click the 'Apply' link on this page!
However, if you don't think this is the one for you, Harnham are working on a broad spectrum of roles in the busiest Big Data market ever - get in touch with Ross Whatling


Big DataEngineer, Big Data Developer, Big Data Software, Hadoop, Spark streaming, AWS, Cloudera, Kafka, Scala, London

Required skills

  • Java
  • JVM
  • Spark
  • Scala
  • AWS

Reference: 34413841

Bank or payment details should not be provided when applying for a job. is not responsible for any external website content. All applications should be made via the 'Apply now' button.

Report this job