This job has ended. Find similar jobs.

Data Engineer

Posted 5 February by Harnham Easy Apply Ended

As a Data Engineer, you are required to build Python pipelines for the batch data processes. You will be working for a successful online food retailer, joining their bespoke Data Engineering function.

THE COMPANY:

This company works with hundreds of food chains, providing a delivery service for them. They pride themselves on customer service and on-time delivery. They take in thousands of orders every day which means their Data teams are required to process large volumes of data. They are currently in the process of moving towards real-time data streaming.

THE ROLE:

The data team are currently working on the Google Cloud platform and are operating 70% batch data and 30% streaming. The aim is to migrate to full data streaming, so they are in the process of implementing Kafka in order to deal with this. As a Data Engineer, you are required to maintain and build ETL pipelines in Python for the batch data. You will be assisting with the transformation and will have the responsibility of advising what are the best technologies to us, going forward.

YOUR SKILLS AND EXPERIENCE:

The ideal Data Engineer will have:

  • Experience working on cloud-based platforms
  • Built Python ETL pipelines from scratch
  • Have worked with Batch data on Big Data platforms
  • Exposure to liaising with senior stakeholders

HOW TO APPLY:

Please register your interest by sending your CV via the Apply link on this page.

Reference: 34402532

Bank or payment details should not be provided when applying for a job. reed.co.uk is not responsible for any external website content. All applications should be made via the 'Apply now' button.

Report this job