As a Data Engineer, you are required to build Python pipelines for the batch data processes. You will be working for a successful online food retailer, joining their bespoke Data Engineering function.
This company works with hundreds of food chains, providing a delivery service for them. They pride themselves on customer service and on-time delivery. They take in thousands of orders every day which means their Data teams are required to process large volumes of data. They are currently in the process of moving towards real-time data streaming.
The data team are currently working on the Google Cloud platform and are operating 70% batch data and 30% streaming. The aim is to migrate to full data streaming, so they are in the process of implementing Kafka in order to deal with this. As a Data Engineer, you are required to maintain and build ETL pipelines in Python for the batch data. You will be assisting with the transformation and will have the responsibility of advising what are the best technologies to us, going forward.
YOUR SKILLS AND EXPERIENCE:
The ideal Data Engineer will have:
- Experience working on cloud-based platforms
- Built Python ETL pipelines from scratch
- Have worked with Batch data on Big Data platforms
- Exposure to liaising with senior stakeholders
HOW TO APPLY:
Please register your interest by sending your CV via the Apply link on this page.