Senior Data Engineer

Posted 4 days ago by Appcastenterprise

Register and upload your CV to apply with just one click

Bringing that feel-good energy.

We're the newest face amongst the E.ON group of companies. E.ON Next is all about creating a sustainable future, now. We're moving our energy in the right direction, one little big step at a time. Join us in our mission to bring feel-good energy.

We’re also here to make this whole energy thing way easier for our customers. Like, really easy. That means providing exceptional service and using state-of-the-art tech to do it.

As we undertake a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, we are growing our data engineering capability within the Data Team.

At E.ON Next we’re looking for the most ambitious, talented, and creative people out there to join our brand new, fresh, start-up business. E.ON Next is one of the biggest energy providers in the UK and plays a crucial role in shaping the UK energy market. This isn’t the old energy as you know it - we’re all-in on 100% renewable energy and sustainability and focussing what we do around our customers. This is new, exciting, and waiting for stars like you to shape it. Do you love delivering for customers? Are you full of energy, ideas, and passion?

A taste of what you’ll be doing:

  • You will build and maintain scalable and efficient data pipelines within Databricks in accordance with best practice. You will evolve and improve these pipelines as requirements change and as new technologies become available.

  • You will build towards and maintain an enterprise data model within Databricks.

  • You will integrate new sources into the data platform through the use of batch and streaming processes, all the while adhering to committed SLAs.

  • You will create and maintain documentation of data pipelines and associated systems, and adhere to the security and monitoring processes around data.

  • You will ensure data quality and reliability processes are effective and adhered to, ensuring trust in the data.

Are you the person for the job?

  • Minimum four years hands-on experience as a Data Engineer.

  • Knowledge and experience of Amazon Web Services is essential.

  • Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements.

  • Hand-on experience with working with stakeholders and managing their requirements.

  • Actively coach and mentor others in the team and foster a culture of innovation and peer review within the team to ensure best practice.

  • A strong attention to detail and a curiosity about the data you will be working with.

  • A strong understanding of Linux based tooling and concepts.

  • A strong Python background, ideally with four or more years of experience building solutions using Python. You will require working knowledge of advanced Python concepts such as, but not limited to, decorators, protocols, functools, context managers, and comprehensions.

  • A strong understanding of cloud based design, in particular on Amazon Web Services.

  • A strong understanding of SQL, database design, and data architecting.

  • Strong experience with Databricks and/or Spark.

  • Experienced with data governance, data cataloguing, data quality principles, and associated tools.

  • Experience of data extraction, joining, and aggregation tasks, especially on big and real-time data i.e. Spark.

  • Perform data cleansing operations to prepare data for analysis, including transforming data into useful formats.

  • Able to explain data storage concepts and logical data structures ie. data warehousing.

  • Able to write repeatable, production quality code as part of your data pipelines, taking advantage of templating and parameterisation where needed.

  • Able to make recommendations for data pipeline design based on business requirements.

  • Previous data migration experience is ideal.

  • Be open to new ways of working, and open to working with new technologies.

  • Be able to set your own goals and take the initiative when working.

  • Have a drive to troubleshoot and deconstruct problems, and build appropriate solutions.

  • Energy sector experience is a bonus but not essential.

What else do I need to know?

  • Closing date – Thursday 9th May 2024

  • We’ll have regular team socials and lively team chats

  • Competitive salary

  • Location - London, Leicester or Nottingham with travel to our other sites when required.

  • Working environment: Flexible hybrid working – a blend of in the office and home working.

  • 26 days holiday plus bank holidays each year – this includes a guaranteed day off for your birthday if you want it.

  • A generous pension scheme.

  • The chance to choose from our award-winning Flexible Benefits package which includes the option to buy up to 10 days holiday a year.

  • We’ve exciting opportunities for everyone to develop their talent at E.ON. Our open access, inclusive talent networks provide networking, learning and development for all, building your skills, qualifications, and capabilities throughout your career.

  • For all successful candidates.  Due to the nature of this role your employment will be subject to a basic DBS (Disclosure Barring Service) check being carried out by ourselves via a 3rd party service provider

We’re committed to equal opportunities and actively promote a diverse and inclusive working environment, and fairness for everyone.

We realise the best people bring their energy at different times, so we’re happy to talk flexible working. We offer a range of flexible working options, including full time, part time, job share, remote working and variable start and finishing times.

Reference: 52537650

Please note Reed.co.uk does not communicate with candidates via Whatsapp, and we will never ask you to provide your bank, passport or driving licence details during the application process. To stay safe in your job search and flexible work, we recommend visiting JobsAware, a non-profit, joint industry and law enforcement organisation working to combat labour market abuse. Visit the JobsAware website for information and free expert advice for safer work.

Report this job