Data Engineer

Posted 28 May by TES Global

Title: Data Engineer

Location: London or Sheffield

Full time, permanent

Salary: £50,000 - £60,000

Role overview:

You will be part of a team that investigates new data architecture solutions as they become available. If you are interested in things like how data architecture has changed because of the rise in popularity of cloud-based data services, e.g. Fivetran, Snowflake, DBT, we would like to meet you.

In addition to the technical expertise, you will apply best engineering practices to your work, e.g. test-driven development, while working in an agile, friendly team.

Key role responsibilities:

Our Data Engineering team is responsible for maintaining a complex cloud-based data pipeline built using AWS platform (including Kinesis, Lambda, Redshift, S3, Spectrum, EMR, Data Pipeline, IAM) coding in Node, Python, Scala, Terraform and various RDBMS (MySQL, Postgres) data sources. We use Docker, Jenkins, and Kubernetes in our deployment pipeline to production.

Data Engineers design, build, and maintain our data infrastructure to support product, business insights, sales, marketing, and finance. This entails:

  • Ingesting data from different sources,
  • Synchronising data flows,
  • Managing data governance,
  • Maintaining the data warehouse, and
  • Monitoring the pipeline

    Education and experience requirements:

    Overall, an interest in learning about data and contributing to the team is more valued than any one of the below.

  • Developing and maintaining data flow management tools e.g. Airflow, Prefect,
  • Using SaaS services e.g. Fivetran, stitch to import data from external sources,
  • Managing modern cloud databases e.g. Snowflake, Redshift, Big Query,
  • Developing and managing systems to service business intelligence and data science work, and
  • Developing / managing platforms for data analysts/scientists e.g. jupyterlab, sagemaker, saturn cloud.

    You would ideally have experience with some or all of the following technologies:

  • SQL
  • Python
  • Node.js
  • Git
  • Continuous integration, e.g. Jenkins
  • Software or platform development
  • AWS platform, e.g. IAM, S3, Redshift or similar, and
  • Programmatically setting up infrastructure, e.g. terraform or similar.

    You may have been praised in the past for:

  • Learning quickly
  • Working well asynchronously
  • Working well as part of a team, and
  • Proactively communicating

    You will value

  • Engineering best practices such as Test Driven Development,
  • Pair programming, and
  • Working with data.

    What do you get in return?

  • 25 days annual leave rising to 30
  • 5% pension after probation
  • State of the art offices
  • Access to a range of benefits via My Benefits World
  • Free fruit delivered to the office weekly
  • Free breakfast cereals
  • Free soft and hot drinks
  • Free eye care cover
  • Free Bupa Health cover
  • Discounted Dental Insurance
  • Life Assurance
  • Long Term Disability Insurance
  • Cycle to Work Scheme
  • Referral Scheme
  • Season Ticket Loan
  • EAP (Employee assistance programme)
  • Paid for monthly nights out
  • Access to an extensive Learning and Development menu

    Who are Tes?

    Tes Global is a global digital education company that has been supporting educators for over 100 years. We power schools and enable great teaching worldwide, by creating intelligent online products and services to make the greatest difference in education.

    With more than 13.7m education professionals and enthusiasts in our online community using over 900k classroom resources and working relationships with 25,000 schools in over 100 countries, we have the scale to make a difference. Our innovative products and services are delivered through a range of partners across the globe. We help schools find the teachers they need; we bring new teachers into the profession through initial teacher training; we provide teachers with continuous professional development and help educators with safeguarding training and compliance. We provide innovative tools to help teachers succeed in the classroom as well as bring educators together online, so they can share expertise and provide them with vital news and information about education.

    We are leaders in using digital technology to make life easier for schools and teachers. The services offered through play a critical role in helping teachers and school leaders deal with the challenges of providing high quality education to millions of children across the globe.

    We are proud of our people centric culture where everyone is driven to achieve the same goal, to support and connect teachers and schools worldwide, helping them to improve children's lives through education.

    Tes Global will ensure all qualified applicants receive consideration for employment without regard to race, sex, colour, religion, sexual orientation, gender identity, national origin or on the basis of disability. We invite applicants to contact us directly to identify any additional support required.

  • Reference: 42871785

    Bank or payment details should never be provided when applying for a job. For information on how to stay safe in your job search, visit SAFERjobs.

    Report this job