Data Engineer

Data Engineer

London - Hybrid working

£55,000 - £60,000

A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning/ AI and governance. Alongside this my client is going to be going through a cloud migration to Azure.

Responsibilities:

• Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines.
• Develop and maintain scalable data models and databases.
• Design and implement data integration and ETL/ELT processes.
• Optimise and tune data storage and retrieval processes.
• Collaborate with the Data Science team to implement machine learning algorithms and AI models.
• Ensure data quality and integrity throughout the data lifecycle.
• Monitor and troubleshoot data pipelines to ensure optimal performance.
• Stay up-to-date with the latest trends and technologies in data engineering.

Requirements:

• Strong hands-on experience with Azure, Synapse, and Databricks
• Excellent programming skills in SQL and Python
• Proficiency in building and optimising data pipelines, architectures, and datasets
• Familiarity with Medallion architecture and data lakes.
• Experience with data integration and ETL/ELT processes.
• Knowledge of DataOps principles and experience with CI/CD tools
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration skills.
• Ideally we would be looking for 2-5 years' experience in a similar role of data engineer or analytics engineer.