Azure Data Engineer
? All our office locations considered: Newbury, London (satellite) & Liverpool; ??We're on the hunt for builders ???. No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms, insurance, finance and mortgages. ????? First and foremost we seek strong Consultants; so if you are ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! ?? The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for 2024 and beyond, we are looking for talented individuals to complement the team of experts we already have working across our business, becoming a pivotal part of our journey, to not just meet, but continuously exceed our client expectations! ?? The Role We are seeking a skilled Azure Data Engineer to join our team, ideally initially on a contract basis, however longer term there is potential to discuss longer term opportunities in the shape of a permanent consultant opportunity. This position is contingent upon winning new business opportunities that are currently in our pipeline, but we can move fast and adapt our selection period to our needs. With this in mind, immediate or quick availability is ideal but not the sole factor we'll consider.This is a typical Data Engineering role in that day to day you will be ingesting large data sets for our clients, which involves designing data pipelines, data integration and transforming data into models for downstream consumption. Key outputs for the role • Develop and maintain data pipelines using Azure Data Factory (ADF), ensuring efficient and reliable data movement and transformation. • Data Modelling using Kimball, 3NF or Dimensional methodologies • Utilize SQL and Python languages to extract, transform, and load data from various sources into Azure Databricks and Azure SQL/SQL Server. • Design and implement metadata driven pipelines to automate data processing tasks. • Collaborate with cross-functional teams to understand data requirements and implement appropriate solutions. • Ensure data quality, integrity, and security throughout the data pipeline. • Troubleshoot and resolve any issues or errors in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. ????????A bit about YOU! As much as we just love working with great, fun people, there are some obvious required Skills and Experience we are going to be seeking out. For this role we'd be expecting to see: • Solid experience in Azure, specifically Azure Databricks and Azure SQL/SQL Server. • Proficiency in SQL and Python languages. • Hands-on experience in designing and building data pipelines using Azure Data Factory (ADF). • Familiarity with building metadata driven pipelines. • Knowledge of Azure Storage, Medallion Architecture, and working with data formats such as JSON, CSV, and Parquet. • Strong understanding of IT concepts, including security, IAM, Key Vault, and networking. • Exposure to Apache Airflow and DBT is a bonus. • Familiarity with agile principles and practices. • Experience with Azure DevOps pipelines. ??The "Nice to Haves": • Certification in Azure or related technologies. • Experience with other cloud platforms (e.g., AWS, Google Cloud). • Knowledge of big data technologies • Familiarity with data governance and compliance frameworks. ??????Your characteristics as a Consultant will include: • Driven by delivering quality work, with a great eye for detail • Takes accountability and ownership of tasks, and finds the best way to solve problems • Excellent communicator who can make sense of and communicate complex ideas to audiences of differing levels of seniority and technical ability • Ability to quickly understand client context and demonstrate expertise in their business • Relationship builder, with the ability to motivate and engage effectively to build trust with clients and colleagues. • An interest in industry trends, emerging technologies, and client's businesses • Ability to take the lead and drive initiatives independently If you don't fit the above criteria exactly but are interested in working for us, get in touch anyway! - we hire people, not a job spec! ? What's in it for you? ?? Salary: £45,000 - £80,000 per annum DOE OR contractor day rates can to be discussed in person???????? A supportive, friendly team - we work hard and enjoy spending time together, whether it's in-person at socials or via silly Slack conversations.?? Dog friendly offices - we're a team of dog lovers, so we've made our offices dog friendly! Longer term our permanent hires attract the following key benefits as well as lighter, wider perks and of course a welcoming, supportive environment in which to develop and thrive is our best offering! Our enhanced benefits package overview ?? If you require any support with your application, please contact Apply for this job
read more