Average Data Engineer salary in Glasgow

Job Title: Data Engineer Location: Hybrid (2 days in office, Glasgow) Day Rate: £390/day (Inside IR35) About the Role: We are seeking an experienced Data Engineer to join our blue-chip client's dynamic team. The ideal candidate will have extensive hands-on experience in data engineering, particularly with Spark, Python, and Java. A background in banking or financial services is highly desirable, as you will work on projects that require domain-specific knowledge. If you have a deep understanding of big data ecosystems, enjoy solving complex problems, and thrive in a hybrid work environment, this role is for you! Key Responsibilities: Develop and optimize scalable ETL pipelines using Spark and other big data technologies.Work on large datasets using HDFS, Hive, and similar tools in the big data ecosystem.Implement and maintain CI/CD pipelines to automate data workflows.Collaborate with cross-functional teams to design data solutions and support ongoing analytics efforts.Ensure data quality, availability, and performance in production environments. Core Skills & Experience Required: Minimum of 8+ years of experience in data engineering.Hands-on experience with Spark 2.x/3.x.Proficiency in Python (or Scala/Java), with a preference for Python.Strong knowledge of HDFS, SQL, and experience in building ETL pipelines.Familiarity with big data ecosystems including data nodes/edge nodes, Hive, and similar technologies.Experience in data wrangling and working with large datasets.Competency with CI/CD pipelines and experience in deploying scalable data solutions. Desirable: Previous experience in banking or financial services industries.Familiarity with financial data structures and regulatory requirements.

Capacity Manager / Data Analyst (SaaS) Hybrid (2 days a week in the office) Edinburgh or Glasgow. Up to £60k + benefits (private healthcare, bonus, extended holidays) Lorien's client, a fast-growing SAAS company, are currently looking to hire a Capacity Manager/Data Analyst to join their Service Delivery Function. The role entails responsibility for ensuring the cloud infrastructure provisioned for SaaS customers meets capacity, performance, and availability goals whilst also dealing directly with customers to help them get the most out of the tools, and utilising general Data Analysis across various business functions to optimize the business. This role offers the opportunity to shape processes within the company and their customers, with the potential for the successful candidate to become a key leader in this area as the company grows. Key Responsibilities: Confidently navigate both the Azure portal and Excel pivot tables.Work with Cloud Operations and Platform Engineering teams to identify improvements in efficiency and resiliency.Execute tasks encompassing analysis, reporting, and developing robust processes for resiliency and capacity management.Provide capacity information for customer presentations to Service Delivery and Account Management teams.Deal directly with end-clients to ensure they are best optimising the product.Working across various functions in the business, where required, to assist with optimising processes, including Cost-Analysis. Skills, Knowledge, and Expertise: Essential: Proficiency in Azure, including Cost Management and Azure Monitor.Solid understanding of how virtual resources are billed.Skilled at working with data, producing reports, and presenting statistical information.Experience with disaster recovery drills (DR testing). Desirable: Experience coordinating/reporting on penetration testing.Understanding of database technologies in a SaaS context, specifically Microsoft SQL Server/Azure SQL.Exposure to security tooling (SIEM).Ability to create effective dashboards / PowerBi. Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.

We have been tasked with recruiting a Principal Data Solutions Architect for a well-established company in the industry. Our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is remote-focused but with an open invitation to their North East headquarters. Role Responsibilities:The Principal Data Solutions Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves:- Leading the design and implementation of innovative cloud data platforms.- Setting standards for detailed solutions documentation and data governance.- Promoting Agile delivery methods across projects.- Managing and mentoring senior technical staff, offering guidance and support.- Overseeing data integration and migration projects to ensure seamless execution.About You:The ideal candidate for the Principal Data Solutions Architect role will possess a blend of technical prowess and leadership skills. The desired qualifications and skills include:- Extensive experience in designing cloud data platforms using Azure, AWS, or exceptional on-premise design expertise.- At least 5 years in data engineering or business intelligence roles.- Proficiency in ETL and data pipeline design, with a technology-agnostic approach.- A solid understanding of data warehouse and data lake principles.- Expert SQL skills and demonstrable data modelling capabilities.About the Company:Our client is a well-established organisation in their field, known for innovation and excellence. Specialising in niche data management and analytics consultancy, they offer the dynamism of a burgeoning company whilst maintaining strong partnerships with longstanding clients. Their commitment is to help clients derive valuable insights from data and achieve their strategic objectives through analytical reporting and consultancy services.Perks and Benefits:The Principal Data Solutions Architect role offers an array of benefits that enhance both your professional and personal life:- Flexibility to work remotely with option of occasional HQ visits to suit, providing a balanced work-life integration.- Opportunity to be a trailblazer in cloud technologies within a leading consultancy.- Access to ongoing professional development and mentoring programs.- Collaborative work environment encouraging innovation and growth.- Open-door policy at the North East HQ, fostering a sense of community.Next StepsTime efficient, two stage interview porocess awaits. If you are a driven and experienced candidate ready to make a significant impact as a Principal Data Solutions Architect, we want to hear from you. Join this exciting journey toward advancing data solutions with a leader in the field. Apply now and take the next step in your professional career.#DataArchitect #CloudSolutions #SQLExpert #DataIntegration #TechLeadership