Data Engineer - Azure / ADF / Databricks
This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions.
Client Details
Global Pharmaceutical Services provider
Description
This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers.
Key Responsibilities:
- Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business.
- Explore solutions for optimising the performance of the strategic data platform pipelines, following development design principles
- Develop and scale the cloud data platforms utilising CI / CD pipelines and Terraform.
- Help identify and implement the approach to data modelling our business processes in a manner that allows for agile implementation and improvement.
- Technical implementation of process protocols, quality measures and outcome definitions that allow us to use our data as Real-World evidence.
- Work with the analytics team to understand and build solutions that combine internal insight, patient outcomes, and external data feeds - creating an opportunity to explore big data and machine learning algorithms.
- Support the implementation of the security controls that ensure patient data privacy and full compliance with the Data Protection Act / GDPR
- Help develop and implement the strategic data platform for insights including support to NHS National KPIs and standard operational/financial reporting, Standard Pharma Offerings, Bespoke Customer Solutions, Commercial/Financial Analytics/Planning and Internal Self-Service reporting.
- Identify key processes where BI can link our business operations with our patients.
- Help develop and implement the data acquisition strategy ensuring that data is available when needed, accurate and understood.
Key Technical Skills required:
- Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI
- Extensive experience of working with Azure Data Factory & Databricks
- Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL)
- Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience.
- Microsoft DevOps source control software and development lifecycle software
- Developing and maintaining objects within Data Warehouses / Lakehouses.
- Experience of working with business data domains / data as a product (Data Mesh).
- Metadata management / Data quality
Profile
- Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI
- Extensive experience of working with Azure Data Factory & Databricks
- Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL)
- Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience.
- Microsoft DevOps source control software and development lifecycle software
- Developing and maintaining objects within Data Warehouses / Lakehouses.
- Experience of working with business data domains / data as a product (Data Mesh).
- Metadata management / Data quality
Job Offer
Opportunity to work on a major Data Engineering programme
Opportunity to work with a global organisation
Required skills
- ADF
- SQL
- Azure
- Data Factory
- Data Bricks
- databricks
- synapse
Reference: 52427746
Please note Reed.co.uk does not communicate with candidates via Whatsapp, and we will never ask you to provide your bank, passport or driving licence details during the application process. To stay safe in your job search and flexible work, we recommend visiting JobsAware, a non-profit, joint industry and law enforcement organisation working to combat labour market abuse. Visit the JobsAware website for information and free expert advice for safer work.
Report this jobNot quite what you are looking for? Try these similar searches
Replace a job alert
Replace a job alert
Get Job Alerts straight to your inbox
"Office Assistant jobs in London"
Your Job Alert has been created and your search saved.
'Saved search name'