Reporting to the Principal Solutions Architect, the Lead Data Engineer is a senior role in our analytics department. the Purpose of the role is to build modern, cloud based data pipelines which enable the delivery of data used by internal & external stakeholders, and to play a leading role in establishing a data engineering capability within the Data and Technology Team.
Client Details
Based in Stockport, We are a large-scale biomedical database and research resource, containing in-depth, de-identified genetic and health information from half a million UK participants. The database, which is regularly augmented with additional data, is globally accessible to approved researchers and scientists undertaking vital research into the most common and life-threatening diseases.
Description
The successful Lead Data Engineer will be responsible for but not limited to:
Build data pipelines
Lead data quality initiatives and ensure data integrity.
Develop and manage data pipelines, databases, and data delivery systems.
Provide technical leadership and mentorship to junior data engineers.
Ensure compliance with data protection regulations.
Stay updated with the latest industry trends and technologies.
Contribute to the strategic planning of the Analytics department.Profile
The successful Lead Data Engineer will be able to demonstrate:
A background in building data pipelines and data analysis
Skilled with Azure, AWS, Python, PySpark, SQL
Knowledge of data ar...