We are seeking a skilled Lead Data Engineer to work on a large scale Data and Analytics Platform which will enable health and care organisations store, access and analyse data effectively and secure.
Day to day activities
* Lead the design and implementation of scalable, reliable data pipelines and data platforms in the Google Cloud Platform.
* Collaborate with data scientists, analysts, and other engineering teams to define data requirements and optimize data workflows.
* Oversee the deployment and integration of data systems on the Google Cloud Platform.
* Ensure the security, compliance, and performance of Google Cloud Platform data solutions.
* Drive best practices in cloud-based data engineering, automation, and DevOps for data solutions.
* Mentor and guide Senior Data Engineers, contributing to team skill growth and knowledge sharing.
Essential Experience
* Experience in cloud platform as a service (PaaS).
* Ability to communicate between technical and non-technical stakeholders, managing expectations and supporting difficult discussions.
* Ability to support teams to apply a range of techniques for data profiling, undertake source system analysis and bring multiple data sources together.
* Can establish enterprise-scale data integration procedures across the data development life cycle.
* Ability to manage resources to ensure that data services work effectively.
* Can identify areas of innovation in data tools and techniques.
* Ability to establish and maintain standards, remaining informed of industry best practice.
* Can understand concepts and principles of data modelling and produce relevant data models.
* Ability to recognise opportunities for the reuse and alignment of data models.
* Ability to solve problems with the most appropriate actions providing co-ordination of teams to implement solutions.
* Can use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts, collaborating with others as appropriate.
* Have a clear understanding of the technical concepts required for the role and how these fit in the wider technical landscape.
* Ability to review requirements, define test conditions, identify issues and risks and analyse and report test activities.
* Experience with Google Cloud Platform for data and analytics.
* Ability to design an appropriate metadata repository, improve existing repositories, understand a range of tools to manage metadata and advise team members on metadata management.
*Rates depend on experience and client requirements