A Lead Data Engineer is required for our client based in Huddersfield. This is a hybrid position with some flexibility, you will be required in the office in accordance with business needs.
Key areas of responsibility;
* Build and develop the client's data engineering capability and practice, providing professional people and technical leadership.
* Take technical responsibility for all stages and/or iterations of a data engineering project, providing method-specific technical advice and guidance to stakeholders.
* Implement best practice and set standards for data engineering, tools, techniques and methods.
* Advise on the application of standards and methods and ensure compliance.
* Lead work to define test conditions based on a review of requirements and specifications.
* Lead the design, development and implementation of complex data flows to connect and transform data from a range of data sources within, and external.
* Lead work to bring together multiple data sources to a conformed model for analysis and where required, reverse-engineer data models from live systems.
* Establish enterprise-scale data integration procedures across the data development life cycle and ensure that teams adhere to these.
* Predict and advise on future technology changes that present opportunities for and/or risks to a product or programme.
* Identify and respond to/develop opportunities to re-use existing data flows between and across teams
* Promote and communicate the value in metadata repositories and set up robust governance processes to keep repositories up to date.
* Proactively lead work and identify opportunities for data quality improvements
Experience required;
* Relevant Data Engineering experience within a Lead position
* Strong leadership skills along with the relevant technical comptencies is a must.
* Knowledge of the concepts and principles of Datamodelling and experience of producing relevant data models across multiple subject areas.
* Experience and skills in designing, building and testing data products and services that are complex or large-scale.
* Experience of developing and implementing data engineering practice and process standards.
* Experience of leading, managing and developing teams, providing technical leadership and career development.
* Experience of building and continually improving data engineering capability and practice.
* Experience of working with a range of data types and structures.
* Advanced skills in developing databases and extracting, transforming, manipulating and modelling data using a range of programming languages.
* Experience of implementing and working with cloud-based data platforms and services (eg, Microsoft Azure, Amazon Web Services)