Data Engineer - Bristol. Due to growing demand for my clients' Data and Analytics services, we are seeking to recruit a number of senior data engineers
The Role
As part of the role you will:
* Work with developers, managers, and business stakeholders to understand and define components of the data landscape and how it relates to the data strategy
* Understand and translate end-user requirements into designs and delivery plans for effective data solutions
* Design, develop, execute, and maintain highly automated data pipelines using cloud technologies
* Analyse and resolve data quality issues
* Build, maintain, and support data workflows and the necessary infrastructure as part of a data and analytics delivery team
* Identify opportunities for improvement and promote theses through the team
* Actively mentor and develop others in the team and inspire them through commitment and enthusiasm
* Foster and demonstrate an inclusive team culture focusing on service excellence and exceptional performance
* Take knowledge or experience and translate into new ideas or solutions
Qualifications
Skills required for this role are:
* Proven ability to work with with:
* Databricks
* Azure Data Factory
* Azure Data Lake
* Azure Synapse (and data warehousing approaches) or SSIS
* Azure Analysis Services
* Experience in programming languages such as:
* SQL
* Python
* Spark
* DAX
* A good understanding of Devops practices:
* CI/CD (Azure DevOps preferable)
* GIT and Version Control
* Exceptional communication skills, both written and verbal – able to translate complex technical subject matter into easily understood presentations and written documentation for mixed technical audiences.
Desirable:
* MLFlow and other MLOps / Machine Learning Engineering processes to support advanced analytical use cases
* Data modelling including Kimball
* Container technologies such as Kubernetes and Docker
* Experience translating designs of Azure data solutions into action
* Analysis/requirements gathering, solution design, and implementation of data platform and Azure technologies
* Experience in collaborating in multi-disciplinary teams, including software engineers, DevOps and infrastructure teams, data scientists etc.