Job Description
Title: Azure Data Engineer
Location: Manchester City Centre (3 days a week onsite)
Salary: £50,000 - £65,000 DOE
The Role
As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining the data infrastructure. Leading a small team, you will work closely with business stakeholders to ensure the availability, reliability and performance of data pipelines, enabling data-driven decision-making across the organisation.
Role Responsibilities
As a Data Engineer, your role will include, but is not limited to:
* Design, develop, and maintain scalable data pipelines using Python, Azure Data Factory, and other relevant tools.
* Collaborate with business stakeholders to understand data requirements and integrate diverse data sources into a unified data lake or warehouse. Perform data cleansing, transformation, and enrichment to ensure data quality and consistency.
* Monitor and optimise data pipelines for performance, scalability, and cost-effectiveness.
* Implement and maintain data security and compliance measures to protect sensitive information.
* Create and maintain clear documentation for data pipelines, data schemas, and processes.
* Diagnose and resolve data-related issues promptly, ensuring minimal downtime.
* Implement automation scripts and workflows to streamline data engineering processes.
* Liaise with third parties, providing relevant data to support project delivery, system maintenance and change programmes.
* Lead the data team to deliver against their objectives and key performance indicators, including scheduling of work and maintaining high quality performance.
* Create and maintain relevant KPI reports to monitor and track the data team’s progress against data requirements and delivery.
Person Specification
* BSc in Computer Science, Information Technology or a related field.
* Previous experience in data engineering or similar role.
* People management experience with proven track record of successfully leading a small team.
* Strong proficiency in Python programming for data manipulation and transformation.
* Knowledge of data modelling and database design principles.
* Familiarity with ETL (Extract, Transform, Load) processes and tools.
* Strong problem-solving and troubleshooting skills.
* Excellent communication and teamwork abilities.
* Attention to detail and a commitment to data quality.
Nice to Have Skills:
* Certification in Azure Data Engineering or a related field.
* Familiarity with data warehousing concepts and platforms.
* Experience with data visualization tools (e.g., Power BI, Tableau).
* Experience with Azure cloud services, including Azure Data Factory, Azure Data Lake Storage, Azure Databricks, and Azure SQL Database.
#J-18808-Ljbffr