Data Engineer
Data Engineer - Azure Data Bricks, Azure Data Factory (ADF), Purview, Azure Event Hubs, Messaging, APIs, Medallion Architecture, Delta Tables, Delta Live Tables, Data Wrangling, Agile Methodology - Remote (Midlands) - £55-75k + bens
An experienced Data Engineer is urgently required to take responsibility for helping to define and implement my clients data strategy and for the design, build and implementation of a new Enterprise data platform. The role is a key appointment and viewed as transformational for this highly-successful solution provider with an enviable customer base and an impressive portfolio of products
Data Engineer Role and Responsibilities:
- Work collaboratively with Architects to define, architect and implement an Enterprise data platform
- Build, test and maintain a series of complex data platform pipelines
- Assume full responsibility for Azure Data Engineering including ingestion, transformation, translation, cleansing and publishing
- Play a key role in data modelling, data management and data governance
- Lead the organisation through the adoption and implementation of data platform initiatives to enable data-led business decisions
Data Engineer Skills and Experience:
- Experience of having led a successful enterprise data platform strategy and implementation programme from scratch
- In-depth experience of Azure Data Factory for designing, implementing and maintaining data pipelines
- Detailed knowledge of data platform technologies including Delta Lake/ Medallion Architecture
- Strong experience of Azure Data Bricks including knowledge of Delta Live Tables and Microsoft Purview for data governance
- Solid knowledge of the data wrangling operations within data platforms including reconciliations, PII data, confirm dimensions etc
My clients product suite comprises a series of heavily data-centric solutions and the aim of the business is to employ AI and Machine Learning as the foundation of a series of data-led business decisions. Any experience of working with or implementing AI or Machine Learning in a software products environment would be ideal.
Data Engineer - Azure Data Bricks, Azure Data Factory (ADF), Purview, Azure Event Hubs, Messaging, APIs, Medallion Architecture, Delta Tables, Delta Live Tables, Data Wrangling, Agile Methodology - Remote (Midlands) - £55-75k + bens
Essential Recruitment is an IT recruitment business with an in-depth understanding of the rapidly-changing nature of the Technology market. We build long-term relationships with our clients and candidates based on our core values of Trust, Integrity and Delivery