Job Title: Senior Azure Databricks Specialist - Milton Keynes Location: Milton Keynes - 3 days onsite Salary/Rate: £540/ day Inside Ir35 Start Date: 30/10/2024 Job Type: Contract My client is the biggest Rail organisations in the UK. We are seeking a Senior Azure Databricks Specialist to join our dynamic data engineering team. The ideal candidate will bring expertise in Azure Databricks, ADF, Data Lake, SQL, and Python/PySpark, with a proven ability to build and deploy high-quality, scalable data solutions within the Microsoft Azure ecosystem. You will work alongside Product Owners, Architects, and engineering leadership to create impactful data lake solutions, robust data pipelines, and reusable libraries and tools. Job Responsibilities/Objectives Develop and implement scalable data lake solutions using Azure components, including Azure Data Factory (ADF) for ingestion, Data Lake Gen 2 and Azure SQL Server for storage, and Azure Analysis Services for data transformations. Design and develop robust data pipelines leveraging Azure BI services for Big Data platforms. Collaborate closely with Product Owners and Architects to ensure best practices in Azure Data Platform development. Drive standards for software engineering within the team, ensuring high-quality, production-ready code. Refactor code to build reusable libraries, APIs, and tools, contributing to a sustainable, scalable data infrastructure. Required Skills/Experience The ideal candidate will have the following: Mandatory: Strong in Azure Databricks, ADF, Data Lake, Strong SQL, Pyspark/Python Hands-on-experience in developing data lake solutions using Azure (Azure data factory for ingestion, Data lake gen 2 and Azure SQL server for storage, Azure analysis service for transformations, Azure data bricks) Implement a robust data pipeline using Microsoft Stack. Create reusable and scalable data pipelines. Development and deployment of new data platforms. Leverage Azure BI services for development of Big Data Platforms. Work closely with the Product Owners and Architects to develop Azure Data Platforms. Work with the leadership to set the standards for software engineering practices within the team and support across other disciplines. Produce high-quality code that allows us to put solutions into production. Refactor code into reusable libraries, APIs, and tools. If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format. Disclaimer Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies. Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.