Senior Data Engineer Data Bricks - PySpark - Python - SQL London or Bedford (x2 days a month) Up to £80,000 My client, one of the largest healthcare organizations in the UK are expanding their data team to help transform their new health care data eco-system. They're embarking on a pivotal migration journey, moving from on-premises to the Azure cloud, and need an experienced Senior Data Engineer to help drive this transformation. This is an opportunity to make a real difference in the healthcare sector, impacting data systems that support critical decisions across the organization. As a Senior Data Engineer, you'll play a key role in their dynamic data team, focusing on building a new healthcare data ecosystem. Your expertise in designing, implementing, and optimizing data solutions will support their migration to Azure and facilitate high-quality data operations. You'll be responsible for complex data structures, data modelling, and analysis, ensuring data is accessible, accurate, and efficient for both technical and non-technical stakeholders. Responsibilities Lead the design and implementation of data pipelines and architectures in Databricks and Azure Data Factory. Develop robust data processing solutions in Python and PySpark, ensuring high efficiency and reliability. Use expert knowledge to design and develop ETL pipelines and cloud data storage solutions that meet business requirements, while also taking into consideration non-functional needs. Work closely with stakeholders across technical and non-technical backgrounds to understand data needs and provide optimal solutions. Ensure data integrity, quality, and accessibility across the new Azure-based healthcare ecosystem. Contribute to data modelling, data analysis, and migration strategies, with a focus on creating sustainable and scalable solutions. Collaborate with the wider data team to establish best practices in data structure, pipeline optimization, and performance tuning. Requirements 6 years in data engineering with a strong focus on cloud data migration projects: Proficiency with Databricks and Azure Data Factory. Advanced knowledge of Python and PySpark. Strong command of SQL for data transformation, cleaning, and manipulation Experience working in CI/CD, DevOps and agile delivery environments In-depth understanding of data structures and data architectures. Solid experience in data modelling and data analysis. Strong collaboration skills, with the ability to engage and influence both technical and non-technical stakeholders effectively. If this sounds like the role for you hit APPLY & a consultant will be in touch