Senior Data Engineer (Contract)
* Rate: £650 per day
* Contract: 6-month initial contract, with potential for extension
* Location: Remote working
About the Role
Join a FTSE100 client’s dynamic and innovative Data Platform Team as they build a cutting-edge greenfield tech hub. This is an exciting opportunity to shape data solutions that drive business impact in a high-stakes, enterprise environment.
Key Responsibilities
As a Senior Data Engineer, you will:
* Architect and optimize data solutions using Databricks, ensuring high performance and scalability.
* Design and implement Infrastructure as Code (IaC) for efficient deployment and management.
* Collaborate within a DevOps environment, supporting CI/CD processes and driving improvements.
* Build, maintain, and enhance data workflows and pipelines on Azure and Databricks.
* Implement and manage data streaming tools, such as Kafka or other Spark-based technologies.
Essential Skills and Experience:
* Databricks : Advanced expertise in Databricks, including architecture, features, and best practices.
* Coding: Python, PySpark, Spark, SQL
* Azure Data Factory (ADF) & SQL : Strong experience in data integration and querying.
* Infrastructure as Code (IaC) : Proficient in deploying resources via IaC.
* CI/CD and DevOps : Background in build and release environments, with experience in automation tools.
* Azure Cloud : Deep understanding of Azure ecosystem and cloud-native technologies.
* Data Streaming : Familiarity with Kafka or similar technologies for data streaming.
Why Join?
* Be part of a forward-thinking team working on a high-impact greenfield project.
* Work with the latest tools and technology within the Azure and Databricks ecosystem.
* Flexible remote work arrangement, supporting work-life balance.