Join a growing team in delivering critical data engineering projects for one of the largest clients in Europe. Lead the transition from legacy systems to cutting-edge Databricks infrastructure. We have an exciting opportunity for a Data Engineer who is an expert with Databricks & SQL to join our client on a 3-month initial contract.
What you’ll be doing
* Lead the migration of data from legacy DB to Databricks.
* Design, implement, and optimise data pipelines using Databricks, PySpark and SQL to serve business-critical operations.
* Collaborate with engineers, data scientists and product teams to manage infrastructure and ensure it aligns with their needs and workflows.
* Communicate effectively with stakeholders, ensuring that all moving parts are on track and all updates are shared in a clear and timely manner.
What experience you’ll need to apply
* Databricks and SQL expert, with a proven track record in data engineering projects.
* Solid experience with Python and PySpark.
* Strong communication skills with excellent English, able to manage complex projects and liaise with multiple stakeholders.
Highly desirable
* Experience with CI/CD pipelines, testing, and DevOps workflows.
* Experience in MLOps and MLFlow, particularly setting up machine learning infrastructure.
What you’ll get in return for your experience
* £450 - 500 p/day outside IR35.
* Good possibility of extension beyond the initial 3-month contract into next year (supporting data science initiatives).
What's next?
Please apply with an up-to-date CV and I will be in touch.
#J-18808-Ljbffr