Salary: 55,000 - 55,000 GBP per year Requirements:
* We are looking for candidates with proven experience in Python, PySpark, and Databricks. Experience with data visualization tools is ideal, as well as working within a cloud environment, preferably Azure.
Responsibilities:
* As a member of our team, you will design, develop, and implement end-to-end data pipelines while incorporating complex business logic in collaboration with stakeholders. You will also be responsible for migrating existing data pipelines from an on-prem Hadoop environment to Azure. Additionally, you will conduct thorough data quality checks to ensure data integrity throughout the pipeline lifecycle and mentor junior team members on data engineering principles and best practices.
Technologies:
* Azure
* Cloud
* Databricks
* Hadoop
* Python
* PySpark
More:
We are thrilled to be working exclusively with our long-standing client, who is building a new data engineering team and looking to add four Engineers at intermediate to senior levels. If you enjoy problem-solving and have experience implementing end-to-end data pipelines, this is the opportunity for you. We offer a competitive salary of up to £55k, along with medical and dental care, a pension, a bonus, and a work from home allowance.