We have an exciting opportunity to support our Manchester based client on a 6 month Data Engineer contract role.
We are looking for a visionary individual to lead the creation of a high-performing, scalable, and compliant data platform. Your role will involve modernizing current ad-hoc data solutions using advanced technologies to generate high-quality data for analysis.
Responsibilities:
* Collaborate with business users to design and implement efficient, secure, and scalable data pipelines using standardized tools and procedures.
* Troubleshoot and resolve data pipeline issues, perform root cause analysis, and implement enhancements to prevent recurrence.
* Take full ownership of the data quality within core datasets and pipelines.
* Work with other teams to identify and resolve data quality issues.
* Ensure data is complete, accessible, and consumable in a fast-paced development environment.
* Maintain data security, integrity, and governance by adhering to company standards and best practices.
* Promote data quality, governance, and security within product and engineering teams.
* Contribute to and evolve best practices for architecture, quality, and non-functional requirements.
* Experiment with new tools and technologies to enhance engineering excellence.
* Design, build, test, and support high-quality code in line with departmental guidelines and testing strategies.
Qualifications:
* 5+ years of experience building big data pipelines in distributed environments using tools such as Airflow, Kafka, Hadoop, AWS S3, AWS Lambda, AWS IAM, Spark, SQL, Python, and DBT.
* Strong data modeling skills (e.g., Dimensional, Data Vault).
* Passionate about Continuous Integration, Continuous Delivery, and Agile methodologies.
* Solid understanding of security principles and secure coding practices.
* Experience with large-scale, well-governed, and compliant systems.
* Proven ability to lead, guide, and coach team members both technically and procedurally.
* Basic knowledge of analytics and machine learning concepts.
* Excellent communication skills, both written and verbal.
* Understanding of cloud security best practices.
* Experience with cloud platforms, preferably AWS.
If you are interested, please apply with your CV and we will be in touch to discuss further