Data Pipeline Developer
Here at Cognizant, we work with clients across the UK’s public sector to help modernise their businesses. As one of our largest growing business sectors, we guide our government, defence and healthcare clients through their digital transformation journeys.
IPM is dedicated to helping businesses to solve their hybrid cloud integration, API management and Process Automation conundrum.
We are currently recruiting a Data Pipeline Developer to join our IPM (Integration and Process Management) team. In this role, you will be responsible for designing, developing, and maintaining complex data pipelines using Microsoft Azure Data Factory (ADF) and Azure Synapse Analytics. You will work closely with data engineers, data analysts, and business stakeholders to understand their data needs and translate them into efficient and scalable data solutions.
The role is based in Oxford and you will be expected to travel onsite 2 to 3 times a week.
Some of your key responsibilities will be to:
* Design, develop, and implement data pipelines using Azure Data Factory (ADF) and Azure Synapse Analytics.
* Develop and maintain data ingestion pipelines, data transformation logic, and data quality checks.
* Optimize data pipelines for performance, scalability, and cost-effectiveness.
* Troubleshoot and resolve data pipeline issues.
* Collaborate with data engineers, data analysts, and business stakeholders to understand their data requirements.
* Document data pipelines and processes.
* Participate in code reviews and provide constructive feedback.
* Stay up-to-date on the latest advancements in data pipeline technologies.
* Mentor junior data engineers and provide guidance on best practices.
The experience you will need to demonstrate:
* Relevant experience in data engineering or a related field.
* Hands-on experience with Azure Data Factory (ADF) and Azure Synapse Analytics.
* Proficiency in SQL, Python, and other relevant scripting languages.
* Experience with data warehousing and data lake concepts.
* Experience with data integration patterns and best practices.
* Strong analytical and problem-solving skills.
* Excellent communication and interpersonal skills.
* Ability to work independently and as part of a team.
#J-18808-Ljbffr