Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from ECS Resource Group
Location – Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.
Contract – 6 Months
Day rate – Flexible (Inside IR35)
Your responsibilities in the role
* Design and implement efficient data ingestion pipelines to and from databases and file storage services.
* Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
* Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
* Monitor data quality and implement measures to ensure data accuracy and completeness.
* Manage and maintain databases to ensure optimal performance and security.
* Deploy and manage data infrastructure on cloud platforms – primarily AWS.
* Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Skills and Experience
* AWS focused, Ideally a AWS Certified Data Engineer.
* SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
* Version Control (Gitlab), CI/CD and IaC.
* Familiar with security and networking principles, especially in AWS deployment.
* Experience and understanding of handling both structured and unstructured data.
* Complex data migrations.
* Strong problem-solving analytical skills.
* Excellent communication and collaboration skills.
* Understanding of GIS data models.
Further information required upon application
Seniority level
* Not Applicable
Employment type
* Contract
Job function
* Information Technology, Strategy/Planning, and Analyst
Industries
* IT Services and IT Consulting and IT System Data Services
#J-18808-Ljbffr