Data Engineer - SC Cleared
Location: Northern Ireland (Belfast). If based in the UK, candidates must be willing to frequently travel to Northern Ireland.
Contract: 6 Months
Day Rate: £500 (Inside IR35)
Your Responsibilities in the Role
1. Design and implement efficient data ingestion pipelines to and from databases and file storage services.
2. Transform data from source to target to ensure data quality and consistency, based on agreed specifications.
3. Build, maintain, and optimise data pipelines to automate data flows and enable real-time data processing.
4. Monitor data quality and implement measures to ensure data accuracy and completeness.
5. Manage and maintain databases to ensure optimal performance and security.
6. Deploy and manage data infrastructure on cloud platforms - primarily AWS.
7. Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Skills and Experience
1. AWS focused, ideally an AWS Certified Data Engineer.
2. SQL, Python, and Spark with experience in metadata-driven ETL/ELT.
3. AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
4. Version Control (Gitlab), CI/CD, and IaC.
5. Familiarity with security and networking principles, especially in AWS deployment.
6. Experience in handling both structured and unstructured data.
7. Complex data migrations.
8. Strong problem-solving and analytical skills.
9. Excellent communication and collaboration skills.
10. Understanding of GIS data models.
Further information is required upon application.
ECS Recruitment Group Ltd is acting as an Employment Business in relation to this vacancy.
#J-18808-Ljbffr