" Transform Data at Scale with AWS – Lead the Future of Cloud ETL Engineering! "
Make sure to read the full description below, and please apply immediately if you are confident you meet all the requirements.
Cloud ETL Engineer
Location: Edinburgh / Remote
Contract: 6 months with potential extension / Outside IR35
Overview
Are you a Cloud ETL Engineer with expertise in AWS and data transformation? In this role, you will be instrumental in driving the modernization of a public sector data platform, ensuring the efficient and accurate processing of large-scale data in a cloud-based environment. Your work will involve designing and optimizing ETL workflows, integrating data pipelines, and ensuring data integrity. This is an excellent opportunity to contribute to an impactful project and work with the latest cloud technologies. If you're ready to take your expertise to the next level, apply today!
Key Responsibilities
ETL Design & Development:
Design and implement ETL workflows to process structured data from Oracle databases, applying transformation rules as specified by business and data analysts.
Data Transformation & Cleaning:
Apply data transformation and cleaning logic, ensuring data integrity, accuracy, and adherence to defined retention policies.
Cloud Integration:
Integrate ETL jobs into a cloud data pipeline, ensuring seamless interaction with cloud-based storage and processing services, specifically within AWS.
Optimization & Error Handling:
Optimize ETL jobs for performance, scalability, and error handling to ensure smooth and efficient data processing.
Collaboration:
Work closely with Cloud Data Engineers and other team members to ensure ETL workflows integrate smoothly with overall cloud data infrastructure and meet project objectives.
Monitoring & Troubleshooting:
Continuously monitor ETL workflows, troubleshoot issues, and resolve performance or reliability concerns, ensuring high availability and reliability of data pipelines.
Experience:
3+ years of hands-on experience in ETL workflow development and optimization.
Proficiency with AWS services like Glue, Lambda, and S3.
Strong programming skills in Python, SQL, or similar languages.
Solid understanding of Oracle database structures and cloud data processing.
Experience in data cleaning, transformation, and enforcing retention policies.
Desirable Qualifications
Certifications:
AWS Certified Data Analytics or Solutions Architect certification.
Experience:
Familiarity with large-scale data warehouses in cloud environments.
Experience integrating ETL workflows with data engineering pipelines.
BPSS Clearance: Required (or willingness to undergo process)
We’re excited to see how your experience can contribute to this role. Please send us your CV for further discussion.