Role Title: AWS Integration - DevOps/Cloud Engineer
Duration: contract to run until 10/10/2025
Location: Knutsford, Hybrid 2-3 days in the office (London and Glasgow may also be options).
Rate: up to £519.74 p/d Umbrella inside IR35
Key Skills/ requirements
1. Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.
2. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.
3. Establish best practices for cloud security, scalability, and performance.
4. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.
5. Ensure high availability, scalability, and fault tolerance of Airflow clusters.
6. Implement monitoring, alerting, and logging for Airflow and related components.
7. Perform upgrades and patches for platform-related components.
8. Oversee capacity planning, resource allocation, and optimization of Airflow workers.
9. Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control.
10. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements.
11. Identify, design, and implement internal process improvements, including re-designing infrastructure f...