Job Title: Lead Data Engineer
Job Description
We are looking to build a greenfield team to create a new data platform. Currently, we are in a proof of concept/prototype phase, testing various tools to understand their capabilities. The goal is to ensure efficient connection to different data sources, effective monitoring, and alerting. This will improve efficiency and enable better integration with third parties using similar tools. We need a Lead Data Engineer to guide the team and set standards for frameworks, best practices, and documentation.
Responsibilities
1. Lead the development team by example and upskill others.
2. Set standards for development frameworks, best practices, and documentation.
3. Collaborate with ETL Developers, Architects, and Infrastructure teams.
4. Ensure effective documentation and understanding of development patterns.
5. Consult and work closely with the team to ensure a suitable development environment.
6. Understand and guide monitoring and logging practices, although hands-on Terraform work will be handled by the infrastructure team.
Essential Skills
7. Experience with AWS (Step Functions, Glue, Lambdas, EventBridge)
8. Proficiency in Python
9. Strong background in SDLC and Data Platform experience
Additional Skills & Qualifications
10. Experience with New Relic and Sumo Logic
11. Familiarity with CI/CD tools (Terraform, Github)
12. Experience with Snowflake
13. Agile working practices, particularly Kanban (they work in 2-week sprints)
Why Work Here?
Our company offers a fully remote role with the potential for occasional travel to the Newcastle office, providing opportunities for collaboration and upskilling the team. We offer agile working practices in a large tech company environment.
Work Environment
This role is fully remote, with the potential for occasional travel to the Newcastle office. The initial contract is for 3 months, with scope to extend beyond. The team works in 2-week sprints using Agile and Kanban practices.
Job Type & Location
This is a Contract position based out of Newcastle Upon Tyne, United Kingdom.
Location
Newcastle upon Tyne, UK
Trading as TEKsystems. Allegis Group Limited, Maxis 2, Western Road, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands.