***SC CLEARED***
Data Engineer
3-6 Month contract initially + Extensions
Location: Remote, possibly 1 day per month onsite in Newcastle upon Tyne.
Market Rates via Umbrella
We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a difference. We have a great opportunity for a number of Data Engineers on a long term program of work.
Key Responsibilities:
1. Listen to the needs of technical and business stakeholders, and interpret them
2. Effectively manage stakeholder expectations
3. Manage active and reactive communication
4. Support or host difficult discussions within the team or with diverse senior stakeholders
5. Understand and help teams to apply a range of techniques for data profiling
6. Source system analysis from a complex single source
7. Bring multiple data sources together in a conformed model for analysis
8. Establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them
9. Manage resources to ensure that data services work effectively at an enterprise level
10. Identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption
11. Establish standards, keep them up to date and ensure adherence to them
12. Keep abreast of best practice in industry and across government
13. Understand the concepts and principles of data modelling and can produce relevant data models
14. Work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations
15. Design the method to categorise data models within an organisation
16. Design an appropriate metadata repository and present changes to existing metadata repositories
17. Understand a range of tools for storing and working with metadata
18. Provide oversight and advice to more inexperienced members of the team
19. Ensure that the most appropriate actions are taken to resolve problems as they occur
20. Co-ordinate teams to resolve problems and to implement solutions and preventative measures
21. Use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations
22. Collaborate with others to review specifications where appropriate
23. Show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape
24. Review requirements and specifications, and define test conditions
25. Identify issues and risks associated with work
26. Analyse and report test activities and results
Key Technical Skills & Experience:
* AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure
* Terraform
* Databricks
* Kafka
* Data Lake, Warehouse, Lakehouse architecture and design
* Python/Pyspark
* Data platforms and notebooks: Jupyter, Databricks, Azure
* Gitlab: repository and CI/CD
* Java (Spring Boot) experience is a plus
This is an excellent opportunity on a great project of work. If you are looking for your next exciting opportunity, apply now for your CV to reach me directly; we will respond as soon as possible. Due to the nature and urgency of this post, candidates holding or who have held high-level security clearance in the past are most welcome to apply.
Please note successful applicants will be required to be security cleared prior to appointment, which can take up to a minimum of 10 weeks.
LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work. For security cleared jobs or non-clearance vacancies, LA International welcomes applications from all sections of the community and from people with diverse experience and backgrounds.
Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.
#J-18808-Ljbffr