Data Engineer – Azure
A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment.
Based in either Derby or London, the successful candidate will be joining a dynamic team that supports corporate and project governance, risk management, and audits across various stakeholders. As part of the Operations Directorate and reporting to the Chief Operating Officer, the candidate will play a crucial role in driving the company’s digital initiatives forward.
Key Responsibilities
As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company’s digital portfolio. Collaborating with a talented team, the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary.
What you’ll be getting up to:
1. Monitoring and recovery of Azure Data Factory and Databricks jobs
2. Proactive monitoring of data quality
3. Becoming a subject matter expert on the company’s data sources and ingestion methods.
4. Assisting in developing and adhering to data governance policies and internal processes
5. Collaborating with the wider team to understand business needs and improve data quality.
6. Developing and maintaining data quality KPIs
7. Maintaining and monitoring user-facing dashboards and internal digital products
8. Updating and patching existing digital software products
9. Documenting root cause analysis outputs
What you can bring to the role:
10. Microsoft Azure experience
11. Proficiency in Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc.
12. Strong Python and SQL skills for data manipulation
13. Experience with Apache Spark and/or Databricks.
14. Familiarity with BI visualization tools like Power BI
15. Experience in managing end-to-end analytics pipelines (batch and streaming)
16. Proficiency in root cause analysis and post-incident reporting in a production environment
17. Excellent interpersonal skills
18. Strong report writing, presentation, and record-keeping abilities.
19. Exceptional communication and stakeholder management skills
Knowledge and Qualifications
20. Relevant degree in Computer Science, Engineering, or related field
21. Certifications such as Azure Data Engineer Associate are desirable.
22. Knowledge of data ingestion methods for real-time and batch processing
23. Proficiency in PySpark and debugging Apache Spark workloads.
What’s in it for you?
24. Annual bonus scheme – up to 10%
25. Excellent pension scheme
26. Flexible working
27. Enhanced family friendly policies
28. Ongoing support with professional and personal development
29. Adoption & Shared Parental Leave benefits
30. Enhanced Armed Forces policies.
31. Long service awards
32. Company Star awards
33. Life assurance
34. Healthcare cash plan
35. 25 days’ annual leave + Bank Holidays + option to buy and sell up to 5 days’ additional leave.
36. Additional days annual leave for long service
37. Season ticket loan.
38. Cycle to work scheme.
39. Free parking
40. Should you be suitable for the role, the full benefits package will be discussed in more detail during your screening call.
Mirai believes in the power of diversity and the importance of an inclusive culture. We welcome applications from individuals of all backgrounds, understanding that a range of perspectives strengthens both our team and our partners’ teams. This is just one of the ways that we’re taking positive action to shaping a collaborative and diverse future in the workplace.