Scala Data Engineer
I am working with an analytics and digital solutions consultancy that partner with clients from several different industries to unlock their potential to become truly data driven. They work to deliver tailored, bespoke systems to fit the needs of their clients with a focus on cloud-based transformations and AI products.
You will be joining this award-winning consultancy during a period of significant growth off the back of winning new projects. They have undergone year on year growth and are backed by a private equity firm who are committed to continuing to help this business grow. You will work on a UK based project but the business have continued to build on their operations in both central Europe and America.
You will be joining a project with a focus on data migration from Hadoop to the cloud, creating robust data pipelines and working with Scala, Spark and other AWS services to process and manipulate data.
As part of this role, you will be responsible for some of the following areas.
Develop big data solutions utilising Hadoop and Apache Spark
Create, develop and maintain robust ETL pipelines using AWS Glue and Scala
Design and implement Scala-based applications for the use of big data processing
Work with other technical members of the team to enhance the performance of code, promoting best practice at all times
Implement data processing and transformation workflows for both unstructured and structured dataTo be successful in this ...