Our client an exceptional start-up are looking for a Data Engineer to join their team on a permanent basis.
This will be a hybrid role with 1 day per week onsite.
The role:
The role of the Data Engineer is to deliver data products supporting a wide range of business demands. Working with the Data Architect, the data engineer will be responsible for the implementation and management of data solutions on our cloud infrastructure. The engineer will create and maintain data pipelines, manage storage solutions, undertake data processing, data modelling and enabling data to support effective decision making.
What they are looking for:
* Proven experience in creating and managing data pipelines, integrating data sources, and performing ETL operations using ADF
* Proficiency in Python with extensive experience in using PySpark for data processing, data manipulation, and building scalable data pipelines OR Strong coding skills in Scala, including experience with functional programming
* Hands-on expertise with Databricks, particularly in managing data workflows
* Experience in using Synapse for data analytics and data integration, as well as proficiency in SQL and other data tools
* Solid experience in managing and organizing datasets in ADLS
* Strong understanding in both batch and stream data processing
* Azure DevOps knowledge
* Strong understanding of RDBMS concepts