Data Engineer - Azure, Synapse, Snowflake
£420/day inside IR35.
A well-known Council based in central London is recruiting for a Data Engineer to play a pivotal role in shaping how data is harnessed to drive decision-making and enhance services across the council.
You will work within a dedicated product team, designing and developing high-quality data solutions that ensure data integrity, accessibility, and scalability, and be responsible for building and running data products and services that generate high-quality insights, supporting the council's mission to use data effectively in service delivery.
Key Responsibilities:
1. Develop, optimize, and maintain scalable data pipelines and architectures.
2. Ensure high data quality and availability, both internally and externally shared datasets.
3. Build and run data products to provide high-quality insights.
4. Work with modern data engineering tools and cloud-based technologies, such as Azure Data Factory, Synapse, and Snowflake.
5. Implement dimensional data models and work with SQL and NoSQL databases, including time-series databases like InfluxDB.
6. Utilize Python for data pipeline development and visualization.
7. Deploy applications using Docker and contribute to CI/CD pipelines.
You will have extensive experience in developing scalable, reusable data pipelines on cloud services with strong cloud data engineering experience, particularly in Azure Data Factory, Synapse, and Snowflake, with a proficiency in Python, SQL, and NoSQL databases, with a focus on time-series databases (e.g., InfluxDB).
As well as that, you will have knowledge of dimensional modelling and experience deploying applications using Docker. Familiarity with CI/CD operating models and best practices in data engineering would be preferred also.
If interested, please apply as soon as possible as we are sending CVs over to be reviewed within 24 hours. #J-18808-Ljbffr