Salary: 65,000 - 65,000 GBP per year Requirements:
* A minimum of 3 years of experience in data engineering and ETL development.
* Strong proficiency in T-SQL and Python.
* Solid understanding of data governance and quality assurance best practices.
* Experience designing and deploying business-critical data pipelines.
* Strong analytical skills, with a problem-solving mindset and attention to detail.
* Ability to collaborate effectively with both technical and non-technical stakeholders.
* Desirable:
* - Hands-on experience with Azure services (Azure Data Lake, Azure Data Factory).
* - Development experience using Databricks Notebooks and Databricks Workflows.
* - Familiarity with Git repositories and source control best practices.
* - Experience managing Azure Databricks environments.
Responsibilities:
* Design and implement scalable, high-performance data warehouse models (star/snowflake schema).
* Optimize data storage and structures using Azure Data Lake and Databricks Delta Tables.
* Gather and analyze data requirements for reporting and analytics by collaborating closely with stakeholders.
* Build and maintain ETL processes using Azure Data Factory, Python, and Databricks.
* Ensure data quality, accuracy, and consistency through rigorous testing and validation.
* Develop automated data pipelines to streamline data ingestion and transformation.
* Monitor, troubleshoot, and enhance data workflows for optimal performance and minimal downtime.
* Document data models, ETL workflows, and best practices to enhance knowledge sharing.
* Work within Agile development frameworks, participating in sprint planning and retrospectives.
* Partner with data analysts, data scientists, and business teams to support reporting and analytics needs.
Technologies:
* Azure
* Cloud
* Data Warehouse
* Databricks
* ETL
* Git
* Support
* Python
* SQL
* Snowflake
* Power BI
More:
We are a leading financial services company committed to innovation and data-driven decision-making. As we transition from on-premises SQL Server to a modern cloud-based Azure environment, we are investing in cutting-edge technology to enhance our data capabilities. Our team nurtures a collaborative culture, supports continuous learning, and advocates for the adoption of emerging technologies.
What we offer:
- Competitive salary and benefits package.
- Opportunities to work on cutting-edge data engineering projects in a finance-driven environment.
- Career development opportunities with access to training and mentorship.
- The chance to be part of a forward-thinking, innovative organization.
If you are passionate about shaping the future of data in financial services, we encourage you to apply now!