This year marks the go-live for our major tech transformation. This end-to-end system will give us some amazing benefits and opportunities, including access to more and ‘better’ data. With this context in mind, we are looking for two Senior Data Engineers to play a pivotal role in designing, developing, and maintaining a cutting-edge data platform on Azure using Databricks. Your primary responsibility will be to architect and implement scalable data pipelines, ensuring efficient data processing, storage, and retrieval. You will collaborate closely with analysts and other stakeholders to deliver high-quality data solutions that drive business insights and decision-making.
Duties include (but are not limited to):
* Provide logical and physical data designs/models.
* Design, develop, and maintain scalable data pipelines using Azure Databricks.
* Ensure efficient data ingestion, transformation, and storage processes.
* Work closely with business stakeholders, architects, analysts, and other stakeholders to understand data requirements.
* Implement and enforce data security measures to protect sensitive information.
* Ensure compliance with data governance policies and regulatory requirements.
* Maintain comprehensive documentation of data pipelines, processes, and architectures.
Qualifications:
We are looking for seasoned Senior Data Engineers. If you have a combination of the following skills and experience, we are keen to chat!
* Strong skills in designing and building ETL/ELT pipelines. ETL vs ELT and when to use them.
* DataBricks and Azure proficiency.
* Proficiency in programming languages such as Python, SQL, and PowerShell.
* Familiarity with cloud architecture and best practices, specifically Azure.
* Experience in data modeling, schema design, and data warehousing concepts.
* OLTP and OLAP modeling experience.
* Securing data using RBAC.
* Understanding of data quality frameworks and data governance principles.
* Some experience mentoring junior data engineers.
* Financial Services experience.
* DevOps experience and tooling, specifically Microsoft Azure DevOps.
* Knowledge of Microsoft SQL Server architecture and features.
Additional Information:
* 26 days holiday, and a day off for your birthday (increasing with service to 30 days), plus bank holidays.
* Buy & sell holidays.
* Discretionary annual bonus.
* Matched pension contribution.
* Onsite (Subsidised) Restaurant with amazing menus!
* Life assurance.
* Critical illness cover.
* Health cash plan.
* Private medical insurance.
* Free access to company holiday homes.
* Travel season ticket loans.
* Ride to work scheme.
* Free local gym access.
* Local bar/restaurant discounts.
If you feel you have some of the skills mentioned above, but not all, please do still apply and we would be happy to have a further discussion with you regarding your suitability for the role.
Together embraces diversity and inclusion, and are proud to be an equal opportunity workplace. Not only do we welcome differences – we celebrate it, support it, and really value our colleagues for who they are. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills.
If you feel you'd benefit from any support or reasonable adjustments during any stage of the recruitment process, please don’t hesitate to let us know when completing your application. This information will be picked up by our team, so we can try and put steps in place to help you be at your best through this process.
Please note that all successful applicants will undergo relevant employment reference, financial, and criminal record checks.
#J-18808-Ljbffr