Senior Data Engineer (Databricks)
Application Deadline: 8 November 2024
Department: Delivery
Employment Type: Full Time
Location: Bristol, UK
Reporting To: Tom Bruce
Compensation: £60,000 - £85,000 / year
Description
Role - Senior Data Engineer (Databricks)
Salary - £60,000 - £85,000 (DOE)
Location - Hybrid; aiming to be on-site 2-3 days per week in our Bristol HQ
A bit about us…
Snap Analytics is a high-growth data analytics consultancy with offices in the UK and India, we work with enterprise clients to simplify complex data and drive business value. We’re customer-centric in our approach and dedicated to helping organisations achieve their strategic goals through innovative cloud analytics solutions.
We pride ourselves on using our innovative Snap 360 delivery framework, combined with a strong culture of teamwork and knowledge-sharing, to consistently deliver exceptional results and ensure 100% customer satisfaction.
Joining Snap at this exciting stage of growth offers a unique opportunity to make a significant impact. As a rapidly expanding consultancy, you'll have the chance to shape our direction and play a key role in driving our success and strategy forward.
A bit about the role...
As a Senior Data Engineer at Snap, building on your wealth of experience, you’ll have the opportunity to explore the latest technologies within analytics; from ETL and Modern Cloud Data Platforms, to BI and ML/AI tools.
We’ll also look to you to lead in client interaction and engagement, support and mentor more junior members of the team and assist in building internal capabilities for use with clients.
Here’s a breakdown of what you’ll be doing…
Data Migration & Integration:
* Lead and manage complex data migration projects, ensuring smooth transitions from multiple data sources to cloud environments.
* Design and implement efficient ETL/ELT processes for seamless integration between systems.
Data Warehousing:
* Design, build, and optimize cloud-based data warehouses (e.g. Databricks (must have), Snowflake, AWS Redshift, Google BigQuery, Azure Synapse) to support advanced analytics and reporting needs. Ensure data accuracy, security, and compliance.
Data Modelling:
* Develop and maintain robust data models (star, snowflake, etc.) that ensure high-quality, scalable, and efficient data storage and retrieval.
* Implement best practices for data modelling to support analytics and reporting requirements.
Cloud Infrastructure:
* Develop and maintain scalable, robust, and cost-effective cloud-based data architectures on platforms such as AWS, Azure, and GCP.
* Provide best practices for data storage, governance, and access control.
Pipeline Development:
* Build, automate, and monitor data pipelines that handle large volumes of structured and unstructured data.
* Implement best practices for data cleansing, transformation, and enrichment.
Collaboration & Stakeholder Management:
* Collaborate with data architects, data scientists, and business teams to understand requirements and translate them into effective data engineering solutions.
* Communicate technical challenges and provide insights on data-driven solutions.
Performance Optimization:
* Analyse and improve the performance of data systems and pipelines, ensuring low-latency data access, high availability, and optimized cloud resource usage.
Mentorship & Leadership:
* Mentor junior engineers, fostering a culture of collaboration and continuous learning.
* Provide technical guidance, code reviews, and best practices to elevate the overall team performance.
Innovation & Continuous Improvement:
* Stay updated with the latest trends and technologies in data engineering, cloud platforms, and big data to propose innovative solutions for clients' evolving data needs.
This role is for you if you have...
* Proven experience (5 years+) as a data engineer with a focus on data migration, integration and cloud-based data warehousing working with big data for enterprise organisations.
* Expertise in building data architecture on cloud platforms such as AWS, GCP or Microsoft Azure.
* 5+ years of experience of ETL/ELT design and development using tools like Matillion, Informatica, SAP Data Services, Talend and Cloud Data Platforms including Databricks (must have), Snowflake, Redshift or BigQuery.
* A deep understanding of data modelling principles and techniques (e.g., star schema, snowflake schema), and experience in developing optimized models to support analytics and reporting.
* Experience with version control, CI/CD pipelines, and containerization tools (e.g., Git, Jenkins, Docker, Kubernetes).
* Strong knowledge of relational and non-relational databases and hands-on experience with cloud data warehouse including AWS Redshift, Google BigQuery, Azure Synapse.
* A 2:1 University degree or above (or equivalent other).
* Excellent communication skills, with the ability to work collaboratively with both technical and non-technical stakeholders.
* Strong problem-solving skills, with the ability to troubleshoot complex data issues and deliver optimized solutions.
It’s useful (not a must) if you have exposure to…
* Data Science and Machine Learning.
* Tools like dbt and Dataiku.
Something to note…
Here at Snap, our values drive us. So, aligning with them is incredibly important.
Our values are – be Smart, be Nice, be Accountable, be Passionate. Be SNAP.
What we offer...
* Annual Leave - Everyone needs a healthy, happy and productive life that only comes with regular R&R. We offer a competitive annual leave allowance plus public holidays.
* Flexible, Hybrid Working - We believe variety is the spice of life, so we encourage a healthy mix of office based and remote working to facilitate a great work/life balance.
* Financial Wellbeing - As well as a competitive salary, we offer contributory pension schemes to allow for future financial security.
* Health & Wellbeing - The well being of everyone at Snap is of great importance to the business, all employees from day 1 are entitled to private medical health insurance through Vitality.
* Profit Share - Enjoy a share of our profits with a bonus at the end of each successful year.
* Technical Training - Dedicated time for ongoing technical training and certification on the modern data stack.
* Monthly Social Club - From surfing to pottery, once a month there is always something new to try.
* UK Electric Car & Cycle to Work Schemes - We promote healthier lifestyles and reduced environmental pollution. These schemes are our way of trying to make a difference.
* Enhanced Maternity & Paternity Time Off - We recognise that having a baby is an important and exciting time, so our policies are designed to make those early days as flexible as possible when it comes to juggling work commitments with the demands of a new family.
#J-18808-Ljbffr