Data Engineering Specialist Job Req ID: 37295 Posting Date: 31 Oct 2024 Function: Data & AI Unit: Digital Location: Snowhill, Birmingham, United Kingdom Salary: competitive plus benefits Why this job matters Our Data & AI unit is building next generation Data platforms and are main contributors to materialise BT Digital strategy. This role is for a Data Engineering Specialist who will serve as a Subject Matter Expert (SME) in utilizing data and analytics services on cloud platforms like AWS and GCP. The primary focus is on supporting Openreach and Networks Data platforms. Overall, the role emphasizes leveraging your expertise to drive effective use of cloud data platforms and ensuring successful adoption and integration within the organization. What you'll be doing - Expert Guidance: Offering specialized knowledge and support to help data platform effectively use cloud-based data and analytics services. - Collaboration: Working closely with Enterprise Architects, Data Architects, CFU (Customer Facing Unit) Data Management teams, Source systems and data engineering teams. This partnership is crucial for the development and implementation of Cloud Data Hub (CDH) solutions specific to Networks and Openreach. - Solution Development: Creating and advocating for cloud design patterns and best practices, ensuring that customers are well-informed and able to adopt these practices efficiently. - Customer Enablement: Facilitating customer adoption of cloud data solutions by providing guidance, developing solutions, and evangelizing effective cloud strategies. - Leading a multi skilled data engineering team through the data development lifecycle. - Recommending the correct technologies to be used and in the most cost effective manner. The skills and experience you will need Key skills identified as: - Experience with analytic warehouse solutions, data movement from data stores into analytic warehouses, and with performance/scalability improvements. - Hands on and deep experience working with AWS & Google Data Products (e.g. BigQuery, Dataflow, Dataproc, etc.). - Ability to identify and gather requirements to define an end-to-end data warehouse solution on a cloud platform. - Work with industry standard ETL Tools (preferably cloud-based solutions) like Ab Initio/Streamsets or equivalent. Design Batch and Real-time data processing pipelines. - Working knowledge of Rshiny/possit, Big Query. Other skills beneficial for the role are: - Provide guidance on FinOps activities for controlling cloud cost using tools such as Cloudability, GCP recommendations etc. - Work with Data Governance Management software like Collibra, MDH, Dataplex or equivalent. - Proactively helping others and bringing people with you towards supporting our strategy. - Degree in Computer Science or equivalent work experience. - Experience with streaming data (e.g. Kafka). - Experience using version control and CD/CI tools (e.g GITLAB, Jenkins, et al.) - Experience writing and deploying Terraform scripts - Communicate complex ideas effectively to stakeholders at all levels. - Knowledge and experience of using Agile. Benefits - Annual On target bonus 10% (personal and company multipliers) - BT Pension scheme; minimum 5% employee contribution, BT contribution 10% - Life Assurance - Direct share scheme - Exclusive colleague discounts on our latest and greatest BT broadband packages - 50% off EE mobile pay monthly or SIM only plans and 50% discount for friends and family on EE SIM only plans - My Discounts gives colleagues access to unbeatable savings on everyday purchases at hundreds of retailers - Discounted EE TV including TNT Sport and the NOW Entertainment membership - Great support for working parents including pay whilst on maternity, adoptive, and paternity leave - Option to join the Healthcare Cash Plan or other benefits such as dental insurance, gym memberships etc. - 25 days annual leave (not including bank holidays), increasing with service with buy holiday option - Volunteering days so you can give back to your local community - Brand new electric vehicle salary sacrifice arrangement, known as 'My EV' With over 175 years of heritage, BT is now the flagship business brand of BT Group. We've brought together our best people and capabilities into a B2B powerhouse serving 1.2 million business customers internationally. We're a global leader for secure connectivity and collaboration platforms for businesses of all shapes and sizes, from big household names and government departments, right through to sole traders and new start-ups. But it's not just the technology that matters, it's what it can do to help them build stronger, smarter, more secure businesses. We value diversity and inclusion and believe in making a positive impact. We connect for good by championing digital inclusion and equipping people, businesses, and communities with digital skills to thrive. As a member of our team, you will be part of an organisation that celebrates difference, fosters innovation and provides you with opportunities to be your best. With millions of businesses relying on us daily, joining BT means you can be part of a diverse and multi-skilled team that makes a significant impact to society. A FEW POINTS TO NOTE: Although these roles are listed as full-time, if you're a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch. We will also offer reasonable adjustments for the selection process if required, so please do not hesitate to inform us. DON'T MEET EVERY SINGLE REQUIREMENT? Studies have shown that women and people who are disabled, LGBTQ, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.