We have an exciting new role for Data Engineer to join our CTO Fixed Network team. The team is responsible for migrating applications to the cloud and this is a key role to build and deploy the cloud data pipelines.
You will be building, developing, and maintaining resilient data pipelines to support the extraction, transformation, and loading (ETL) of diverse data sets. Improving data quality, ensuring efficient data processing, and enabling data-driven decision-making across the organisation will be a key part of your role. You'll also be supporting junior members of the team through technical advice and peer reviews. The technology stack focuses around DBT (Data Build Tool), GCP, SQL and Python.
Key responsibilities
1. Develop and maintain scalable ETL processes for collecting, processing, and storing large volumes of telecommunications data within the fixed network domain.
2. Collaborate with cross-functional teams to understand data requirements and implement solutions to meet business needs.
3. Design and optimize data models for efficient storage and retrieval of information within the fixed network domain.
4. Implement data quality checks and validation processes to ensure accuracy and consistency of data.
5. Work within GCP environments to leverage their services for data storage, processing, and analysis.
6. Collaborate with data scientists and insight analysts to facilitate the integration of reporting responsibilities and machine learning models into data pipelines.
7. Monitor and troubleshoot data pipeline issues to ensure continuous availability and performance.
8. Stay updated on industry best practices and emerging technologies to drive innovation in data engineering across the wider team.
The must haves
1. Strong expertise in designing and implementing ETL processes and data pipelines.
2. High level of expertise with GCP or similar cloud platform and services within a data engineering context.
3. Proven experience using DBT as the data transformation tool.
4. Proven experience as a Data Engineer within a large corporation.
The other stuff we are looking for
1. Python and SQL for data processing and data manipulation.
2. Understanding and experience in crafting data models within relational databases.
3. Excellent problem-solving and interpersonal skills.
4. Ability to work in a fast-paced and collaborative environment.
Thanks for your patience and for showing an interest in joining the Virgin Media O2 family.
#J-18808-Ljbffr