Position: Senior Data Engineer
Location: Remote (United Kingdom-based)
Salary: £90,000 + shares
Full time position
Our client is seeking a highly skilled and innovative Data Engineer to join their expanding Data Engineering squad within the Product Engineering department. This full-time, remote position offers an exciting opportunity to transition from internal BI-focused initiatives to building cutting-edge, customer-facing data products and enhancing the company's data platform capabilities.
You will play a pivotal role in driving product-focused innovation and developing robust, scalable frameworks to meet the needs of external users while applying software engineering best practices to data engineering.
Key Responsibilities
1. Build and Expand Product Engineering Capabilities
* Collaborate with the Data Platform team to design and deliver customer-facing data products.
* Apply SDLC and CI/CD best practices to ensure seamless product delivery.
* Architect and implement advanced data frameworks and pipelines to support new use cases.
1. Ownership & Strategy
* Lead strategic discussions with internal and external stakeholders.
* Develop strategies to optimise interaction with the Data Platform.
* Build advanced Databricks concepts and semantic layer frameworks.
* Minimise dependencies on other teams through robust architecture and self-sufficient design.
1. Data Quality & Engineering Processes
* Focus on engineering excellence through continuous integration and testing.
* Implement robust systems for data quality, monitoring, and reliability.
Required Skillset
* Bachelor’s or Master’s degree in Computer Science, Data Science, Software Engineering, or a related field.
* 4+ years of experience in data engineering or a similar role.
* Proven experience in designing and implementing large-scale data pipelines and frameworks.
* Hands-on experience with customer-facing data products and platforms.
* Demonstrated ability to work collaboratively with product teams and stakeholders.
* Proficiency in Python (preferred).
* Experience with Java, Go, Scala, or C# (optional).
* Familiarity with React for front-end components.
* Strong experience with Databricks on AWS.
* Knowledge of Azure integrations.
* Expertise in Airflow for orchestration.
* Familiarity with semantic layers such as Cube.js or DBT.
* Proficiency in defining and implementing CI/CD pipelines.
* Strong experience with GitHub for version control and collaboration.
* Solid understanding of relational databases (RDBMS).
* Experience scripting pipelines and ETL processes.