Lead Data Engineer ( Databricks )
London - Hybrid - Remote
Permanent
£100,000 - £130,000 plus up to 20% bonus based on performance and commercial contribution
About the Role
We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements.
This is a senior client-facing leadership role, blending hands-on technical delivery with architectural design and pre-sales influence.
You'll be leading high-performing squads, guiding complex transformations, and working directly with senior stakeholders to bridge business needs and engineering excellence — particularly in industries like manufacturing, utilities, and aviation.
This is a key hire to support our clients expanding Databricks practice, to build capacity for future growth.
What You’ll Be Doing
* Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks.
* Architect robust, scalable data platforms using the medallion architecture.
* Translate business requirements into scalable workflows, advising on data governance, quality, and security.
* Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog.
* Guide teams in implementing best practices across engineering, DevOps, and model deployment.
* Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps.
* Provide technical leadership, mentorship, and oversight to squads of Senior and Associate Engineers.
* Collaborate closely with Platform Engineers and Platform Architects to align infrastructure with data needs.
* Contribute to growing the Databricks capability – from delivery frameworks to internal tooling and capability development.
* Lead a team of data engineers, fostering a collaborative and growth-oriented environment.
* Evaluate new data engineering technologies and strategies, assessing their relevance and fit for the organisation’s strategic goals.
* Work closely with the commercial team to scope projects and develop proposals that align technical capabilities with client requirements.
What We’re Looking For
Essential Skills & Experience
* 8+ years in data engineering, with at least 2+ in a technical leadership role
* Proven experience designing and leading Databricks-based data platforms
* Deep understanding of the medallion architecture, data lakehouse design, and transformation workflows
* Hands-on expertise with DLT, Unity Catalog, and model deployment frameworks
* Strong communication and consulting skills – able to lead client conversations and manage stakeholders
* Experience in agile delivery environments and cross-functional teams
* Commercial awareness – comfortable contributing to pre-sales, growing accounts, and engaging with commercial targets
Desirable Skills
* Experience in physical asset-heavy industries (e.g. utilities, manufacturing, aviation)
* Familiarity with platform and DevOps collaboration, especially on AWS or Azure
* Certifications in Databricks or cloud platforms (AWS/Azure)
* Background in consulting or client delivery environments
Why Join Us?
* Join a consultancy that’s doubling down on Databricks with enterprise-grade delivery
* Be the go-to technical leader on projects with real-world business impact
* Shape the future of our Databricks workforce strategy and delivery model
* Career progression into Delivery Lead, Practice Lead, or Pre-Sales Specialist
* Competitive compensation and strong bonus structure, aligned with delivery and commercial impact
To find out more about this high profile Lead Data Engineering position, click apply.