Job Description
Lead Data Engineer | Defence Consultancy | DV Clearance Required | Up to £100,000 | London
MERITUS are working with a tech focused Defence Consultancy in London looking for a Lead Data Engineer to join work with their MOD customers in London.
If successful you will be responsible for designing, building and maintaining scalable data pipelines and integration solutions. You will work closely with business & customer stakeholders in the wider data team to ensure efficient flow of data across systems.
The role is based in London & requires active DV security clearance.
Main Responsibilities:
* Design, implement, and maintain scalable data architectures, pipelines, and ETL processes.
* Lead and mentor data engineers, ensuring best practices in coding, data modelling, and pipeline optimisation.
* Establish and enforce data quality, compliance, and security standards across data platforms.
* Work closely with data scientists, analysts, and business teams to understand requirements and optimise data solutions.
Skills Required:
1. Expertise in tools like Hadoop, Spark, Kafka, and cloud data services (AWS, GCP, or Azure).
2. Strong knowledge of relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases.
3. Pro...