Job Title - Lead Data Engineer (SC Cleared)
We are seeking a highly skilled and experienced Lead Data Engineer with active SC clearance to join our team at Cognitive Group | Part of the Focus Cloud Group.
Main Requirements:
* Active SC clearance is mandatory
* Proven experience working within public sector or central government environments, understanding the unique challenges and compliance requirements.
* Expertise in AWS, Apache Spark, Kafka Stream, Glue, and Kubernetes.
* Develop scalable cloud-based data architectures, data lakes, and pipelines for structured/unstructured data.
* Ensure data availability, consistency, and optimization across ingestion-to-consumption stages using ETL/ELT processes.
* Deploy data solutions on AWS.
* Experience managing teams of data engineers.
* Strong experience with Apache Spark or similar big data processing frameworks.
* Solid background in designing and implementing ETL pipelines, data modeling, and managing large datasets.
About the Role:
This is a 12-month contract with the possibility of extension. The role is mainly remote, with occasional onsite visits to London. The rate is up to £500 per day (Outside IR35).
What We Offer:
At Cognitive Group | Part of the Focus Cloud Group, we provide a dynamic and supportive work environment that encourages innovation and collaboration. We are committed to helping our employees grow and develop their careers.