As a Data Engineer, you will play a pivotal role in developing mission-critical technical solutions focused on delivering robust data services for our National Security clients.
Our client is a premier technology and engineering firm, serving an esteemed roster of clients across National Security, Defence, and Intelligence. By joining us, you will collaborate directly with customers to tackle intricate and unique challenges at the forefront of technology.
As part of the team, your primary responsibility will be managing and enhancing data pipelines that convert raw datasets into actionable insights for our client's National Security customers. These insights will empower downstream analytics and reporting. You’ll work with a variety of data sources, including batch, streaming, real-time, and unstructured data, leveraging distributed computing techniques to handle large-scale datasets effectively.
Key Requirements:
* Proficient in creating Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly transfer data from source systems to data stores.
* Experience with one or more data technologies such as Apache Kafka, NiFi, Spark, Flink, or Airflow.
* Expertise in working with SQL and NoSQL databases, including PostgreSQL, MongoDB, Elasticsearch, Accumulo, or Neo4j.
* Skilled in programming using modern languages such as Python, Java, or Go.
* Familiarity with distributed computing methodologies.
Company Insight:
With over 60 years of expertise, our client is a leader in advancing technologies across sensors, communications, cybersecurity, artificial intelligence, and data science. They empower organisations with actionable insights derived from multi-layered data analysis, shaping the way they think and act. Their mission is simple: to deliver innovative, technical solutions that ensure safety and security for all.
You’ll be part of a team united by a shared ambition. As a business experiencing rapid growth—having doubled in size over the past four years—they are set to double again by 2027! Every voice is heard, and every idea matters. Together, they break boundaries, reinvest in innovation, and empower individuals to make a tangible difference.
Location/on-site requirements:
Based out of Manchester, a majority of your time spent will be at HQ, or at the customers site which is 15 minutes away. They understand not everyone has easy access to Manchester so there's some flexibility around this. If you're living in London, or further afield in the South West of England then you'd be able to go to other sites closer to your home. Ideally our client would like you on-site 2-3 days per week given the nature of the work.
#J-18808-Ljbffr