Digital Data and Technology (DDaT) enables the Home Office to keep the UK safe and secure. We design and build the services that help people apply for visas or passports; support policing and counter-terrorism operations; and protect the UK’s borders.
Data Services and Analytics (DSA) is the part of DDaT which leads the build of data products to integrate data from multiple sources, and then deliver products for business intelligence, reporting and data science. DSA has the ambition to be one of the leading providers of insight services in UK Government and is currently growing significantly with over 300 colleagues, providing services to variety of functions within the Home Office.
In this role, you will identify and deliver new data sources and develop ETL processes, collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems.
We value diversity and provide an open, inclusive, and supportive environment to help you do your best work.
The successful candidate will either be located in Croydon, Liverpool, Manchester, Sheffield or Glasgow. Under Home Office hybrid working practices there is an expectation that you will attend the office for a minimum of 60% of your working hours.
There are two types of Lead Data Engineer positions in the Data Services and Analytics (DSA) team.
There are several positions to lead a team of data engineers working on complex data pipelines, ingesting and transforming data from/to a variety of sources (email, csv, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet). Data pipelines are primarily developed in AWS using a variety of tools and languages including AWS S3, AWS Athena, AWS Redshift, AWS Glue, python and java (Docker / Spring).
There is one position leading the data engineering development for a team of data engineers working on a legacy Oracle data platform and delivering data integration and data retrieval services using PL-SQL. A complex transformation programme is delivering the change of people, process and technology to redesign and transform the processing of the Oracle data outputs onto the strategic data platform. This role would ideally have experience of Oracle and PL-SQL, with the aptitude to move to cloud native tooling such as AWS Athena, python, S3. However, Oracle experience is not essential for this position as the key priority is to manage the people change to ensure the team stability and business continuity throughout the transformation.
As a lead Data Engineer, you will showcase a true passion for data and exhibit expertise in the following areas:
* Manage data sources effectively to improve data quality and make them suitable for analysis.
* Drive and develop new data models and ETL processes, working collaboratively with the analytics team and mapping data to an appropriate matching data model.
* Utilise essential key stakeholder management skills to effectively manage expectations, actively listen and interpret business needs, communicate progress, and navigate challenging conversations, all while fostering a service orientated culture around data.
* Managing the performance of suppliers and the data team to improve capability, as well as creating the roadmap which balances immediate user needs with long-term investment.
* Developing processes to balance data availability, capacity and data archiving, while continually improving processes and efficiency in the acquisition and ingestion of data.
* Identifying data issues in data pipelines and managing their resolution.
* In one of the positions the successful candidate will be responsible for upskilling staff to transition to a new platform. Experience with Oracle is a plus. They must also have leadership experience, including coaching and professional development skills.
Proud member of the Disability Confident employer scheme
Disability Confident
About Disability Confident
A Disability Confident employer will generally offer an interview to any applicant that declares they have a disability and meets the minimum criteria for the job as defined by the employer. It is important to note that in certain recruitment situations such as high-volume, seasonal and high-peak times, the employer may wish to limit the overall numbers of interviews offered to both disabled people and non-disabled people. For more details please go to Disability Confident .