Lead Data Engineer (x2) - London - Permanent - Hybrid
This role requires hybrid working based in Moorgate, London.
The salary for this role ranges between £65,000 - £74,000.
Lead Data Engineer required for a leading client based in Moorgate, London. Our customer is seeking a well-experienced Lead Data Engineer to come on board to spearhead agile data engineering initiatives, delivering data and insights products.
This role involves understanding the business and IT strategy to align technical solutions with desired outcomes, developing APIs and integrations for data transfer between systems, and providing aggregated data solutions.
Key Responsibilities:
1. Ability to lead complex data engineering projects.
2. Design, code, test, and document data applications.
3. Develop and manage scalable APIs, machine learning endpoints, data integration pipelines, and data storage solutions.
4. Shape the information strategy and platform architecture.
5. Introduce new data engineering tools, frameworks, standards, and processes.
6. Ensure the application of agreed standards and tools.
7. Ensure technical solutions support the accessibility, retrievability, security, quality, retention, and ethical handling of data.
8. Experience with strategies and design approaches for APIs and data pipelines.
9. Experience in designing and implementing data-driven tools and solutions.
10. Proficiency in developing scalable APIs in Python using frameworks like FastAPI or Flask.
11. Proficiency in developing scalable data pipelines in Spark/Python using tools such as Airflow.
12. Experience with SQL, Python, and other scripting/programming languages.
13. Experience with diverse data infrastructure and systems, such as PostgreSQL, SQL Server, Azure Data Lakes, Databricks, and Kubernetes.
14. Strong stakeholder management and communication skills at varying levels.
Interested? Please submit your updated CV to lewis.rushton@crimson.co.uk for immediate consideration.
#J-18808-Ljbffr