Location:City of London, LondonSalary:Up to 110000.00 per annumContract Type:PermanentJob Ref:BBBH111642_1737548506Our client is a global leader in Commodities Trading, with over $50 billion in revenue annually. They're looking for a Lead Data Engineer to join their global trade surveillance team and help to manage the impacts from new business initiatives. Title: Lead Data EngineerSalary: 100,000-110,000Hybrid: 2-3 x a week in Central London officeThey're looking for a Lead Data Engineer to join this newly established Trade Surveillance team, to help them grow this important business area. You will managing a team consisting of local, offshore, and 3rd party resources. Key Requirements:Strong Python and Pyspark experienceExtensive experience with both Data Warehouse and Data Lakehousing is a must, in particular DataBricks, SQL, Azure Data Factory (ADF)Experience working within a Azure environment is essentialDevelopment of ETL Pipelines, working with Big Data technologies, and data architectures is requiredAutomation experience e.g., PyTestExperience with containerized environmentsNice to Have:Capital Markets/Commodities Trading experienceIf you have the above experience and would like to be considered for this position, please click apply now.Please Note: Unfortunately, sponsorship is not an option for this role.