Lead Data Engineer
Harvey Nash London, United Kingdom
Posted: 2 days ago
Job Type: Hybrid Job Permanent
Salary: Up to GBP110,000.00 per annum
Our client is a global leader in Commodities Trading, with over $50 billion in revenue annually. They're looking for a Lead Data Engineer to join their global trade surveillance team and help to manage the impacts from new business initiatives.
Hybrid: 2-3 x a week in Central London office
As a Lead Data Engineer, you will join this newly established Trade Surveillance team to help grow this important business area. You will manage a team consisting of local, offshore, and 3rd party resources.
Key Requirements:
* Strong Python and Pyspark experience
* Extensive experience with both Data Warehouse and Data Lakehousing is a must, particularly with DataBricks, SQL, and Azure Data Factory (ADF)
* Experience working within an Azure environment is essential
* Development of ETL Pipelines, working with Big Data technologies, and data architectures is required
* Automation experience, e.g., PyTest
* Experience with containerized environments
Nice to Have:
* Capital Markets/Commodities Trading experience
If you have the above experience and would like to be considered for this position, please click apply now.
Please Note: Unfortunately, sponsorship is not an option for this role.
#J-18808-Ljbffr