HADOOP BIG DATA DEVELOPER
Start: ASAP
Duration: initial 6-months
Location: Hybrid, once per week in Windsor
Rate: inside IR35, paying up to £425 per day.
Responsibilities:
1. Assess existing big data infrastructure
2. Design and code Hadoop applications
3. Create processing frameworks
4. Extract and isolate data clusters
5. Test scripts to analyse results
Skills required:
1. Build and maintain data pipelines. Expertise in PySpark, Spark SQL, Hive, Python, Kafka
2. Data collection, integration, scheduling, data storage and management, ETL processes
3. Relational and non-relational databases (MySQL, PostgreSQL, MongoDB)
#J-18808-Ljbffr