Overview
Our client is migrating from an on-prem Hadoop-based data platform to a Kubernetes-based infrastructure. They already have an Internal Kubernetes Platform (IKP) focused on microservices but need a platform for large-scale batch processing.
Role
* Design and implement a Kubernetes batch processing stack
* Assess and adapt the existing IKP architecture for batch processing
* Assist with platform deployment and automation scripts
* Troubleshoot network, storage, and security issues
* Implement secret management
Skills Required
* 3-4 years of hands-on Kubernetes experience
* Experience with large banking clients
* Familiarity with multiple Kubernetes distributions (GKE preferred)
* Knowledge of data lakes/warehousing
* Strong Kubernetes security skills
* Experience with CNI/CSI configurations, Helm charts, and Operators
* Containerizing apps (e.g., Elasticsearch, PostgreSQL)
* Linux administration, Ansible, Terraform
* Experience with K8S, Spark, Terraform, CI/CD, Hadoop, and observability tools
* Kubernetes security and Argo experience
Additional Skills
* Strong communication and stakeholder management skills
* Analytical, proactive, and a quick learner
* Comfortable with agile methods and team management
* Resilient and solution-driven