Salary: 45,000 - 70,000 GBP per year Requirements:
* I am looking for candidates with over 10 years of software development experience specifically with Scala. You should have hands-on experience with Apache Spark for both batch and streaming, as well as expertise in data lake and warehouse technologies, along with a strong understanding of open-source data formats such as JSON, Parquet, and Avro. A solid knowledge of distributed systems and cloud platforms, particularly AWS, is essential. Proficiency in CI/CD practices, Docker, Kubernetes, and Terraform is also required. Familiarity with SQL and NoSQL databases, as well as streaming frameworks like Kafka and Flink, will be highly advantageous.
Responsibilities:
* As a Scala Developer, I expect you to develop scalable data processing applications using Scala and optimize ETL pipelines for large datasets. You will work with Apache Spark, Kafka, and Flink to handle both batch and streaming data. Maintaining data lakes and warehouses, particularly with technologies such as Databricks Delta Lake, Apache Iceberg, and Apache Hudi, will be a key part of your role. I also need you to implement real-time streaming solutions and event-driven architectures, while ensuring that data governance, security, and compliance are upheld.
Technologies:
* AWS
* Big Data
* CI/CD
* Cloud
* Databricks
* Docker
* ETL
* Flink
* JSON
* Kafka
* Kubernetes
* NoSQL
* SQL
* Scala
* Security
* Spark
* Terraform
* Data-Science
* Hadoop
More:
If you are passionate about building data-intensive systems and are eager to solve complex challenges using Big Data technologies, this position in the banking sector is perfect for you. I encourage you to apply now and be part of our team that tackles exciting data challenges.