Description Senior Engineer - Kafka Joining Sainsbury's Tech as a Senior Engineer means becoming part of a leading technology organisation that powers the UK's top multi-channel, multi-brand retailer. We are a community of passionate engineers who are empowered to define and deliver through the use of technology. With a focus on continuous improvement and technical excellence, you'll have the opportunity to shape our engineering vision, drive adoption of best practises, and work with cutting-edge technologies. Not only will you contribute to innovative solutions that impact millions of customers, but you'll also be part of a progressive community that fosters growth, collaboration, and the advancement of engineering expertise. With the support and resources available, you can accelerate your professional development and enhance your skills within a dynamic, agile environment. Join us and be part of a team dedicated to making a meaningful impact within the retail industry while staying at the forefront of technological advancements. We support and run multiple Kafka clusters, Confluent managed and self-managed in AWS. Our AWS Kafka stack utilises Ansible roles to create AMI’s, which are deployed to AWS using Cloud Formation. We provide self-service pipelines to allow engineers to use the Kafka clusters via GitHub actions. We have a number of services running in Kubernetes to manage the cluster, Metrics, Kafka-Connect, Schema Registry, and GUI Tools. We keep track of everything using Git, Jira & Confluence, with daily stand-ups, and empowered teamwork You don’t need experience with everything in this list About the role: Managing and running a Kafka Platform, Confluent and Self-Managed. Creation of self-service pipelines to empower engineers to utilise the cluster quicker Supporting migrations from one cluster to another. Create supporting infrastructure as code and use CI/CD pipelines to deploy your code into the cloud Employ agile ways of working to discover, assess and build products. Assist in architecting systems and products Visualise your product’s behaviour in production What we’re looking for: Required: In depth knowledge of Kafka, Kafka eco-system and administration of a Kafka platform AWS; EC2, EBS, Lambda, Cloud Formation Enthusiastic and motivated team player Be open to learning other languages and platforms – don’t worry, we will support you to do this Nice to have: Terraform Kubernetes Ansible, Cloud Formation Agile Methodology In addition we expect the candidate to: Have an eye for great customer service and delivery Enjoy working on end-to-end stories in a multi-disciplinary team Have previous experience working on Integration projects LI-EB1 Responsibilities We’d all like amazing work to do, and real work-life balance. That’s waiting for you at Sainsbury’s. Think about the scale it takes for us to feed the nation. The level of data, transactions and variety it involves. Then you’ll realise that ours is a modern software engineering environment because it has to be. We’ve made serious investment into a Tech Academy and into setting standards and principles. We iterate, learn, experiment and push ways of working such as Agile, Scrum and XP. So you can look forward to awesome opportunities in everything from AI to reusable tech. Qualifications We are committed to being a truly inclusive retailer, so you’ll be welcomed whoever you are and wherever you work. Around here, there’s always the chance to try something new - whether that’s as part of an evolving team or somewhere else across the business - and we take development seriously and promise to support you. We also recognise and celebrate colleagues when they go the extra mile and, where possible, offer flexible working. When you join our team, we’ll also offer you an amazing range of benefits. Here are some of them: Starting off with colleague discount, you'll be able to get 10% off at Sainsbury's, Argos, TU and Habitat after 4 weeks. This increases to 15% off at Sainsbury’s every Friday and Saturday and 15% off at Argos every pay day. We've also got you covered for your future with our pensions scheme and life cover. You'll also be able to share in our success as you may be eligible for a performance-related bonus of up to 20% of salary, depending on how we perform. Your wellbeing is important to us too. You'll receive an annual holiday allowance, and you can buy additional holiday. We also offer other benefits that will help your money go further such as season ticket loans, interest free car loan of up to £10k, cycle to work scheme, health cash plans, pay advance (where you can access some of your pay before pay day) as well access to a great range of discounts from hundreds of other retailers. And if you ever need it there is also an Employee Assistance Programme, you will also be eligible for private healthcare too. Moments that matter are as important to us as they are to you which is why we give up to 26 weeks’ pay for maternity or adoption leave and up to 4 weeks’ pay for paternity leave. Please see www.sainsburys.jobs for a range of our benefits (note, length of service and eligibility criteria may apply).