Main Purpose of the Role & Responsibilities in the Business:
As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible for designing and developing data processing and data persistence software components for solutions that handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems. You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments.
Your responsibilities will include:
1. Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test, and defect resolution.
2. Working with Architects and Lead Engineers to ensure the software supports non-functional needs.
3. Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remain high. Leads by example in code quality.
4. Working with operations teams to ensure operational readiness.
5. Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.
6. Coaching and mentoring team members.
Minimum (Essential) Requirements:
* Strong software development experience in one of Java, Scala, or Python.
* Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.
* Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment.
* Proficient in SQL and SQL extensions for analytical queries.
* Solid understanding of ETL/ELT data processing pipelines and design patterns.
* Aware of key features and pitfalls of distributed data processing frameworks, data stores, and data serialization formats.
* Able to write quality, testable code and has experience of automated testing.
* Experience with Continuous Integration and Continuous Deployment techniques.
Desirable Requirements:
* Experience of performance tuning.
* Experience of data visualization and complex data transformations.
* Experience with streaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products.
* Expertise in continuous improvement and sharing input on data best practice.
So what are you waiting for? Let’s write the next incredible chapter of our story together.
About Us
At Kainos we use technology to solve real problems for our customers, overcome big challenges for businesses, and make people’s lives easier. We build strong relationships with our customers and go beyond to change the way they work today and the impact they have tomorrow.
Our two specialist practices, Digital Services and Workday, work globally for clients across healthcare, commercial, and the public sector to make the world a little bit better, day by day.
Our people love the exciting work, the cutting-edge technologies, and the benefits we offer. That’s why we’ve been ranked in the Sunday Times Top 100 Best Companies on numerous occasions.
#J-18808-Ljbffr