Salary: 45,000 - 45,000 GBP per year Requirements:
* Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, utilizing Java, Python, Scala, Spark, and SQL.
* Proficiency in tasks such as writing scripts, extracting data using APIs, and writing SQL queries.
* Ability to collaborate closely with other engineering teams to integrate data engineering components into production systems.
* Knowledge of data cleaning, wrangling, visualization, and reporting, along with an understanding of the most efficient use of associated tools and applications.
* Capable of traveling to client sites when required.
* Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources via ingestion and curation functions on AWS cloud, using either AWS native or custom programming.
* Knowledge of data mining, machine learning, and natural language processing is an advantage.
* Enjoy working within cross-functional Agile teams and familiar with Scrum ceremonies.
* Comfortable designing and building for AWS cloud, with experience in architectures that include Platform-as-a-Service components and possibly server-less and container technologies.
* Preferably experience with AWS tooling for ETL pipelines, data warehouse and data lake design/building, and data movement. Open-source equivalents will also be considered.
* Experience working in teams to design, build, and maintain large scale data solutions and applications using AWS data and analytics services (or open-source equivalents), such as EMR, Glue, RedShift, Kinesis, Lambda, and DynamoDB.
* Familiarity with defining the end-to-end software development lifecycle in alignment with modern AWS best practices, covering areas of data engineering, data science, and product development projects.
Responsibilities:
* As a Data Engineer, I will expect you to work collaboratively within my team to design, build, and maintain robust data solutions.
* You will play a vital role in delivering transformative digital solutions as part of our Digital team, addressing complex business challenges.
* Your expertise will be instrumental in defining best practices for the software development lifecycle in our projects.
* You will be responsible for integrating data engineering components into production systems and working on various data-related tasks.
* You will have opportunities to engage with different tools and cloud technologies, contributing to our cutting-edge projects.
Technologies:
* AWS
* Big Data
* Cloud
* Data Warehouse
* ETL
* Java
* LESS
* Machine Learning
* Python
* SQL
* Scala
* Spark
More:
We are a global firm that thrives on innovation and creating positive change. We work with some of the biggest names across various thriving industries and offer fantastic growth opportunities. With significant investment in our data team in Belfast, we are hiring from Junior right up to Lead positions, all while working in a hybrid model from some of the city's newest and most modern offices.
In addition to competitive salaries and an annual bonus, we offer flexible hybrid working options, private medical insurance, critical illness and life/income protection insurance, a generous pension scheme, and involvement in cutting-edge projects utilizing AWS and other modern technologies. If working within an innovative and growth-oriented environment sounds interesting to you, we encourage you to apply now!