Your Role:
We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer
(SME) to join our dynamic Payment Gateway team in Fleet UK for a Full time Hybrid role. As
an SME you will serve as a subject matter expert providing technical leadership guidance
and best practices across the team.
You will play a critical role in designing developing and implementing complex data
solutions on cloud platforms (primarily AWS) ensuring they meet the highest
standards of quality scalability and performance.
Serve as a subject matter expert in cloud data engineering providing technical
guidance and mentorship to the team.
Drive the design development and implementation of complex data pipelines and
ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda
AWS S3 AWS Redshift AWS EMR).
Develop and maintain data quality checks data validation rules and data lineage
documentation.
Collaborate with data analysts data scientists business stakeholders and product
owners to understand their data needs and translate them into innovative and
effective technical solutions.
Troubleshoot and resolve complex data quality issues performance bottlenecks and
production incidents.
Participate in the evaluation selection and implementation of new data technologies
and tools.
Adhere to and champion best practices in data engineering including data security
privacy and governance.
Define and enforce data engineering standards processes and best practices within
the team.
Develop and maintain CI/CD pipelines for data engineering workflows using tools like
Jenkins.
Automate data ingestion transformation and loading processes.
Work closely with DevOps teams and other engineering teams to ensure smooth
deployment and operations of data pipelines.
Experience working on Linux platforms and managing data on Linux servers.
Stay abreast of the latest advancements in cloud computing and data engineering
technologies.
Contribute to the development and improvement of the team's overall performance
and efficiency.
May lead small projects or initiatives within the data engineering team.
Your Profile
7+ years of experience in data engineering with a strong focus on cloud platforms
(preferably AWS).
3+ years of experience as a Senior Engineer or SME in a data engineering role.
Solid experience working on Linux platforms. Experience with CI/CD pipelines and
tools like Jenkins.
Strong understanding of DevOps methodologies and principles.
Solid understanding of data warehousing data modeling and data integration
principles. Proficiency in at least one scripting/programming language (e.g. Python
Scala Java). Experience with SQL and NoSQL databases.
Familiarity with data quality and data governance best practices.
Strong analytical and problem-solving skills.
Excellent communication interpersonal and presentation skills.
Desired Skills: Experience with containerization technologies (e.g. Docker
Kubernetes). Experience with data streaming platforms (e.g. Kafka Kinesis).
Experience with data visualization and business intelligence tools.
Experience with Agile development methodologies.
AWS Certifications (e.g. AWS Certified Data Analytics - Specialty AWS Certified
Solutions Architect)