We are looking for an experienced Senior Data Engineer to join one of our client's team.
Role and Responsibilities:
* Develop and maintain scalable data pipelines.
* Create efficient Extract, Transform, Load (ETL) processes to handle data transformation and preparation.
* Ensure data accuracy and integrity across various sources.
* Work with data warehousing technologies to organize and store large volumes of data.
* Optimize data storage and retrieval for analytical and operational purposes.
* Collaborate with data scientists to deploy machine learning models (incl.LLMs) into production environments.Leverage tools like Kubeflow, MLflow to streamline the end-to-end ML lifecycle.
* Ensure seamless integration of ML models with data pipelines.
* Collaborate with business teams to enhance data models that feed business intelligence tools.
* Foster data-driven decision-making by making data accessible to relevant stakeholders.
* Implement software and methodologies for data correction, reconciliation, and quality checking.
* Maintain data consistency across different data sources
Skills and Qualifications:
* Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
* Advanced Python knowledge for data processing and scripting.
* Hands-on experience with one or more cloud services (Azure, AWS, GCP).
* Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
* Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker and Kubernetes.
* Skilled in building strong training datasets for ML.
* Experience with MLOps is a plus.
* Experience with Infrastructure as Code is a plus.
* Strong problem-solving skills and attention to detail.
* Good communication skills, fluent English.
If interested, please get in touch via contact details provided or click “Apply” to forward an up-to-date copy of your CV.
Cavendish (Recruitment) Professionals Ltd are proud to be an equal opportunity employer and we believe that inclusivity begins with the candidate experience.All qualified applicants will receive consideration for employment regardless of, gender, race, age, sexual orientation, religion, or belief.
#J-18808-Ljbffr