We are looking for an experienced Senior Data Engineer to join one of our client's team.
Role and Responsibilities:
* Develop and maintain scalable data pipelines.
* Create efficient Extract, Transform, Load (ETL) processes to handle data transformation and preparation.
* Ensure data accuracy and integrity across various sources.
* Work with data warehousing technologies to organize and store large volumes of data.
* Optimize data storage and retrieval for analytical and operational purposes.
* Collaborate with data scientists to deploy machine learning models (incl. LLMs) into production environments.
* Leverage tools like Kubeflow, MLflow to streamline the end-to-end ML lifecycle.
* Ensure seamless integration of ML models with data pipelines.
* Collaborate with business teams to enhance data models that feed business intelligence tools.
* Foster data-driven decision-making by making data accessible to relevant stakeholders.
* Implement software and methodologies for data correction, reconciliation, and quality checking.
* Maintain data consistency across different data sources.
Skills and Qualifications:
* Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
* Advanced Python knowledge for data processing and scripting.
* Hands-on experience with one or more cloud services (Azure, AWS, GCP).
* Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
* Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker and Kubernetes.
* Skilled in building strong training datasets for ML.
* Experience with MLOps is a plus.
* Experience with Infrastructure as Code is a plus.
* Strong problem-solving skills and attention to detail.
* Good communication skills, fluent English.
If interested, please get in touch via contact details provided or click “Apply” to forward an up-to-date copy of your CV.
#J-18808-Ljbffr