Senior Data Platform Engineer
Location: London
About the client
pioneering global advancements in autonomous food production through cutting-edge robotics and transformative AI technology. Headquartered in London with offices in Berlin and Munich, we are redefining the food industry by integrating AI-driven robotics into every aspect of food creation, production, and operation.
We’re seeking a Senior Data Platform Engineer to help build a modern data platform that powers our AI-driven food solutions. Join a team of top-tier professionals in robotics, AI, and data engineering to revolutionize how food is produced and delivered.
Your Responsibilities
1. Data Platform Development
* Design, build, and maintain scalable data pipelines for ingestion, transformation, and storage.
* Implement a modern data warehouse using AWS and Snowflake.
* Develop backend services to process and transform internal and external data streams.
2. Collaboration & Leadership
* Collaborate with Data Scientists, Engineers, and AI specialists on data platform initiatives.
* Lead efforts to modernize and decentralize the data platform with state-of-the-art technologies.
3. Infrastructure & Automation
* Build CI/CD pipelines to ensure seamless data management and deployment.
* Implement best practices for data lifecycle management, ensuring secure and scalable infrastructure.
4. Data Quality & Governance
* Establish processes for data observability, quality assurance, and governance.
* Develop tools, templates, and processes to optimize data platform operations.
What We’re Looking For
* Experience: 5+ years of experience in data engineering, with a proven track record of building data warehouses and data lakes from scratch.
* Cloud Expertise: In-depth knowledge of AWS services, including networking, security, and identity management.
* Data Technologies: Expertise in Snowflake, SQL/NoSQL databases, and modern data tools.
* Programming Skills: Advanced proficiency in Python, with experience in Docker, Kubernetes, and CI/CD tools.
* AI/ML Familiarity: Exposure to Data Science or Machine Learning frameworks is a plus.
* Mindset: Solutions-oriented, collaborative, and passionate about scaling and optimizing data platforms.