Lead Data Engineer
Salary/Rate: £100,000 - £110,000 per annum + Bonus
Location: North London
Company: Retelligence
About Retelligence
Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression.
The Role
Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The company is particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a fast-paced environment.
Key Responsibilities:
1. Design, develop, and maintain scalable, data pipelines and infrastructure in a GCP environment.
2. Integrate multiple data sources to ensure seamless data flow across the organization.
3. Build and optimize data models for querying and analytics use cases.
4. Develop fault-tolerant, highly available data ingestion and processing pipelines.
5. Continuously monitor and improve pipeline performance for low-latency and high-throughput operations.
6. Ensure data quality, integrity, and security across all systems.
7. Implement effective monitoring, logging, and alerting mechanisms.
8. Collaborate with product, engineering, and analytics teams to deliver tailored solutions that meet business needs.
About You
1. Strong hands-on experience in data engineering with expertise in Python.
2. Proven track record of building and managing data pipelines.
3. In-depth experience with Google Cloud Platform (GCP) and its associated tools for data ingestion and processing.
4. Familiarity with distributed streaming platforms such as Kafka or similar technologies.
5. Advanced knowledge of SQL.
6. Experience with data orchestration tools.
7. Ability to optimize and refactor data pipelines for improved performance and scalability.
8. Strong problem-solving skills and the ability to thrive in a collaborative, fast-paced environment.
#J-18808-Ljbffr