Job Title: Senior Data Engineer
Salary: £70-90k
Location: Manchester
(NO SPONSORSHIP OFFERED IN THIS ROLE)
Job Description: We’re looking for a highly skilled and motivated Senior Data Engineer to join a forward-thinking startup team. If you have a strong background in data engineering, data governance, and metadata management, along with expertise in AWS and Python, we want to hear from you!
Key Responsibilities:
Data Engineering:
* Design, develop, and maintain robust data pipelines and ETL processes for a Dynamic Metadata system and risk index technology.
* Implement real-time data processing solutions to ensure timely and accurate data for the clients product
* Optimize data storage and retrieval processes to enhance system performance and scalability.
AWS:
* Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure.
* Implement best practices for security, monitoring, and cost management within the AWS ecosystem.
* Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions.
Data Governance and Metadata Management:
* Establish and enforce data governance policies to ensure data quality, integrity, and compliance.
* Develop and maintain metadata management frameworks to support dynamic data processing and real-time analytics.
* Collaborate with cross-functional teams to define data standards and ensure consistency across the organization.
Python Programming:
* Develop and maintain Python scripts and applications for data processing, analysis, and automation tasks.
* Implement machine learning algorithms and statistical models to enhance risk assessment and insurance policy calculations.
* Write clean, efficient, and well-documented code to ensure maintainability and reproducibility.
Qualifications:
* Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
* Proven experience as a Data Engineer, with a focus on data governance and metadata management.
* Strong proficiency in AWS services and cloud architecture.
* Advanced skills in Python programming and related libraries (e.g., pandas, NumPy, scikit-learn).
* Experience with real-time data processing frameworks (e.g., Apache Kafka, Apache Spark) is a plus.
* Solid understanding of data security, privacy regulations, and compliance standards.
* Excellent problem-solving skills and attention to detail.
* Strong communication and collaboration skills.
What the client Offers:
* Competitive salary and benefits package.
* Opportunity to work with a dynamic and innovative team at the forefront of insurance technology.
* Professional development and growth opportunities.
* Flexible working environment with a focus on work-life balance.
Ready to Innovate? Apply Now!