* Job Title: Data Engineer
* Salary: up to £60,000
* Location: Bath (hybrid)
Data Engineer – Exciting Growth Opportunity
We are searching for an experienced Data Engineer to architect, implement, and maintain sophisticated data solutions. This position requires building end-to-end database systems, orchestrating data pipelines, and ensuring high-performance data operations.
Primary Duties
* Design and construct SQL-driven databases from inception to deployment.
* Develop, administer, and optimize imaging-related data assets.
* Configure and manage data workflows and pipelines to enhance efficiency.
* Oversee and tune data environments, including warehouses and other repositories.
* Establish robust data transformation strategies to meet organizational needs.
* Collaborate with software developers and key stakeholders to define data requirements and solutions.
* Safeguard data accuracy, security, and consistency across all systems.
* Produce and maintain clear documentation for data engineering processes.
* Continuously monitor and troubleshoot data flows to ensure reliability and top performance.
* Employ CI/CD pipelines to automate testing, deployment, and iteration of data solutions.
Essential Qualifications
* Bachelor’s or Master’s degree in Computer Science, Engineering, or a similar field.
* Minimum of three years’ relevant professional experience in data engineering.
* Proven expertise in SQL and Python.
* Hands-on familiarity with cloud-based infrastructures and technology stacks.
* Strong knowledge of large-scale, continuous enterprise architecture.
* Skillful in software development within a Linux environment.
* Practical know-how in containerization (e.g., Docker).
* Proficiency in data transformation tools such as DBT.
* Experience working with orchestration platforms like Prefect.
* Comprehensive understanding of ETL/ELT methods and data warehousing principles.
* Background using CI/CD systems and version control (e.g., Git).
* Excellent analytical skills coupled with strong attention to detail.
* Experience modeling machine-centric data.
* Awareness of best practices in data governance and security.
Preferred Attributes
* Familiarity with Agile development principles.
* Professional exposure to regulated industries.
* Previous work with GUI libraries.
* Experience using Jira for task management and GitHub for source control.