Azure Data Engineer Position Overview
We are seeking an experienced Azure Data Engineer to join our team at 83zero Limited. This is a fantastic opportunity for a skilled professional to work on designing, developing, and implementing data platforms that drive our business forward.
Key Responsibilities:
* Data Pipeline Development: Utilize Databricks and Apache Spark to create high-performance data pipelines that transform and load data into Azure services.
* Secure Data Solutions: Develop secure data models, apply quality checks, and implement governance for accuracy and reliability.
* AI/ML Model Integration: Build machine learning models in Databricks ML and Azure ML to deliver predictive insights.
* Performance Optimization: Monitor and enhance pipeline performance for scalability and efficiency.
* Collaboration: Partner with business analysts, data scientists, and DevOps engineers to ensure seamless data solutions.
The ideal candidate will have expertise in Databricks, Apache Spark, and Azure technologies, as well as proficiency in SQL, Python, or Scala. Experience with machine learning tools and techniques is also essential. Strong problem-solving, collaboration, and communication skills are required. Security Clearance (SC) clearance, including a minimum of 5 years of continuous UK residency, is necessary for this position.
Salary Information: £75,000 per annum, plus benefits and bonuses.