Job Title: Azure Data Engineer (Databricks & Data Lakehouse Specialist)
Location: Fully Remote
Employment Type: Permanent, Full-Time
Are you a data-driven professional with a passion for building and optimising cloud-based data solutions? Do you have a knack for designing seamless ETL processes and working with Azures cutting-edge data tools? Join us as an Azure Data Engineer and become a key player in a fully remote team committed to building a robust data lakehouse environment using Azure Databricks.
This is an exciting opportunity to get hands-on with Azure data engineering while contributing to a large-scale AWS to Azure migration program. If youre ready to innovate and build resilient data systems in the cloud, we want to hear from you!
What Youll Be Doing as the Azure Data Engineer:
* Design & Build Data Pipelines: Create and maintain ETL/ELT pipelines to ingest, cleanse, and transform data from multiple sources, using Azure Databricks, Azure Data Factory, and more.
* Develop Azure Data Lakehouse: Set up and manage the data lakehouse environment on Azure, optimising it for analytics and supporting both structured and unstructured data.
* AWS to Azure Migration: Be a pivotal part of the migration program, helping to transfer and transform data assets from AWS S3 and Redshift to Azure Data Lake Storage and Synapse.
* Ensure Data Quality & Governance: Implement data quality checks, ensure regulatory compliance, and support data governance practices.
* Optimise for Performance: Monitor and fine-tune data pipelines, cluster management, and data storage to ensure optimal performance and scalability.
What Were Looking For from our Azure Data Engineer:
* Azure Data Expertise: Proficiency in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Delta Lake.
* Databricks & Spark: Experience with Databricks notebooks, Spark, and Delta Lake for data transformation and analytics.
* ETL/ELT Skills: Strong background in building ETL/ELT workflows, with knowledge of Python, SQL, and Spark SQL.
* Cloud Migration Experience is advantageous: Direct experience with AWS to Azure data migrations, including data replication and re-platforming strategies.
* Data Quality & Governance: Familiarity with data validation techniques and security standards within cloud environments.
* Collaboration & Communication: A team player who can translate technical concepts for stakeholders and collaborate effectively with data analysts and data scientists.
Ready to take the next step in your data engineering career? Apply today and join a team thats transforming data infrastructure in the cloud!