Manage, analyze, extract, and transform large data sets to drive business decisions.
Organize and advance customers platforms, utilizing Databricks, in preparation for embarking on a platform-wide AI transformation program.
Design, develop and implement Databricks providing advanced analytics capabilities.
Design reusable data pipelines. Ingest, curate & process data with efficient data pipelines built using Azure services.
Write design & technical documentation. communicate effectively with the end clients.
Work directly with internal/external stakeholders to gather requirements, deliver working POCs, design and develop advanced data solutions.
Collaborate with technical team members across Databricks, Microsoft Fabric and Azure Services
Primary expertise in Databricks and understanding of Microsoft Fabric's unified analytics platform, including familiarity with One Lake, Fabric Spark. (8-10+ years of Azure, Databricks experience)
Expert level experience of Azure Integration Services products, including Azure Databricks, Data Factory, API Manager.
Experience handling and transforming large quantities of data using T-SQL, SQL, PySpark, or Python.
Extensive experience working with big data.
Hands on experience of Databricks.
Strong understanding of MS Fabric
Understanding of agile process, Automation tools & Azure DevOps a plus.
Experience working closely with clients to understand business challenges and needs.
Problem solving and creative approach to tackle challenges.
A team player and effective communicator.