We are looking for a Data Architect/Data Engineer to design, develop, and manage data solutions that align with business needs and industry standards. The ideal candidate will have expertise in Java, SQL, Python, and Spark (PySpark & SparkSQL) while also being comfortable working with Microsoft Power Platform. Experience with Microsoft Purview is a plus.
The role requires strong communication skills to collaborate effectively with both technical and non-technical stakeholders. You will be responsible for data governance, data modelling, metadata management, and ensuring compliance with data standards.
Key Responsibilities:
1. Data Architecture & Engineering
* Design and implement scalable data architectures that align with business objectives.
* Work with Java, SQL, Python, PySpark, and SparkSQL to build robust data pipelines.
* Develop and maintain data models tailored to organizational needs.
* Reverse-engineer data models from existing live systems.
* Utilize Microsoft Power Platform for low-code data solutions.
2. Data Governance & Compliance
* Ensure adherence to data governance policies and regulatory requirements.
* Monitor and maintain compliance with data standards and security measures.
* Develop and manage metadata repositories for accurate data tracking and integration.
* Support data assurance processes and provide recommendations for compliance improvements.
3. Data Analysis & Communication
* Conduct data profiling and analyze source systems to derive insights.
* Translate business problems into data-driven designs and solutions.
* Create visual presentations and reports to communicate insights to stakeholders.
* Collaborate across multidisciplinary teams and advocate for data best practices.
4. Problem-Solving & Innovation
* Identify and address data-related issues using analytical and problem-management techniques.
* Explore innovative tools and methodologies for improving data processes.
* Support strategic planning by aligning data solutions with business goals.
* Analyze and mitigate the impact of data standard breaches.
Required Skills & Qualifications:
* Strong proficiency in Java, SQL, Python, SparkSQL, and PySpark.
* Experience with Microsoft Power Platform (PowerApps, Power Automate, etc.).
* Good understanding of data governance, metadata management, and compliance frameworks.
* Ability to communicate effectively with both technical and non-technical stakeholders.
* Experience in data modelling, data profiling, and source system analysis.
* Strong analytical and problem-solving skills with experience in problem management.
* Knowledge of data architecture principles and the ability to align them with business needs.
Nice to Have:
* Experience with Microsoft Purview for data governance and cataloging.
* Exposure to cloud platforms (Azure, AWS, or Google Cloud).
* Experience working in an Agile environment.
Why Join Us?
* Work on cutting-edge data technologies and contribute to innovative projects.
* Collaborate with a team of experienced professionals in a dynamic environment.
* Career growth opportunities with access to training and certifications.
* Competitive compensation and comprehensive benefits package.