Job Description
We are looking for a Data Architect/Data Engineer to design, develop, and manage data solutions that align with business needs and industry standards. The ideal candidate will have expertise in Java, SQL, Python, and Spark (PySpark & SparkSQL) while also being comfortable working with Microsoft Power Platform. Experience with Microsoft Purview is a plus.
The role requires strong communication skills to collaborate effectively with both technical and non-technical stakeholders. You will be responsible for data governance, data modelling, metadata management, and ensuring compliance with data standards.
Key Responsibilities:
1. Data Architecture & Engineering
o Design and implement scalable data architectures that align with business objectives.
o Work with Java, SQL, Python, PySpark, and SparkSQL to build robust data pipelines.
o Develop and maintain data models tailored to organizational needs.
o Reverse-engineer data models from existing live systems.
o Utilize Microsoft Power Platform for low-code data solutions.
2. Data Governance & Compliance
o Ensure adherence to data governance policies and regulatory requirements.
o Monitor and maintain compliance with data standards and security measures.
o Develop and manage metadata repositories for accurate data tracking and integration.
o Support data assurance processes and provide recommendations for compliance improvements.
3. Data Analysis & Communication
o Conduct data profiling and analyze source systems to derive insights.
o Translate business problems into data-driven designs and solutions.
o Create visual presentations and reports to communicate insights to stakeholders.
o Collaborate across multidisciplinary teams and advocate for data best practices.
4. Problem-Solving & Innovation
o Identify and address data-related issues using analytical and problem-management techniques.
o Explore innovative tools and methodologies for improving data processes.
o Support strategic planning by aligning data solutions with business goals.
o Analyze and mitigate the impact of data standard breaches.
Required Skills & Qualifications:
* Strong proficiency in Java, SQL, Python, SparkSQL, and PySpark.
* Experience with Microsoft Power Platform (PowerApps, Power Automate, etc.).
* Good understanding of data governance, metadata management, and compliance frameworks.
* Ability to communicate effectively with both technical and non-technical stakeholders.
* Experience in data modelling, data profiling, and source system analysis.
* Strong analytical and problem-solving skills with experience in problem management.
* Knowledge of data architecture principles and the ability to align them with business needs.
Nice to Have:
* Experience with Microsoft Purview for data governance and cataloging.
* Exposure to cloud platforms (Azure, AWS, or Google Cloud).
* Experience working in an Agile environment.
Why Join Us?
* Work on cutting-edge data technologies and contribute to innovative projects.
* Collaborate with a team of experienced professionals in a dynamic environment.
* Career growth opportunities with access to training and certifications.
* Competitive compensation and comprehensive benefits package.
#J-18808-Ljbffr