Join to apply for the Azure Data Engineer role at Cognizant
Responsibilities:
* Write Python/PySpark and Spark SQL code for validation/curation in notebooks
* Create data integration test cases
* Implement or amend worker pipelines
* Convert data model data mapping to technical data mapping
* Implement integrations
* Data migration implementation and execution
* Data analysis (profiling, etc.)
* Azure DevOps/GitHub configurations for ADF and Databricks code
* Strong experience in designing and delivering Azure-based data platform solutions
* Good knowledge in real-time streaming applications, preferably with experience in Kafka real-time messaging or Azure Functions, Azure Service Bus
* Spark processing and performance tuning
* File formats partitioning (e.g., Parquet, JSON, XML, CSV)
* Hands-on experience in at least one of Python with knowledge of others
* Experience with synchronous and asynchronous interface approaches
* Knowledge in data modeling (3NF/Dimensional modeling/Data Vault 2)
* Able to provide comprehensive documentation
* Able to set and manage realistic expectations for timescales, costs, benefits, and measures for success
Nice to Have:
* Experience with integration and implementation of data cataloging tools like Azure Purview/Collabra
* Experience in implementing and integrating visualization tools like Power BI/Tableau, etc.
Seniority Level
Mid-Senior level
Employment Type
Full-time
Job Function
Information Technology
Industries
IT Services and IT Consulting
#J-18808-Ljbffr