Data Catalogue Specialist (Microsoft Purview)

Overview

Location: Abudhabi - UAE - Onsite

Experience: 5 to 7 Years

Role Overview

Key Responsibilities

• **Microsoft Purview Administration*** Configure and administer Microsoft Purview for ADC.
• Establish collection hierarchies aligned with ADC business domains and the Government Information Model (GIM).
• Register and maintain all in-scope data sources including:
• + IBM DB2 Warehouse.
• + Databricks Unity Catalog.
• + IBM DataStage.
• Manage asset ownership, stewardship assignments, and governance records.
• **Metadata Discovery and Cataloguing*** Execute automated metadata scans across all in-scope datasets using Purview native connectors.
• Capture and maintain technical metadata including:
• + Asset names.
• + Schemas.
• + Data types.
• + Nullability.
• + Column-level statistics.
• + Refresh frequencies.
• Configure Databricks Unity Catalog integration to ensure ongoing automated metadata harvesting.
• **Business Glossary Management*** Design, build, and maintain the Microsoft Purview Business Glossary.
• Create and manage GIM-aligned business terms, definitions, ownership assignments, and stewardship relationships.
• Ensure all in-scope data elements are linked to relevant glossary terms.
• Synchronise approved glossary content with DGE’s central Purview environment using Purview APIs.
• **Classification and Information Protection*** Configure and manage Purview classification rules.
• Apply Microsoft Information Protection (MIP) sensitivity labels across all in-scope assets.
• Coordinate with business stakeholders to classify assets as:
• + Public.
• + Internal.
• + Confidential.
• + Secret.
• Manage Secret Data Exclusion processes and maintain audit and notification registers.
• **Data Lineage Management*** Design, configure, and validate end-to-end lineage across ADC data platforms.
• Document lineage across:
• + Landing.
• + Staging.
• + IDM.
• + Semantic layers.
• + Databricks Bronze, Silver, and Gold environments.
• Implement Databricks lineage integration using native Purview capabilities.
• Configure DataStage lineage through Atlas Process entities where required.
• **Data Quality Metadata Integration*** Surface Databricks data quality metrics within Microsoft Purview.
• Configure custom asset attributes including:
• + DQI Score.
• + Rule Pass Rate.
• + Last Profiled Date.
• Ensure users can assess data quality directly from catalogued assets without requiring separate tooling.
• **Governance and Compliance*** Prepare metadata management artefacts for formal DGE and DDA review.
• Produce and maintain:
• + Metadata templates.
• + Classification registers.
• + Lineage diagrams.
• + Governance documentation.
• Manage review cycles, incorporate feedback, and maintain version-controlled catalogue artefacts.
• **Required Skills and Experience*** Strong experience implementing and administering Microsoft Purview.
• Experience with enterprise metadata management, data cataloguing, and business glossary management.
• Knowledge of Microsoft Information Protection (MIP) and data classification frameworks.
• Experience configuring and validating enterprise data lineage.
• Understanding of Databricks, Unity Catalog, IBM DB2 Warehouse, and DataStage environments.
• Experience with REST APIs and metadata integration processes.
• Strong stakeholder engagement and data governance experience.
• Knowledge of government data governance and information management frameworks is desirable.
• **Deliverables*** Configured Microsoft Purview environment.
• Metadata catalogue covering all in-scope assets.
• Business glossary and GIM-aligned terminology.
• Classification and sensitivity labelling registers.
• End-to-end lineage documentation.
• Data quality metadata integration.
• DGE/DDA review and approval artefacts.
• nocMOrkPyr