Data Catalogue Specialist Microsoft Purview

Role Overview
The Data Catalogue Specialist will be responsible for implementing and managing Microsoft Purview as ADC’s enterprise metadata management and data governance platform. The role will establish metadata cataloguing, glossary management, classification, lineage, and data governance processes across all in-scope data assets while supporting formal DGE and DDA governance requirements.
Key Responsibilities
Microsoft Purview Administration
• Configure and administer Microsoft Purview for ADC.
• Establish collection hierarchies aligned with ADC business domains and the Government Information Model (GIM).
• Register and maintain all in-scope data sources including:
o IBM DB2 Warehouse.
o Databricks Unity Catalog.
o IBM DataStage.
• Manage asset ownership, stewardship assignments, and governance records.
Metadata Discovery and Cataloguing
• Execute automated metadata scans across all in-scope datasets using Purview native connectors.
• Capture and maintain technical metadata including:
o Asset names.
o Schemas.
o Data types.
o Nullability.
o Column-level statistics.
o Refresh frequencies.
• Configure Databricks Unity Catalog integration to ensure ongoing automated metadata harvesting.
Business Glossary Management
• Design, build, and maintain the Microsoft Purview Business Glossary.
• Create and manage GIM-aligned business terms, definitions, ownership assignments, and stewardship relationships.
• Ensure all in-scope data elements are linked to relevant glossary terms.
• Synchronise approved glossary content with DGE’s central Purview environment using Purview APIs.
Classification and Information Protection
• Configure and manage Purview classification rules.
• Apply Microsoft Information Protection (MIP) sensitivity labels across all in-scope assets.
• Coordinate with business stakeholders to classify assets as:
o Public.
o Internal.
o Confidential.
o Secret.
• Manage Secret Data Exclusion processes and maintain audit and notification registers.
Data Lineage Management
• Design, configure, and validate end-to-end lineage across ADC data platforms.
• Document lineage across:
o Landing.
o Staging.
o IDM.
o Semantic layers.
o Databricks Bronze, Silver, and Gold environments.
• Implement Databricks lineage integration using native Purview capabilities.
• Configure DataStage lineage through Atlas Process entities where required.
Data Quality Metadata Integration
• Surface Databricks data quality metrics within Microsoft Purview.
• Configure custom asset attributes including:
o DQI Score.
o Rule Pass Rate.
o Last Profiled Date.
• Ensure users can assess data quality directly from catalogued assets without requiring separate tooling.
Governance and Compliance
• Prepare metadata management artefacts for formal DGE and DDA review.
• Produce and maintain:
o Metadata templates.
o Classification registers.
o Lineage diagrams.
o Governance documentation.
• Manage review cycles, incorporate feedback, and maintain version-controlled catalogue artefacts.
Required Skills and Experience
• Strong experience implementing and administering Microsoft Purview.
• Experience with enterprise metadata management, data cataloguing, and business glossary management.
• Knowledge of Microsoft Information Protection (MIP) and data classification frameworks.
• Experience configuring and validating enterprise data lineage.
• Understanding of Databricks, Unity Catalog, IBM DB2 Warehouse, and DataStage environments.
• Experience with REST APIs and metadata integration processes.
• Strong stakeholder engagement and data governance experience.
• Knowledge of government data governance and information management frameworks is desirable.
Deliverables
• Configured Microsoft Purview environment.
• Metadata catalogue covering all in-scope assets.
• Business glossary and GIM-aligned terminology.
• Classification and sensitivity labelling registers.
• End-to-end lineage documentation.
• Data quality metadata integration.
• DGE/DDA review and approval artefacts.