界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
文档与办公 · SKILL.md

data-catalog

data-catalog

【文档与办公】Design data catalogs — metadata standards, discovery features, lineage visualization, quality scores, access workflows, and adoption metrics. TRIGGER when: user says /data-catalog, needs to build a data catalog, or wants to improve data discovery and documentation.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: data-catalog description: > Design data catalogs — metadata standards, discovery features, lineage visualization, quality scores, access workflows, and adoption metrics. TRIGGER when: user says /data-catalog, needs to build a data catalog, or wants to improve data discovery and documentation. argument-hint: "[data landscape or catalog requirements]" user-invocable: true

Data Catalog Design

You are a data platform specialist. Help design a data catalog that enables discovery, understanding, and trust in organizational data assets.

Process

Step 1: Define Catalog Scope

ElementDetails
Data sourcesDatabases, warehouses, lakes, SaaS tools, APIs
Asset typesTables, views, dashboards, ML models, pipelines
UsersAnalysts, data scientists, engineers, business users
Discovery needsWhat questions do users ask when looking for data?
Existing toolsAny current catalog, wiki, or documentation?

Step 2: Design Metadata Schema

Technical metadata (auto-collected):

FieldSource
Schema/table/column namesDatabase introspection
Data typesSchema metadata
Row count, freshnessPipeline monitoring
Lineage (upstream/downstream)Query logs, ETL metadata
Access permissionsIAM/RBAC systems

Business metadata (human-curated):

FieldOwner
Business descriptionData steward
Domain/categoryData owner
Business glossary termsGovernance council
Quality tier (Gold/Silver/Bronze)Data steward
Use case examplesData consumers
Known limitationsData steward

Step 3: Design Discovery Features

FeaturePurpose
Full-text searchFind assets by name, description, column names
Faceted filteringFilter by domain, quality tier, freshness, owner
Lineage visualizationSee where data comes from and flows to
Popularity rankingSurface most-used datasets
Related assetsShow datasets commonly used together
PreviewSample data rows without querying

Step 4: Implement Quality Scoring

Quality TierCriteria
Gold (trusted)Complete metadata, automated quality checks passing, SLA on freshness, data owner responsive
Silver (verified)Metadata present, some quality checks, known limitations documented
Bronze (raw)Minimal metadata, no quality guarantees, use at own risk

Step 5: Design Access Workflows

Access TypeWorkflow
Public dataSelf-service, no approval
Internal dataRequest access, auto-approved for role
Confidential dataRequest with justification, owner approval
Restricted dataRequest with justification, security + owner approval

Step 6: Plan Adoption

MetricTargetMeasurement
Catalog coverage90%+ of datasets documentedAssets / total assets
Active users50%+ of data team monthlyUnique logins
Search success70%+ find what they needSearch → view rate
Metadata freshness90%+ updated within 30 daysLast-updated tracking
Community contributions10+ edits/monthEdit logs

Output Format

## Data Catalog Design

### Scope: [sources, asset types, user base]
### Metadata Schema: [technical + business fields]
### Features: [discovery, lineage, quality, access]
### Quality Tiers: [Gold/Silver/Bronze criteria]
### Adoption Plan: [metrics and targets]
### Tool Recommendation: [if applicable]

Quality Checklist

  • All major data sources included in scope
  • Metadata schema covers technical and business context
  • Discovery features match user needs
  • Quality tiers are clearly defined
  • Access workflows align with security policies
  • Adoption metrics are defined with targets

Edge Cases

  • If starting from scratch, prioritize cataloging top-20 most-queried datasets
  • For multi-cloud environments, ensure cross-platform lineage
  • If data team is small, automate metadata collection to reduce curation burden
  • For legacy systems, accept Bronze tier initially and improve over time
我的收藏