界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
数据与研究 · SKILL.md

comparison-and-quality

comparison-and-quality

【数据与研究】Guides fg-data-profiling report comparison, privacy-safe reports, metadata, data dictionaries, quality outputs, and expectation-suite caveats.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: comparison-and-quality description: "Guides fg-data-profiling report comparison, privacy-safe reports, metadata, data dictionaries, quality outputs, and expectation-suite caveats." disable-model-invocation: true metadata: disco-role: operating license: MIT

Comparison and Quality

Use this sub-skill when the user wants to compare datasets/reports, protect sensitive data in a profile report, attach dataset metadata or data dictionaries, inspect quality outputs, or discuss expectation-suite integration.

Read first

Comparison quick start

from data_profiling import ProfileReport, compare

train_profile = ProfileReport(train_df, title="Train", minimal=True)
valid_profile = ProfileReport(valid_df, title="Validation", minimal=True)
comparison = compare([train_profile, valid_profile])
comparison.to_file("train-vs-validation.html")

ProfileReport.compare(other) is an alias for comparing two reports:

comparison = train_profile.compare(valid_profile)

Reports use config.title as labels. Tune report.precision and html.style.primary_colors when comparison tables are cramped.

Privacy quick start

profile = ProfileReport(
    df,
    title="Private profile",
    sensitive=True,
    samples=None,
    duplicates=None,
    minimal=True,
)
profile.to_file("private-profile.html")

For reports that need a sample section, replace real records with a synthetic sample:

profile = ProfileReport(
    df,
    sensitive=True,
    sample={"name": "Synthetic sample", "data": synthetic_df, "caption": "Synthetic rows only."},
)

This is redaction guidance, not enterprise PII detection. The open-source package does not automatically manage organization-wide PII classifications.

Metadata and quality quick start

profile = ProfileReport(
    df,
    title="Dataset profile",
    dataset={"description": "5% reproducible sample", "creator": "Data team"},
    variables={"descriptions": {"amount": "Transaction amount"}},
    type_schema={"segment": "categorical"},
)
summary = profile.get_description()
json_text = profile.to_json()

Boundaries

我的收藏