name: generation-corpora
description: "Guides summarization, machine-translation, broad corpus,
pretraining, knowledge-graph, and social-graph dataset discovery in
CLUEDatasetSearch."
disable-model-invocation: true
metadata:
disco-role: operating
license: NO_LICENSE
Generation and Corpora Dataset Route
Use this sub-skill when the user intent matches one of these signals:
- summarization, headline generation, keyphrase/title generation
- machine translation or parallel corpora
- general Chinese corpora, pretraining text, wiki/news/QA corpora, knowledge graph/social graph
Read references/dataset-selection.md for generation/corpus choices and references/troubleshooting.md for scale, license, and privacy issues.
Fast workflow
- Restate the user's requested task, language, domain, and output need.
- Search the bundled root index before recommending a row:
python ../../scripts/search_dataset_index.py --category summarization --query LCSTS
python ../../scripts/search_dataset_index.py --category machine-translation --query WMT2019
python ../../scripts/search_dataset_index.py --category corpus --query wiki2019zh
- Compare title, category, description, keywords, provider, license, paper, and note fields.
- Warn that CLUEDatasetSearch is a catalogue: no dataset files are bundled and external access must be verified.
- If the request belongs to another family, route to the sibling sub-skill named below instead of forcing a weak match.
Boundary routes
Output pattern
When answering, include:
- candidate dataset title and category;
- why it fits the task;
- language/domain/scale hints from the catalogue;
- provider and source URL when present in the bundled index;
- license/access caveat, especially if blank or competition-hosted;
- what the user must verify upstream before download, redistribution, or benchmark use.
Do not tell future agents to open or run files from the original repository checkout.