界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
数据与研究 · SKILL.md

distributed-tools

distributed-tools

【数据与研究】Plan safe DGL distributed graph partitioning, launch commands, DistGraph usage, and partition metadata validation.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: distributed-tools description: "Plan safe DGL distributed graph partitioning, launch commands, DistGraph usage, and partition metadata validation." disable-model-invocation: true metadata: disco-role: operating license: Apache 2.0

DGL Distributed Tools

Use this sub-skill when a task needs DGL distributed partitioning, DistGraph runtime setup, partition metadata validation, ip_config.txt, launch-command construction, or GraphBolt distributed partitioning notes.

Start Here

  • Read references/api-reference.md for dgl.distributed.initialize, DistGraph, distributed dataloaders, node_split/edge_split, partition concepts, and launcher argument semantics.
  • Read references/workflows.md for partition preflight, safe launch-command construction, trainer script changes, GraphBolt partition handoffs, and skip conditions.
  • Read references/data-formats.md for ip_config.txt, partition config JSON essentials, part-* entries, and canonical edge-type string rules.
  • Read references/troubleshooting.md when distributed setup fails due to shared workspace, SSH assumptions, relative paths, process-count mismatches, metadata errors, heterograph edge-type ambiguity, or cluster limits.
  • Run python scripts/check_partition_config.py --part-config PATH to inspect partition metadata without loading partition graphs or mutating files.
  • Run python scripts/dgl_distributed_command_builder.py --help to build a dry, printable tools/launch.py-style command; the script never SSHes or launches jobs.

Route Elsewhere

  • Single-machine sampling, dgl.dataloading.DataLoader, and GraphBolt ItemSampler pipelines belong in dataloading-graphbolt.
  • Model layers, GraphConv/SAGEConv/GATConv, losses, and non-distributed training loops belong in message-passing-training.
  • Raw CSV dataset layout, DGLDataset, graph serialization, and dataset cache design belong in datasets-and-io.
  • Homogeneous/heterogeneous graph construction and canonical edge-type basics belong in graph-apis.

Safety Notes

  • Do not run launchers, SSH, rsync, dispatch data, or start cluster processes unless the user explicitly confirms the target cluster, shared workspace, and failure/cleanup plan.
  • Prefer workspace-relative --part_config and --ip_config values for launch commands; validate them before constructing commands.
  • Stop and ask for cluster details when network ports, passwordless SSH, shared storage, GPU/CUDA availability, or multi-host process counts are unknown.
我的收藏