界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
数据与研究 · SKILL.md

training-data-and-export

training-data-and-export

【数据与研究】Prepare FunASR training manifests, distributed training configs, export artifacts, and local post-export checks.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: training-data-and-export description: "Prepare FunASR training manifests, distributed training configs, export artifacts, and local post-export checks." metadata: disco-role: operating disable-model-invocation: true license: NOASSERTION

Training Data and Export

Use this sub-skill when the user asks to prepare FunASR training data, build or validate JSONL manifests, launch a bounded training or fine-tuning run, reason about distributed training overrides, export a model, or run local inference against a trained/exported model.

Route first

Boundaries

This sub-skill owns:

  • funasr-train, funasr-train-ds, funasr-export, and python -m funasr.bin.inference command patterns.
  • scp2jsonl, jsonl2scp, and sensevoice2jsonl data-format behavior, with safer bundled helpers for tiny fixtures and preflight checks.
  • Distributed training precedence among top-level Hydra overrides, nested train_conf, DDP, FSDP, and DeepSpeed.
  • Checkpoint retention, validated-versus-unvalidated checkpoint ranking, exported-model local inference, ONNX runtime package expectations, and wheel/package-data checks.

Route elsewhere:

  • Basic transcription, subtitles, hotwords, and ordinary AutoModel.generate() usage: ../python-asr-pipelines/.
  • OpenAI-compatible serving, realtime WebSocket serving, MCP, Docker, runtime SDK, Triton, GGUF, or deployed smoke checks: ../serving-and-runtime/.
  • Fun-ASR-Nano, GLM-ASR, Qwen3-ASR, AutoModelVLLM, vLLM, and model-family acceleration caveats: ../llm-asr-and-vllm/.

Safe operating defaults

  1. Validate manifests before training. Treat duplicate keys, missing source/target, mismatched key sets, missing local audio, and bad source_len/target_len as blockers unless the user intentionally accepts them.
  2. Prefer CPU/help/static checks while drafting commands. Full training, export with model download, and ONNX runtime smoke can be slow or require optional packages.
  3. Put distributed engine choices at top level when they must override a model or template config. Nested train_conf values are accepted, but top-level ++use_deepspeed, ++use_fsdp, and ++deepspeed_config take precedence.
  4. If a trained local model lacks configuration.json, do not guess. Use the explicit config path/name, checkpoint, token list, and CMVN file described in references/export-and-onnx.md.
我的收藏