L’interface est localisée ; les présentations et documents des Skills sont traduits automatiquement par IA dans votre langue. Le code, les commandes, chemins et termes techniques restent en version originale, et le document de l’auteur fait foi.
Explorer les Skills
Données et recherche · SKILL.md

extensibility-and-debugging

extensibility-and-debugging

Use this sub-skill for Torch-TensorRT dryrun analysis, Debugger capture/replay, unsupported-op triage, converter/lowering/plugin authoring, QDP kernels, and ModelOpt or quantization debugging.

Independent GitHub snapshot · Automated classification · Original documentation governs

Documentation de la Skill

GitHub

name: extensibility-and-debugging description: "Use this sub-skill for Torch-TensorRT dryrun analysis, Debugger capture/replay, unsupported-op triage, converter/lowering/plugin authoring, QDP kernels, and ModelOpt or quantization debugging." metadata: disco-role: operating disable-model-invocation: true license: BSD 3-Clause

Torch-TensorRT Extensibility and Debugging

Use this sub-skill when the user needs to understand why a model did not compile cleanly, how to inspect graph partitioning, or how to extend Torch-TensorRT with custom lowering or kernels.

Start with the failure mode

Visible symptomLikely workstream
no converter, unsupported op, or tiny TRT partitionUnsupported-op triage and converter decisions
Compile coverage questiondryrun, require_full_compilation, torch_executed_ops, min_block_size
Need graph/capture artifacts or layer infoDebugger and capture/replay
Custom op, converter, or lowering implementationConverter/plugin extension
QDP kernel or custom CUDA/PTX kerneltorch_tensorrt.kernels
Quantization warning or ModelOpt dependency confusionQuantization support triage

Primary references

  • references/debugging.md for dryrun, debugger, and issue-reproduction workflows.
  • references/operator-coverage.md for unsupported-op and fallback decisions.
  • references/custom-ops-and-plugins.md for converter, lowering, and TensorRT plugin paths.
  • references/kernel-api.md for QDP kernel APIs and safe skeletons.
  • references/troubleshooting.md for common error interpretations and dependency gaps.
  • scripts/debugger_capture_template.py --help for a safe capture template.
  • scripts/qdp_kernel_skeleton.py --help for a non-running kernel skeleton generator/checker.

Typical debugging workflow

  1. Reproduce on the smallest possible model and input.
  2. Run a dryrun or debugger capture to see which operators are partitioned to TensorRT and which stay in PyTorch.
  3. Decide whether fallback is acceptable.
  4. If not, choose among model rewrite, custom converter, or plugin/QDP implementation.
  5. Only after the root cause is identified should you revisit runtime optimization or deployment.

Guardrails

  • Do not promise a converter/plugin path without the exact op, schema, input dtype/layout, and target TensorRT version.
  • Do not treat ModelOpt or QDP support as universal; version and dependency gates matter.
  • Do not use a generic compile smoke as proof that the problematic op is supported.
  • Keep debugging artifacts small and self-contained so the user can paste them into an issue or test case.
Skills enregistrées