界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
数据与研究 · SKILL.md

get-available-resources

get-available-resources

【数据与研究】Detect available CPU, GPU, memory, and disk resources before compute-heavy CS work. Use when planning model training, large-scale evaluation, embedding generation, experiment sweeps, dataset processing, log analysis, or reproduction runs where hardware limits affect the workflow.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: get-available-resources description: Detect available CPU, GPU, memory, and disk resources before compute-heavy CS work. Use when planning model training, large-scale evaluation, embedding generation, experiment sweeps, dataset processing, log analysis, or reproduction runs where hardware limits affect the workflow.

Get Available Resources

Use this skill early in a CS workflow when hardware constraints may change the implementation plan.

Typical Triggers

  • choosing between in-memory and out-of-core data processing
  • checking whether a model fits on available GPU memory
  • sizing parallel workers for preprocessing or evaluation
  • deciding whether to run locally, distribute with Dask, or move to Modal
  • estimating whether a reproduction or benchmark sweep is realistic on the current machine

Workflow

  1. Run scripts/detect_resources.py to collect CPU, GPU, memory, and disk information.
  2. Save or inspect the generated JSON report.
  3. Translate the report into execution choices.
  4. State the constraints explicitly before proposing a heavy workflow.

CS-Focused Decisions

Map resource findings to concrete tool choices:

  • fits in RAM: prefer polars, pandas, or standard PyTorch workflows
  • exceeds RAM on one machine: consider dask or vaex
  • limited local GPU but scalable remote need: consider modal
  • multi-GPU or long training runs: plan around pytorch-lightning or distributed tooling
  • low disk headroom: avoid materializing large intermediate checkpoints or duplicated datasets

What to Report

By default, summarize:

  • CPU cores and whether high parallelism is realistic
  • available GPUs, VRAM, and likely model-size limits
  • total RAM and whether dataset / checkpoint loading is safe
  • free disk space and likely pressure points
  • practical recommendations for the current task

Default Output

When no exact format is requested, return:

  1. a concise resource summary
  2. the main bottlenecks
  3. recommended execution strategy
  4. any risk to training, evaluation, or large-file processing
我的收藏