界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

plotting-benchmarking

plotting-benchmarking

【效率与协作】Plot RL Baselines3 Zoo training/evaluation results and build safe benchmark result commands.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: plotting-benchmarking description: "Plot RL Baselines3 Zoo training/evaluation results and build safe benchmark result commands." disable-model-invocation: true metadata: disco-role: operating license: MIT

plotting-benchmarking

Use this sub-skill when a future Researcher needs RL Baselines3 Zoo plotting or benchmark-result workflows from an installed rl_zoo3 package: training monitor curves, evaluation curves, postprocessed result pickles, rliable comparison plots, or bounded benchmark-table commands.

Route here for

  • Plotting training reward, episode length, or success curves from Monitor CSV files with rl_zoo3 plot_train or python -m rl_zoo3.plots.plot_train.
  • Aggregating evaluation callback files named evaluations.npz with rl_zoo3 all_plots or python -m rl_zoo3.plots.all_plots.
  • Rendering postprocessed .pkl result files with rl_zoo3 plot_from_file or python -m rl_zoo3.plots.plot_from_file, including --rliable, --versus, and --iqm options.
  • Building a safe benchmark command using python -m rl_zoo3.benchmark --test-mode --no-hub.
  • Diagnosing missing plotting dependencies, headless display failures, missing evaluation files, rolling-window issues, normalization caveats, or benchmark Hub surprises.

Route elsewhere

Default operating stance

  1. Identify the available result format first: Monitor CSV files imply plot_train; evaluations.npz files imply all_plots; an exported result .pkl implies plot_from_file; benchmark tables imply python -m rl_zoo3.benchmark.
  2. Prefer installed-package entry points. Use python -m rl_zoo3.plots.<module> if the rl_zoo3 console router is unavailable; use rl_zoo3 <plot_subcommand> when plotting extras import successfully.
  3. For headless sessions, add MPLBACKEND=Agg; also pass --no-display to all_plots. plot_train and plot_from_file call plt.show(), so the backend guard is the no-display safety mechanism.
  4. Treat rliable output as optional and comparatively slow because it bootstraps confidence intervals. Check normalization coverage before interpreting “normalized score” plots.
  5. Keep benchmark commands offline and bounded by default: include both --test-mode and --no-hub, and use a caller-controlled benchmark directory.

Bundled references and helper

Minimal safe command-building examples

python scripts/plotting_command_builder.py \
  all-plots --algos sac td3 tqc --envs Half Ant --exp-folders ./logs \
  --labels local --output ./plots/offpolicy --print-n-trials

python scripts/plotting_command_builder.py \
  plot-from-file --input ./plots/offpolicy.pkl --skip-timesteps --rliable --versus \
  --labels SAC TD3 TQC --output ./plots/offpolicy.svg

python scripts/plotting_command_builder.py \
  benchmark --log-dir ./rl-trained-agents --benchmark-dir ./benchmark-output \
  --n-timesteps 100 --num-threads 1

The helper prints commands only; it does not train, evaluate, open figures, contact the Hub, or write benchmark/plot output files.

我的收藏