The interface is localized. Skill descriptions and documents are machine-translated by AI into your language; code, commands, paths and technical terms stay in the original, and the author's document governs.
Explore skills
Productivity · SKILL.md

plotting-benchmarking

plotting-benchmarking

Plot RL Baselines3 Zoo training/evaluation results and build safe benchmark result commands.

Independent GitHub snapshot · Automated classification · Original documentation governs

Skill documentation

GitHub

name: plotting-benchmarking description: "Plot RL Baselines3 Zoo training/evaluation results and build safe benchmark result commands." disable-model-invocation: true metadata: disco-role: operating license: MIT

plotting-benchmarking

Use this sub-skill when a future Researcher needs RL Baselines3 Zoo plotting or benchmark-result workflows from an installed rl_zoo3 package: training monitor curves, evaluation curves, postprocessed result pickles, rliable comparison plots, or bounded benchmark-table commands.

Route here for

  • Plotting training reward, episode length, or success curves from Monitor CSV files with rl_zoo3 plot_train or python -m rl_zoo3.plots.plot_train.
  • Aggregating evaluation callback files named evaluations.npz with rl_zoo3 all_plots or python -m rl_zoo3.plots.all_plots.
  • Rendering postprocessed .pkl result files with rl_zoo3 plot_from_file or python -m rl_zoo3.plots.plot_from_file, including --rliable, --versus, and --iqm options.
  • Building a safe benchmark command using python -m rl_zoo3.benchmark --test-mode --no-hub.
  • Diagnosing missing plotting dependencies, headless display failures, missing evaluation files, rolling-window issues, normalization caveats, or benchmark Hub surprises.

Route elsewhere

Default operating stance

  1. Identify the available result format first: Monitor CSV files imply plot_train; evaluations.npz files imply all_plots; an exported result .pkl implies plot_from_file; benchmark tables imply python -m rl_zoo3.benchmark.
  2. Prefer installed-package entry points. Use python -m rl_zoo3.plots.<module> if the rl_zoo3 console router is unavailable; use rl_zoo3 <plot_subcommand> when plotting extras import successfully.
  3. For headless sessions, add MPLBACKEND=Agg; also pass --no-display to all_plots. plot_train and plot_from_file call plt.show(), so the backend guard is the no-display safety mechanism.
  4. Treat rliable output as optional and comparatively slow because it bootstraps confidence intervals. Check normalization coverage before interpreting “normalized score” plots.
  5. Keep benchmark commands offline and bounded by default: include both --test-mode and --no-hub, and use a caller-controlled benchmark directory.

Bundled references and helper

Minimal safe command-building examples

python scripts/plotting_command_builder.py \
  all-plots --algos sac td3 tqc --envs Half Ant --exp-folders ./logs \
  --labels local --output ./plots/offpolicy --print-n-trials

python scripts/plotting_command_builder.py \
  plot-from-file --input ./plots/offpolicy.pkl --skip-timesteps --rliable --versus \
  --labels SAC TD3 TQC --output ./plots/offpolicy.svg

python scripts/plotting_command_builder.py \
  benchmark --log-dir ./rl-trained-agents --benchmark-dir ./benchmark-output \
  --n-timesteps 100 --num-threads 1

The helper prints commands only; it does not train, evaluate, open figures, contact the Hub, or write benchmark/plot output files.

Saved skills