---

name: nemo description: "Router for trlX's optional NVIDIA NeMo/Megatron backend: when to choose it, how configs and checkpoints fit together, and what remains unverified without NeMo/Apex." disable-model-invocation: true metadata: disco-role: operating license: MIT

nemo

Use this sub-skill only when the task explicitly depends on the trlX NeMo / Megatron backend, .nemo checkpoints, or the trlX NeMo wrappers.

Route here when the request mentions

• NeMoPPOTrainer, NeMoILQLTrainer, or NeMoSFTTrainer
• PPOGPT, ILQLGPT, or SFTGPT
• default_nemo_20b_config, default_nemo_2b_config, or default_nemo_1_3b_config
• NeMo YAMLs, tensor/pipeline parallel sizing, rank-sharded checkpoints, or LLaMA-to-NeMo conversion
• checkpoint loading, NeMo-style inference, or pretrained_model / megatron_cfg wiring
• the optional NeMo / Apex / Megatron backend and its install prerequisites

Route elsewhere when the task is really about

• standard trlx.train PPO / ILQL / SFT / RFT on Accelerate, reward functions, samples/rewards, PEFT, data shapes, or Ray sweeps → ../training/SKILL.md
• generic NeMo usage that is not tied to trlX wrappers or configs
• direct NeMo/Apex installation, large-model conversion, or distributed launch execution

Backend status in this inspection

• CUDA torch smoke passed in the minimum env.
• NeMo / Apex / Megatron were not installed in that env.
• The installed trlX package registers the NeMo trainer names, but they resolve to dummy import-error stubs until NeMo is installed.
• Treat all NeMo guidance here as source-backed and intentionally unverified for the local backend.

What this sub-skill provides

• references/workflows.md for setup, conversion, training, inference, and default selection.
• references/configuration.md for NeMo YAML shape and trlx-to-NeMo config mapping.
• references/troubleshooting.md for import, Apex/CUDA, parallelism, checkpoint, tokenizer, and memory failures.

Provenance used to distill this guidance

Source evidence was read from the NeMo-related trainer/model files, NeMo defaults, and docs/examples in the repo, including docs/source/installation.rst, docs/source/api.rst, trlx/models/README.md, examples/llama_nemo/README.md, trlx/data/default_configs.py, trlx/trainer/nemo_*.py, trlx/models/modeling_nemo_*.py, and configs/nemo_configs/*.yaml.