技能创建器
skill-creator
创建、改进和评估自定义技能,把专业流程转化为可重复使用的 AI 能力。
algo-rank-elo【数据与研究】Implement Elo rating system to rank items or players from pairwise comparison outcomes. Use this skill when the user needs to rank items from head-to-head matchups, build a competitive rating system, or evaluate relative quality from comparison data — even if they say 'player rating', 'ranking from comparisons', or 'competitive scoring system'.
独立 GitHub 快照 · 自动分类 · 以原作者文档为准
Elo assigns numerical ratings that update after each pairwise comparison. Winner gains points, loser loses points. The amount exchanged depends on expected vs actual outcome. Originally for chess, now used for sports, games, and A/B preference testing. Update runs in O(1) per match.
Trigger conditions:
When NOT to use:
IRON LAW: Elo Assumes Each Matchup Is Independent and Stationary
Rating changes are based on surprise: beating a higher-rated opponent
gains more points than beating a lower-rated one. K-factor controls
update speed: high K (32) = volatile, fast adaptation. Low K (16) =
stable, slow adaptation. Choose K based on how quickly skill changes.
Initialize all participants at base rating (typically 1500). Collect match results: winner, loser (or draw). Gate: Valid match data, no self-matches.
Check: total rating points conserved (zero-sum). Rating distribution is reasonable (no extreme values from data errors). Gate: Ratings conserved, top-ranked items pass sanity check.
Return sorted ratings with confidence indicators.
{
"ratings": [{"id": "player_A", "rating": 1720, "matches": 50, "wins": 35, "losses": 15}],
"metadata": {"k_factor": 32, "initial_rating": 1500, "total_matches": 500}
}
Input: Player A (1500) beats Player B (1500), K=32 Expected: E_A = 0.5, S_A = 1. R_A_new = 1500 + 32×(1-0.5) = 1516. R_B_new = 1484.
| Input | Expected | Why |
|---|---|---|
| 1500 beats 2000 | Large rating gain (~29 pts at K=32) | Huge upset, large surprise |
| 2000 beats 1500 | Small rating gain (~3 pts at K=32) | Expected outcome, minimal surprise |
| Draw between equals | No change | Expected outcome exactly matches actual |
| Script | Description | Usage |
|---|---|---|
scripts/elo.py | Update Elo ratings (single match or batch) with zero-sum verification | python scripts/elo.py --help |
Run python scripts/elo.py --verify to execute built-in sanity tests.
references/bradley-terry.mdreferences/variable-k.md