name: metric-gaslighting-detector
description: "Find out how a dashboard, KPI report, or metrics slide is lying to you — before you repeat its story in a bigger room. Use when numbers feel too tidy, a narrative rests on one chart, or you inherited metrics you didn't define. Produces a deception audit: every metric graded for the eleven classic distortions (denominator games, survivorship, y-axis crimes, cherry-picked windows…), the story the data would tell under honest framing, and the three questions to ask the metric's owner."
Metric Gaslighting Detector
Dashboards rarely contain false numbers. They contain true numbers arranged to create false beliefs. This skill audits the arrangement — the eleven standard distortions through which honest data becomes dishonest narrative.
Required Inputs
- The metrics artifact — the dashboard description, KPI table, chart, or the numbers with their labels exactly as presented. Include axis ranges, time windows, and any annotations; the lie usually lives there.
- The claim being made with it (if any) — "churn is under control", "the launch worked". The audit tests the claim-data connection, not the data alone.
The Eleven Distortions
- Denominator games — the base changed ("of active users" quietly became "of weekly active")
- Survivorship framing — measuring only what remained (retention of cohorts that didn't churn early)
- Y-axis crimes — truncated baselines, dual axes, log scales without labels
- The cherry window — the date range that starts at the trough or ends before the drop
- Mix-shift laundering — the aggregate improved because composition changed, not performance
- Ratio without magnitude — "+40%!" concealing 5→7
- The vanity proxy — measuring what moves instead of what matters (signups for activation)
- Goodhart's ghost — the metric improved because it became a target, and the gamed behaviour is visible elsewhere
- Smoothing to silence — rolling averages wide enough to bury the event being asked about
- The missing counterfactual — "up 20% since launch" with no baseline trend (it was up 25% before)
- Significance theatre — differences within noise presented as movement ("ticked up to 4.6 from 4.5, n=41")
Output Format
- The audit table — metric | distortion(s) detected | severity (🔴 changes the conclusion / 🟡 shades it / 🟢 clean) | the honest version of that number's sentence.
- The honest retelling (≤150 words) — what this data says under fair framing. Sometimes the story survives; say so — the detector earns trust by clearing metrics too.
- Three questions for the owner — specific, answerable, non-accusatory ("what was the trend in the 8 weeks before launch?"), ordered by how much the answer would change the conclusion.
- The one chart to request — the single re-cut (full window, fixed denominator, split by segment) that would settle the biggest 🔴.
Quality Checks
Anti-Patterns
Example Trigger Phrases
- "These numbers feel too tidy."
- "Is this dashboard lying to me?"
- "Audit this KPI report before I present it."
- "I inherited these metrics: can I trust them?"