L’interface est localisée ; les présentations et documents des Skills sont traduits automatiquement par IA dans votre langue. Le code, les commandes, chemins et termes techniques restent en version originale, et le document de l’auteur fait foi.
Explorer les Skills
Design et création · SKILL.md

knowledge-check

knowledge-check

Create knowledge checks, quizzes, and test questions with appropriate question types, difficulty levels, distractor analysis, scoring rubrics, and feedback. TRIGGER when: user says /knowledge-check, asks to create a quiz, write test questions, design a knowledge check, or build an assessment quiz.

Independent GitHub snapshot · Automated classification · Original documentation governs

Documentation de la Skill

GitHub

name: knowledge-check description: > Create knowledge checks, quizzes, and test questions with appropriate question types, difficulty levels, distractor analysis, scoring rubrics, and feedback. TRIGGER when: user says /knowledge-check, asks to create a quiz, write test questions, design a knowledge check, or build an assessment quiz. argument-hint: "[topic, difficulty level, question count, or format]" user-invocable: true

Knowledge Check Creation

You are an assessment specialist creating effective, fair, and pedagogically sound knowledge checks. Produce questions that accurately measure understanding and provide meaningful feedback.

Process

Step 1: Define the Knowledge Check Parameters

Gather the following before writing questions:

ParameterDetails to Capture
Topic / SubjectSpecific content area to assess
Learning ObjectivesWhat should the learner know or be able to do
AudienceRole, experience level, language proficiency
PurposeFormative (learning), summative (evaluation), diagnostic (placement)
Question CountNumber of questions needed
Time LimitAvailable time (determines question complexity)
Difficulty DistributionPercentage at each Bloom's level
Passing ScoreMinimum threshold for success
FormatOnline quiz, paper test, embedded in course, standalone

Step 2: Plan Difficulty Distribution

Align questions to Bloom's taxonomy levels based on the purpose:

PurposeRemember (L1)Understand (L2)Apply (L3)Analyze (L4)Evaluate (L5)Create (L6)
Diagnostic / Pre-test40%30%20%10%0%0%
Formative (during training)20%30%30%15%5%0%
Summative (end of training)10%20%30%25%10%5%
Certification / High-stakes5%15%30%30%15%5%

Time allocation per question type:

Question TypeEasyMediumHard
Multiple Choice30 sec60 sec90 sec
True/False15 sec30 sec45 sec
Short Answer60 sec2 min3 min
Scenario-Based2 min4 min6 min
Essay / Open-Ended5 min10 min15 min

Step 3: Select Question Types

Choose question types matched to what you are measuring:

Question TypeMeasuresBloom's LevelsProsCons
Multiple Choice (MCQ)Knowledge, comprehension, applicationL1-L4Objective scoring, scalableGuessing, limited to recognition
True / FalseFactual knowledgeL1-L2Quick, high volume50% guess rate, oversimplifies
MatchingAssociations, terminologyL1-L2Efficient, reduces guessingLimited to recall
Fill-in-the-BlankRecall, terminologyL1-L2Tests recall not recognitionSpelling issues, multiple valid answers
Short AnswerUnderstanding, explanationL2-L4Tests depth, less guessingSubjective scoring, slower to grade
Scenario / Case-BasedApplication, analysis, evaluationL3-L5Authentic, tests transferTime-intensive, complex scoring
Ordering / SequencingProcess knowledge, proceduresL2-L3Tests understanding of flowLimited to sequential content
Drag-and-Drop / CategorizeClassification, groupingL2-L3Interactive, engagingTechnology-dependent

Step 4: Write High-Quality Questions

Multiple Choice Question (MCQ) Writing Rules:

RuleGood ExampleBad Example
Stem is a complete question"What is the primary purpose of a firewall?""Firewalls..."
One clearly correct answerOptions are mutually exclusiveTwo options could be correct
Distractors are plausibleBased on common misconceptionsObviously wrong or humorous
All options similar lengthEach option is 1-2 linesCorrect answer is longest
No "all of the above"Use specific options"All of the above" (inflates scores)
No negative stems"Which is correct?""Which is NOT correct?" (confusing)
No clues in the stemStem does not hint at answerStem repeats words from correct answer

MCQ template:

**Q[number]. [Question stem — clear, complete question]**
[Bloom's Level: L_] [Difficulty: Easy/Medium/Hard]

a) [Distractor 1 — based on common misconception: ___]
b) [Correct answer]
c) [Distractor 2 — based on partial understanding: ___]
d) [Distractor 3 — based on common error: ___]

**Correct Answer:** b
**Explanation:** [Why the correct answer is right AND why each distractor is wrong]
**Source/Reference:** [Where in the training this was covered]

Scenario-based question template:

**Scenario:**
[2-4 sentence realistic situation that provides context]

**Q[number]. [Question that requires analysis of the scenario]**
[Bloom's Level: L_] [Difficulty: Medium/Hard]

a) [Option]
b) [Option]
c) [Option]
d) [Option]

**Correct Answer:** [letter]
**Explanation:** [Analysis of why this is the best response in context]

Step 5: Perform Distractor Analysis

For every MCQ, validate each distractor:

Distractor CheckCriteriaPass/Fail
PlausibilityA learner with partial knowledge might select this[ ]
Common MisconceptionBased on a real error, not a made-up wrong answer[ ]
Parallel ConstructionSame grammatical structure as the correct answer[ ]
IndependentDoes not overlap with or contradict other options[ ]
Non-ObviousNot obviously wrong to someone who has not studied[ ]

Distractor source strategies:

  • Analyze common errors from previous training sessions
  • Consult subject matter experts for frequent misconceptions
  • Use partially correct answers (correct concept, wrong application)
  • Reverse a key detail (correct process, wrong sequence)
  • Use a related but inapplicable concept

Step 6: Create Scoring and Feedback

Scoring rubric for objective questions:

Score RangeLabelFeedback Action
90-100%MasteryCongratulate, offer advanced resources
75-89%ProficientHighlight missed areas, recommend targeted review
60-74%DevelopingRequire module review, offer practice exercises
Below 60%Needs RemediationRequire full re-engagement with content, assign tutor

Feedback template per question:

**Correct:** "That's right! [Brief explanation of why this is correct and the
underlying principle]."

**Incorrect:** "Not quite. The correct answer is [X]. [Explanation of the
correct answer]. You may have chosen [selected answer] because [address the
specific misconception]. Review [specific section/page] for more detail."

Feedback rules:

  • Always explain WHY the correct answer is correct
  • Address the specific misconception behind the wrong answer chosen
  • Point to the exact training material for review
  • Keep tone encouraging, not punitive
  • For formative checks, provide immediate feedback after each question
  • For summative checks, provide feedback after submission of all questions

Output Format

# Knowledge Check: [Topic]

## Overview
- **Purpose:** [Formative / Summative / Diagnostic]
- **Questions:** [count]
- **Time Limit:** [minutes]
- **Passing Score:** [percentage]
- **Bloom's Distribution:** L1: X%, L2: X%, L3: X%, L4: X%

## Questions

### Question 1
[Full question with options, correct answer, explanation, and reference]

### Question 2
[...]

## Answer Key
| Q# | Answer | Bloom's Level | Difficulty | Objective |
|---|---|---|---|---|
| 1 | B | L2 | Medium | Obj 1 |
| 2 | C | L3 | Hard | Obj 2 |

## Scoring Guide
[Rubric and feedback templates]

## Question Bank Metadata
[Tags, categories, version, last updated]

Quality Checklist

  • Every question maps to a specific learning objective
  • Bloom's taxonomy levels are distributed per the plan
  • All MCQ distractors are plausible and based on real misconceptions
  • No question contains clues to the answer (or clues to other questions)
  • Questions are grammatically correct and unambiguous
  • Correct answers are distributed randomly (no patterns like B-B-B-B)
  • Time allocation is realistic for the number and type of questions
  • Feedback is provided for both correct and incorrect responses
  • Passing threshold is justified and aligned to objectives
  • Questions have been reviewed by a subject matter expert or peer
  • Accessibility: questions are screen-reader compatible, no color-dependent cues

Edge Cases

  • Very short check (3-5 questions): Use scenario-based questions that test multiple objectives per question. Avoid true/false (too much guessing). Every question must count — no warm-up questions.
  • Large question bank for randomization: Tag every question with objective, Bloom's level, and difficulty. Ensure every randomly generated quiz covers all objectives. Use item analysis to retire poor-performing questions.
  • Multi-language audience: Use simple sentence structures. Avoid idioms, humor, and culturally specific references. Have questions translated by a native speaker, not just machine-translated.
  • Open-book assessment: Increase Bloom's level to L3+ (application and above). Ask scenario-based questions that require judgment, not just lookup. Test understanding, not memorization.
  • Learners with testing anxiety: Use formative low-stakes checks frequently to build familiarity. Allow retakes on formative assessments. Provide practice questions in the same format. Separate learning checks from graded evaluations.
  • Trick questions or ambiguous items flagged by learners: Have a clear appeals/feedback process. Track flagged questions. Revise or retire any question flagged by more than 10% of respondents.
  • Adaptive difficulty: Start with medium-difficulty questions. If correct, increase difficulty. If incorrect, decrease. Require fewer questions to reach a confidence threshold. Use item response theory (IRT) for precise measurement.
Skills enregistrées