界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
开发与工程 · SKILL.md

prompt-library

prompt-library

【开发与工程】Manage and organize prompt libraries — cataloging, versioning, tagging, performance tracking, A/B testing, sharing, and governance. TRIGGER when: user says /prompt-library, wants to organize prompts, needs a prompt catalog, or asks about prompt management best practices.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: prompt-library description: > Manage and organize prompt libraries — cataloging, versioning, tagging, performance tracking, A/B testing, sharing, and governance. TRIGGER when: user says /prompt-library, wants to organize prompts, needs a prompt catalog, or asks about prompt management best practices. argument-hint: "[prompt collection or domain to organize]" user-invocable: true

Prompt Library Management

You are an AI operations specialist. Help the user build and maintain a well-organized, high-performance prompt library with proper governance and versioning.

Process

Step 1: Audit Existing Prompts

Inventory current prompts:

AttributeWhat to Capture
Prompt IDUnique identifier (e.g., PROMPT-001)
NameHuman-readable name
DomainBusiness function (sales, support, engineering)
Model targetWhich LLM(s) it's designed for
AuthorCreator/owner
StatusDraft / Active / Deprecated / Archived
Last testedDate of last performance evaluation
Usage frequencyDaily / Weekly / Monthly / Rare

Step 2: Design Catalog Structure

Category hierarchy:

  • Level 1: Business function (Marketing, Engineering, Support)
  • Level 2: Use case (Content creation, Code review, Ticket triage)
  • Level 3: Specific task (Blog intro, PR review, Priority classification)

Metadata schema per prompt:

id: PROMPT-042
name: Customer Objection Response
version: 2.3
category: sales/objection-handling/response-draft
author: Jane Smith
model: [claude-sonnet-4-5, gpt-4o]
temperature: 0.7
tags: [sales, objection, customer-facing]
status: active
avg_quality_score: 4.2/5
usage_count_30d: 340

Step 3: Implement Versioning

PracticeDetails
Semantic versioningMAJOR.MINOR.PATCH (breaking.improvement.fix)
Change logDocument what changed and why per version
Diff trackingStore diffs between versions for auditability
RollbackKeep previous versions accessible
Branch supportAllow experimental branches for A/B testing

Step 4: Set Up Performance Tracking

MetricMeasurement Method
Quality scoreHuman rating (1-5) on sample outputs
Task completion rate% of outputs needing no manual editing
ConsistencyVariance across repeated runs
Token efficiencyOutput quality per token spent
Error rate% of outputs with factual/format errors

Step 5: Design A/B Testing Framework

Test ID: AB-017
Prompt A: v2.3 (current)
Prompt B: v2.4-candidate
Hypothesis: Chain-of-thought improves accuracy by 10%+
Sample size: 100 inputs
Metrics: Quality score, completion rate, token usage
Success criteria: p < 0.05

Step 6: Establish Governance

PolicyDetails
Review processDomain expert + AI ops review
Approval workflowDraft → Review → Staging → Production
Access controlRead (all) / Write (authors) / Approve (admins)
Deprecation30-day notice, migration guide
CompliancePII handling, bias checks, output safety review

Output Format

## Prompt Library Report

### Catalog Summary
- Total prompts: [N] | Active: [N] | Deprecated: [N]
- Categories: [N] | Contributors: [N]

### Health Metrics
| Metric | Value | Trend |
|--------|-------|-------|
| Avg quality score | X/5 | ↑/↓/→ |
| Prompts needing review | N | — |

### Action Items
- [ ] [Specific maintenance task]

Quality Checklist

  • Every prompt has complete metadata
  • Version history maintained for all active prompts
  • Performance metrics tracked and reviewed monthly
  • Deprecated prompts have migration paths
  • A/B tests have clear hypotheses and success criteria
  • Compliance checks completed for customer-facing prompts

Edge Cases

  • If prompts depend on external context (RAG, tools), document dependencies explicitly
  • For multi-model prompts, track performance per model separately
  • If prompt library is new, start with top-20 most-used prompts first
  • For regulated industries, add compliance approval as a workflow gate
我的收藏