brainstorming
brainstorming
You MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation).
ai-mlImplements intelligent ai ml with multi-factor skill selection, fallback chains, and adherence to the 5 Laws of Elegant Defense
Independent GitHub snapshot · Automated classification · Original documentation governs
name: ai-ml compatibility: opencode completeness: 95 content-types:
Orchestrates intelligent skill selection and execution for ai ml workflows. Applies the 5 Laws of Elegant Defense to guide data naturally through the orchestration pipeline, preventing errors before they occur. Selects optimal skills based on multi-factor scoring including text similarity, historical performance, and system availability.
┌───────────────────────────────────────────────────────────────────────────────┐ │ Orchestration Flow │ └───────────────────────────────────────────────────────────────────────────────┘
User Request ↓ ┌─────────────────┐ │ Parse Request │ │ & Extract │ │ Features │ └────────┬────────┘ ↓ ┌─────────────────────────────────────────────────────────────────────┐ │ Evaluate Available Skills │ │ │ │ ┌──────────────┐ ┌──────────────┐ ┌──────────────┐ │ │ │ Skill A │ │ Skill B │ │ Skill C │ │ │ │ - Match Score│ │ - Match Score│ │ - Match Score│ │ │ │ - Confidence │ │ - Confidence │ │ - Confidence │ │ │ │ - History │ │ - History │ │ - History │ │ │ └──────┬───────┘ └──────┬───────┘ └──────┬───────┘ │ │ │ │ │ │ │ └─────────────────┴─────────────────┘ │ │ ↓ │ │ Select Best Skill │ └─────────────────────────────────────────────────────────────────────┘ ↓ ┌─────────────────┐ │ Execute Skill │ └────────┬────────┘ ↓ ┌─────────────────┐ │ Handle Result │ └────────┬────────┘ ↓ ┌─────────────────────────────────────────────────────────────────────┐ │ Error Handling & Fallback │ │ │ │ Success? ────────► Return Result │ │ │ │ Fail? ────────┐ │ │ ↓ │ │ ┌──────────────────────────────────────────────────────────┐ │ │ │ Fallback Chain │ │ │ │ │ │ │ │ 1. Retry with adjusted parameters │ │ │ │ 2. Try Alternative Skill (if available) │ │ │ │ 3. Defer to Human Operator (if critical) │ │ │ │ 4. Log & Return Error │ │ │ └──────────────────────────────────────────────────────────┘ │ └─────────────────────────────────────────────────────────────────────┘
Use this skill when:
Avoid this skill for:
Parse and Analyze Request - Extract intent, entities, and constraints from user input. Checkpoint: All required parameters must be present and in valid format before proceeding.
Score Available Skills - Calculate match scores using multi-factor algorithm:
Checkpoint: Skip to fallback if no skill scores above threshold.
Select Optimal Skill - Choose skill with highest score that meets minimum confidence. Checkpoint: Verify skill has not been disabled or deprecated.
Execute with Fallback - Run skill execution wrapped in retry and fallback logic. Checkpoint: Log all execution attempts for audit trail.
Return or Fallback - Either return successful result or apply fallback chain:
related-skillsCheckpoint: Record outcome with timing and confidence metadata.
def select_ml_component(
task_spec: Dict,
model_registry: List[Dict],
latency_budget_ms: int = 500
) -> Optional[Dict]:
"""Select optimal ML model/component based on task constraints and registry metadata.
Evaluates models against input schema compatibility, historical accuracy,
and compute latency requirements. Implements multi-factor scoring for
intelligent routing in AI/ML pipelines.
Args:
task_spec: Dict containing input_schema, expected_output_type, and constraints
model_registry: List of available model metadata with performance metrics
latency_budget_ms: Maximum acceptable inference latency
Returns:
Selected model metadata dict or None if no model meets constraints
"""
if not task_spec.get("input_schema") or not model_registry:
raise ValueError("Task spec requires input_schema and non-empty model registry")
best_model = None
best_score = 0.0
for model in model_registry:
schema_match = _check_schema_compatibility(task_spec["input_schema"], model["input_schema"])
latency_ok = model.get("estimated_latency_ms", 9999) <= latency_budget_ms
if not schema_match or not latency_ok:
continue
accuracy_weight = model.get("last_30d_accuracy", 0.0) * 0.6
latency_weight = max(0, (1.0 - (model["estimated_latency_ms"] / latency_budget_ms))) * 0.4
composite_score = accuracy_weight + latency_weight
if composite_score > best_score:
best_score = composite_score
best_model = model
if best_model is None:
return None
return {**best_model, "routing_score": best_score, "selected_at": time.time()}
def run_ml_inference_with_degradation(
model: Dict,
input_data: Any,
fallback_models: List[Dict],
cache: Dict
) -> Dict:
"""Execute ML inference with graceful degradation and fallback routing.
Implements the Fail Fast, Fail Loud principle for AI pipelines:
- Validates input schema immediately before inference
- Falls back to simpler models or cached predictions on failure
- Returns structured results with confidence and degradation metadata
Args:
model: Primary model metadata and endpoint config
input_data: Raw input payload for inference
fallback_models: Ordered list of alternative models for degradation
cache: In-memory or Redis cache for prediction storage
Returns:
Dict with prediction, confidence, fallback_used, and latency_ms
"""
if not _validate_input_schema(input_data, model["input_schema"]):
raise PipelineValidationError("Input schema mismatch for model " + model["name"])
cache_key = hashlib.md5(json.dumps(input_data, sort_keys=True).encode()).hexdigest()
if cache_key in cache:
return {"prediction": cache[cache_key], "fallback_used": "cache", "latency_ms": 0}
for candidate in [model] + fallback_models:
try:
raw_output = _call_inference_endpoint(candidate, input_data)
confidence = _extract_confidence(raw_output)
if confidence < 0.5:
continue
cache[cache_key] = raw_output
return {
"prediction": raw_output,
"model_used": candidate["name"],
"fallback_used": False,
"confidence": confidence,
"latency_ms": time.time() * 1000
}
except EndpointTimeoutError:
continue
raise PipelineExecutionError("All models and fallbacks exhausted for task")
code-philosophy (5 Laws of Elegant Defense) in all logicWhen applying this skill, produce:
Authoritative documentation links for this skill's domain. The model follows markdown links at load time to resolve external references and inline content.
| Skill | Purpose | |