协作头脑风暴
brainstorming
在实现前澄清需求、探索设计选择,并形成清晰的开发方向。
agentsop-http-tool-wrapping【开发与工程】Decision protocol for wrapping a REST / GraphQL / RPC API as a tool an LLM agent can call. The load-bearing premise: the *tool surface* is an LM-friendly subset of the *API surface* — one tool per user intent, not one per endpoint. Activates when a coder agent must expose an external HTTP API to a model (function calling, tool_use, MCP, LangChain `@t…
独立 GitHub 快照 · 自动分类 · 以原作者文档为准
name: agentsop-http-tool-wrapping
version: 0.1.0
description: |
Decision protocol for wrapping a REST / GraphQL / RPC API as a tool an LLM
agent can call. The load-bearing premise: the tool surface is an
LM-friendly subset of the API surface — one tool per user intent, not one
per endpoint. Activates when a coder agent must expose an external HTTP API
to a model (function calling, tool_use, MCP, LangChain @tool, CrewAI
BaseTool). Encodes the what to surface, how to name, how to shape, how to
fail — not any single framework's API. ~80% of agent tools in production are
HTTP wrappers; this is the SOP for getting them right.
domain: coder-agent / tool-construction
audience: engineers wiring external APIs into LLM agents
trigger_keywords:
Source posture: every non-trivial claim is cited inline with short tags like
[oai/fc],[anthropic/tooluse],[lc/tools],[mcp/spec],[apxml/schema]. Resolve them againstreferences/R1-source-evidence.mdfor full URLs. Reusable code shapes live inreferences/R2-pattern-library.md.
Activate when a coder agent must make an external HTTP API callable by an LLM. Concrete triggers:
429, timeouts, or unpaginated list endpoints.tool_use, an MCP server, LangChain @tool, and CrewAI BaseTool.Do not activate when: the API is already exposed as an MCP server you merely consume (just connect it); the "tool" is pure local computation with no network I/O (write a plain typed function); or you are designing the upstream API itself.
This is a tool-construction skill — sibling to the framework SOPs
(langgraph-sop, crewai-sop) which decide whether/where tools run. Once you
know you need a tool, this skill decides what shape it takes.
The tool surface is an LM-friendly subset of the API surface. One tool per intent, not one per endpoint.
A REST API is designed for programmers who read docs, hold a mental model of resources, and compose calls. An agent tool is designed for a language model that sees only a name, a description, and a JSON schema — and must decide, mid-reasoning, whether this is the thing to call. These are different audiences, so the surface must be re-cut, not mirrored.
"Tool descriptions are often more important than code comments because the LLM directly uses them for reasoning."
[apxml/schema]
Four load-bearing consequences:
Intent, not CRUD. The unit of a tool is a thing the agent wants to
accomplish (cancel_order, find_customer_by_email), not an HTTP verb on a
resource (DELETE /orders/{id}). One intent may compose several endpoints;
one endpoint may serve zero intents (admin/batch/webhook-out endpoints get
dropped). Surface intent, not the verb table [zuplo/agent-ready].
The schema is the prompt. The model never sees your code. It sees the
tool name, the description, and each field's description=. Every field
needs units, format, enum values, and an example aimed at the model — "if a
field is a date, specify ISO 8601 vs Unix timestamp" [apxml/schema]. A
typed schema (Pydantic / JSON Schema) is non-negotiable because it is both
the validation layer and the documentation the model reads [lc/tools].
The response is context, and context is scarce. A 10 MB JSON payload is not "data the agent has" — it is tokens the agent must pay for, re-read, and can misquote. Shape the response down to the fields the agent needs to reason or act on. Returning raw upstream JSON is the second most common anti-pattern after 1:1 mapping.
The model cannot promise call discipline. It may emit zero, one, or
several calls — "best practice [is] to assume there are several"
[oai/fc] — retry on its own, or be resumed by the framework. So the
wrapper owns reliability (timeout, retry, rate-limit) and safety
(idempotency on mutations). You cannot prompt these guarantees into existence;
you build them into the tool. (Side-effect safety is deep enough to be its
own skill — cross-link llm-tool-idempotency for any mutating tool.)
The pre-LLM analog: you are writing an SDK for a non-deterministic, amnesiac junior dev who reads only the function signature — generous docstrings, narrow typed inputs, small clean returns, and total robustness to being called wrong.
Walk top-down. Each step has a gate — if it fails, fix it before adding surface.
List every endpoint × verb. For each, ask: "what user/agent intent does this
serve?" Drop endpoints with no agent-facing intent (internal admin, batch
jobs, outbound webhooks). The MCP guidance is a useful first cut: GET-style
data reads often map to resources; create/update/delete map to tools
[gun/mcp]. Target ≤10 surfaced operations for a first pass.
Gate: if you are about to create one tool per endpoint, stop — that is AP-1. Auto-generated 1:1 servers from an OpenAPI spec "routinely under-perform hand-curated tools"
[stainless/mcp].
Tool name = verb_object describing intent: search_orders, cancel_order,
get_order_status. Not post_orders_v2, delete_orders_id. Test: a model
that has never seen your API, reading only the name, should guess when to call
it. The name should be a verb; the description should explain when to call,
not how [oai/prompting].
Define a Pydantic model (or JSON Schema). Rules:
description= (units, format,
enum, example) [lc/tools] [apxml/schema].filter[status]=open → status: Literal["open","closed"]. The model should never construct a query-string
fragment.Gate: every field the model can set has a
description=. Untyped**kwargsor a free-formbody: stris a smell — the model will fill it wrong.
Catch HTTPStatusError / ValidationError / network errors. Return a
structured, LM-readable error, never a raw stack trace:
{"error": "rate_limited", "message": "...", "retryable": true, "hint": "wait and retry"}
Use a small closed set of error codes (not_found, invalid_input,
auth_failed, rate_limited, server_error). LangChain's ToolException
converts a raised error into an LM-visible string for the same reason
[lc/structured]. The model reasons over the error like any other tool output —
give it something it can act on.
Define an output model with only the fields the agent needs. Drop audit
timestamps, internal mirrors, deprecated fields, ETags. Summarize blobs into
strings. Aim for a compact payload per call (rule of thumb: keep it small enough
that re-reading it 5 times in a loop is cheap). For lists, return items + a
next_cursor, not the whole dataset (Step 5b).
Step 5b · Pagination. Default: fetch one page, return items + next_cursor, let the agent decide to continue. Prefer cursor over offset —
"cursor-based pagination is more reliable than offset/limit for agentic
scrolling" [techops/rest]. Auto-loop only when total is small and bounded
(≤200); never loop unbounded — a single agent can "burst 20 sequential API
calls to complete one task" [zuplo/agent-ready] (cross-link bounded-loop skill).
Read the key/token from env or a secret store inside the wrapper. Never
expose api_key as a tool parameter and never put a secret in the description —
the model doesn't need it and traces would leak it. Per-tenant tokens flow via a
closure or context object, not via tool args [northflank/mcp].
Gate: grep your tool schema and description for
key,token,secret,password. Zero hits.
If the tool does POST/PUT/DELETE, it will be retried by the model or the
framework. Generate an idempotency key per logical operation and pass it
(Idempotency-Key header) when the API supports it — the canonical Stripe
pattern [stripe/idem]. Tag the tool metadata mutating=True. For the full
decision tree (key derivation, dedup store, at-least-once vs exactly-once),
defer to the llm-tool-idempotency skill — that is its entire domain.
Format: Trigger → Action → Output → Evidence. (Full JSON in
intermediate/operation_candidates.json.)
[zuplo/agent-ready] [stainless/mcp].verb_object; name-only readability test.[oai/prompting].description=; flatten wire
params; explicit required/optional.args_schema on the tool.[lc/tools] [oai/fc] [anthropic/tooluse] [apxml/schema].[northflank/mcp].timeout=. Retry only on 429/5xx/network,
max 3–5, exponential backoff with jitter, honor Retry-After. Never retry
other 4xx.[apxml/rate] [boldsign/retry] [getknit/rate].next/cursor/Link.next_cursor; agent decides to continue;
bounded auto-loop only for small totals.[techops/rest] [zuplo/agent-ready].[apxml/schema] [gun/mcp].{error, message, retryable, hint} from a closed
code set; never raw traces.[lc/structured] [mighty/fault].mutating=True.
Defer full protocol to llm-tool-idempotency.[stripe/idem] [techops/rest] [mighty/fault].@tool
with args_schema. CrewAI: subclass BaseTool._run. OpenAI: tools=[{type: "function", function:{...}}]. Anthropic: {name, description, input_schema}.
MCP: @mcp.tool(). Derive each via Model.model_json_schema().[lc/tools] [crewai/tools] [mcp/spec] [oai/fc]
[anthropic/tooluse].Scenario: A CRM API has 60 endpoints. Do you ship 60 tools, or one
crm_operation(operation: str, params: dict) mega-tool?
Trap (mega-tool): A single tool with a free-form operation string and a
dict of params pushes all routing into the model with no schema help. "A
mega-tool with a single instructions string invites hallucinations"
[medium/velorum] — the model invents operation names and param shapes, and the
wrapper can't validate them.
Trap (1:1, 60 tools): Flat catalogs degrade selection accuracy at scale —
beyond ~50 tools, "flat tool-list catalogs degrade selection accuracy;
hierarchical / graph organization helps" [arxiv/toolnet]. The model spends
reasoning budget scanning a wall of near-identical names.
Decision rule:
action: Literal[...] enum (not a free string) plus a
discriminated-union params model. The enum keeps schema validation; the
grouping keeps the catalog short. This is the middle path between 1:1 and
one mega-blob.graphql_query(query, variables)
with a documented schema) — and even then, constrain it.Verdict: Neither extreme. Triage first, then typed grouping. The win is a short catalog of validated tools, not raw endpoint count in either direction.
Scenario: get_customer_360 returns a 10 MB document — full order history,
event logs, nested addresses, internal flags.
Trap: Return it whole. The model pays ~2–3M tokens, can't fit it, and will quote fields that aren't there. Truncating blindly loses the field the agent needed.
Decision rule:
recent_orders_count: int,
last_order_summary: str, and a separate list_customer_orders(cursor) the
agent calls only if it needs more (OP-6 pagination).Verdict: Expose a thin reason/act slice; demote bulk to follow-up paginated tools or references. The tool's job is to give the model enough to decide the next step, not the whole record.
Scenario: A report API: POST /reports returns a job_id; you poll
GET /reports/{job_id} until status=done (can take minutes).
Options:
generate_report() submits then polls
internally until done. Simple mental model for the model, but holds the agent
(and its timeout) hostage for minutes, and a single per-attempt HTTP timeout
can't cover it.submit_report() -> job_id and
check_report(job_id) -> status|result. The agent submits, does other work,
polls. Robust to long waits; matches the agent loop; but the model must
remember to poll.Decision rule:
check_report return a clear status enum so the model
knows whether to wait, and bound the agent's poll count (bounded-loop skill).Verdict: Match the tool shape to the latency. Sub-second → hide the poll inside one tool; minutes → split, and make the agent's polling explicit and bounded.
| # | Anti-pattern | Symptom | Fix |
|---|---|---|---|
| AP-1 | 1:1 endpoint→tool mapping | 40+ near-identical tools; model picks wrong one | Triage to intents (OP-1); auto-gen 1:1 "under-performs hand-curated" [stainless/mcp] |
| AP-2 | Raw JSON dump to the LM | Context bloat, hallucinated field names | Output model with only reason/act fields (OP-7) |
| AP-3 | Secrets in description or args | API key leaks into traces/logs | Auth inside wrapper from env/secret store (OP-4) |
| AP-4 | No rate-limit / retry handling | One 429 or blip kills the whole run | Timeout + jittered retry, honor Retry-After (OP-5) |
| AP-5 | Unbounded pagination auto-loop | Token blowout / OOM on big lists | Return page + cursor; bounded loop only (OP-6) |
| AP-6 | Procedural description ("first call X, then Y") | Model treats the tool as a script, mis-sequences | Describe when to call, not how; one intent per tool [oai/prompting] |
| AP-7 | Free-form body: str / params: dict | Model fills the wire format wrong | Typed flattened schema (OP-3) |
| AP-8 | Raising stack traces to the model | Model parrots Python tracebacks at the user | Structured {error, retryable, hint} (OP-8) |
Hard boundaries — this skill is the wrong frame when:
[serghei/agent-ready]) rather than
papering over it in a wrapper.llm-tool-idempotency skill; this skill only flags the hook (OP-9).The wrapper logic — triage, naming, typed schema, auth, retry, pagination,
shaping, errors — is framework-independent. The only framework-specific layer
is the registration call. One Pydantic v2 model feeds all five targets via
model_json_schema() and model_validate().
| Framework | Definition shape | Schema source | Error surface | Notes |
|---|---|---|---|---|
| OpenAI function calling | tools=[{type:"function", function:{name, description, parameters}}] | parameters = JSON Schema | Return error JSON as the tool result | "Assume there are several [calls]" — wrappers must be parallel-safe [oai/fc] |
Anthropic tool_use | tools=[{name, description, input_schema}] | input_schema = JSON Schema | tool_result with is_error:true keyed by tool_use_id | Correlate response to request via tool_use_id [anthropic/tooluse] |
| MCP HTTP server | @mcp.tool() (FastMCP) | Inferred from type hints / Pydantic | Return structured error content | GET→resource, mutate→tool split [gun/mcp]; don't auto-gen 1:1 [stainless/mcp] |
| LangChain / LangGraph | @tool or StructuredTool with args_schema | Pydantic args_schema | ToolException → LM-visible string [lc/structured] | Type hints required; docstring is the description [lc/tools] |
| CrewAI | subclass BaseTool, implement _run, set args_schema | Pydantic args_schema | Return string; weak built-in error capture | Per-agent scoping: shared definition, per-agent binding [crewai/tools] |
Two cross-framework heuristics carried in from the sibling SOPs:
allowed_tools):
give each agent/step only the tools its role needs. Fewer tools = better
selection and less context [oai/tools] [crewai/tools]. A wide wrapped API
should still be scoped per agent, not bound wholesale.Short tags → full sources in references/R1-source-evidence.md:
[oai/fc] = developers.openai.com/api/docs/guides/function-calling[oai/tools] = developers.openai.com/api/docs/guides/tools (allowed_tools)[oai/prompting] = community.openai.com/t/prompting-best-practices-for-tool-use-function-calling/1123036[anthropic/tooluse] = docs.anthropic.com/en/docs/build-with-claude/tool-use[lc/tools] = docs.langchain.com/oss/python/langchain/tools[lc/structured] = blog.langchain.com/structured-tools/[crewai/tools] = docs.crewai.com/en/concepts/tools[mcp/spec] = modelcontextprotocol.io/specification[gun/mcp] = gun.io/ai/2025/05/wrap-existing-api-with-mcp/[stainless/mcp] = stainless.com/mcp/from-rest-api-to-mcp-server/[northflank/mcp] = northflank.com/blog/how-to-build-and-deploy-a-model-context-protocol-mcp-server[apxml/schema] = apxml.com/.../tool-input-output-schemas[apxml/rate] = apxml.com/.../api-rate-limits-retries-tools[boldsign/retry] = boldsign.com/blogs/api-retry-mechanism-how-it-works-best-practices/[getknit/rate] = getknit.dev/blog/10-best-practices-for-api-rate-limiting-and-throttling[techops/rest] = techopsasia.com/blog/rest-api-design-idempotency-pagination-security[stripe/idem] = stripe.com/docs/api/idempotent_requests[mighty/fault] = mightybot.ai/blog/fault-tolerant-ai-agent-pipelines/[zuplo/agent-ready] = zuplo.com/learning-center/api-readiness-gap-agent-callable-apis[serghei/agent-ready] = sergheipogor.medium.com/how-to-make-your-api-agent-ready-...[medium/velorum] = medium.com/@1nick1patel1/tool-schemas-the-quiet-superpower-of-agents[arxiv/toolnet] = arxiv.org/pdf/2403.00839 (ToolNet, Liu et al. 2024)