인터페이스는 현지화되어 있으며, Skill 소개와 설명 문서는 선택한 언어로 AI가 자동 번역합니다. 코드·명령어·경로·전문 용어는 원문을 유지하며 원작자 문서가 우선합니다.
Skills 둘러보기
개발 및 엔지니어링 · SKILL.md

serving-runtime

serving-runtime

Launch and debug SGLang serving runtime, OpenAI-compatible APIs, server arguments, cache/scheduler behavior, parallelism, and production serving caveats.

Independent GitHub snapshot · Automated classification · Original documentation governs

Skill 문서

GitHub

name: serving-runtime description: "Launch and debug SGLang serving runtime, OpenAI-compatible APIs, server arguments, cache/scheduler behavior, parallelism, and production serving caveats." disable-model-invocation: true metadata: disco-role: operating license: Apache 2.0

Serving Runtime

Use this sub-skill for sglang serve, launch_server.py, ServerArgs, HTTP/OpenAI-compatible endpoints, tokenizer/engine settings, tensor/data/expert parallelism, radix/KV cache, speculative decoding, disaggregation, and server runtime failures.

Start by separating argument parsing, model/tokenizer loading, CUDA visibility, backend dependency availability, and request-shape errors. Avoid recommending a full server run unless the environment has the pinned SGLang runtime dependencies installed.

Cross-Links

  • Root routing: ../../SKILL.md
  • Workflow map: ../../references/workflow-map.md
  • Cross-cutting troubleshooting: ../../references/troubleshooting.md
저장한 Skills