heteroscale-autoscaling

【开发与工程】Scale disaggregated LLM inference (prefill-decode) via topology-aware scheduling and metric-driven policies, achieving 26.6% GPU utilization improvement and conserving hundreds of thousands GPU-hours daily

独立 GitHub 快照 · 自动分类 · 以原作者文档为准