heteroscale-autoscaling

Scale disaggregated LLM inference (prefill-decode) via topology-aware scheduling and metric-driven policies, achieving 26.6% GPU utilization improvement and conserving hundreds of thousands GPU-hours daily

Independent GitHub snapshot · Automated classification · Original documentation governs