算法艺术创作
algorithmic-art
通过代码和可调参数创作生成艺术与交互式视觉效果。
3dgs-compression-deploy【设计与创意】3DGS compression-to-deployment pipeline: quantization (scalar/VQ/mixed-precision), pruning (coreset/adaptive/variational/merge/Bayesian), progressive streaming & LoD, Web/WebGPU/mobile deployment, hardware acceleration (Tensor Core/GEMM/FPGA/ASIC), training-free semantic compression. Covers 53+ methods across 6 compression categories. Use when: compr…
独立 GitHub 快照 · 自动分类 · 以原作者文档为准
End-to-end pipeline from raw 3DGS model to deployed application. Covers 6 compression categories + 4 deployment targets + hardware acceleration.
Raw 3DGS Model
│
▼
[Step 1] Analysis ── attribute profiling, bottleneck identification
│
▼
[Step 2] Strategy Selection ── target platform → compression recipe
│
▼
[Step 3] Pruning ── reduce Gaussian count (coreset / adaptive / variational / merge)
│
▼
[Step 4] Quantization ── reduce per-attribute bit-width (scalar / VQ / mixed-precision)
│
▼
[Step 5] Vector Quantization ── codebook-based attribute compression (optional, replaces/augments Step 4)
│
▼
[Step 6] Streaming & LoD ── progressive loading structure for network delivery
│
▼
[Step 7] Deployment ── platform-specific renderer and runtime
│
▼
Deployed Application (Web / Mobile / Desktop / Edge)
Profile the 3DGS model before selecting compression methods:
| Attribute | FP32 Size | Typical Range | Sensitivity to Quantization |
|---|---|---|---|
| Position (μ) | 12B/Gaussian | Scene bounds | High — direct geometry impact |
| SH (degree 0–3) | 48B/Gaussian | [-1, 1] per coeff | Medium-High — visual quality driver |
| Opacity (α) | 4B/Gaussian | [0, 1] | Medium — pruning signal |
| Scale (s) | 12B/Gaussian | [1e-5, 1e2] | Medium — anisotropy sensitive |
| Rotation (q) | 16B/Gaussian | Unit quaternion | Low-Medium — can tolerate 8-bit |
Profiling checklist:
Decision tree by target platform:
Target Platform?
├── Web (WebGL/WebGPU)
│ ├── Bandwidth-limited → Pruning + VQ + Streaming (CAGS/HGS pipeline)
│ └── Compute-limited → Aggressive pruning + low SH degree + Flux-GS
├── Mobile (iOS/Android)
│ ├── Real-time required → Mobile-GS pipeline (depth-aware OIT + distillation + pruning)
│ └── Quality priority → MesonGS++ (mixed-precision, budget-controlled) + NanoGS merge
├── Desktop (GPU ≥ RTX 3060)
│ ├── Max quality → Light quantization only (8-10 bit, ContextGS entropy coding)
│ └── Large scene → Pruning + Streaming + HiGS hierarchical tiles
└── Edge / Embedded
├── FPGA targeted → SpqGS (hardware-friendly quantization) + Axis-Shared Accelerator
└── Low-power GPU → VEDAL pruning + 4-6 bit quantization + PocketGS on-device
Combined target table:
| Target | Typical Gaussian Budget | Bit-width Range | Streaming | Key Methods |
|---|---|---|---|---|
| Web | 100K–500K | 4–8 bit | Required | CAGS, StreamLoD-GS, Spark 2.0 |
| Mobile | 50K–200K | 4–8 bit | Optional | Mobile-GS, Flux-GS, PocketGS |
| Desktop | 500K–5M | 8–16 bit | For large scenes | MesonGS++, HiGS, gsplat |
| Edge/FPGA | 10K–100K | 2–6 bit | Required | SpqGS, VEDAL, GEMM-GS |
| Method | Type | Venue | Bit-width | Key Feature |
|---|---|---|---|---|
| MesonGS++ | Mixed-precision (post-training) | arXiv 2026 | 4–16 bit per attribute | 0-1 ILP hyperparameter search, 34x compression |
| GETA-3DGS | Joint pruning + quantization | arXiv 2026 | 4–8 bit heterogeneous | Render-aware saliency, QADG dependency graph |
| GSQ | Learned step size | CVPR 2025 | 4–8 bit | Group-wise quantization with learnable step |
| ContextGS | Context-model entropy coding | NeurIPS 2024 | 8–16 bit | Anchor-level context replaces uniform quant |
| SpqGS | Scalable parallel | CVPR 2025 | Hardware-friendly | Parallel bit allocation for FPGA/ASIC |
| SOG-GS | Channel-grouped | CVPR 2025 | Per-channel | Preserves inter-Gaussian correlations |
| ZipGS | Pruning + quant + entropy | CVPR 2025 | Variable | Volumetric entropy coding |
| GaussianCodec | Entropy-constrained | CVPR 2025 | Rate-distortion optimized | Learned codec with ECVQ |
| EAGLES | Quantized embeddings | ECCV 2024 | 8–16 bit | Coarse-to-fine training + pruning |
| TC-GS | Tri-plane representation | IEEE 2026 | Implicit via tri-plane | Replaces per-Gaussian SH with shared tri-plane |
| Attribute | 4–5 bit | 6–8 bit | 8–12 bit | 12–16 bit |
|---|---|---|---|---|
| Position | Edge only — visible artifacts | Mobile/Web acceptable | Desktop recommended | Lossless-range |
| SH (dc) | Not recommended | Edge/mobile | Desktop | High-fidelity |
| SH (rest) | Aggressive mobile | Mobile/Web | Desktop | Unnecessary |
| Opacity | Acceptable (post-sigmoid) | Recommended | Overkill | Overkill |
| Scale | Log-space 4-bit risky | Log-space 6–8 bit | Recommended | Overkill |
| Rotation | 8-bit often sufficient | Standard | Unnecessary | Overkill |
Rule of thumb: Position and SH dominate quality; allocate more bits there. Opacity and rotation tolerate aggressive quantization.
| Strategy | Method | Venue | Compression | Quality Impact |
|---|---|---|---|---|
| Coreset-based | Provable Pruning via Coresets | arXiv 2026 | Theoretical guarantee | Minimal — multiplicative approximation |
| Bayesian | DP-Splat | arXiv 2026 | Automatic complexity control | Minimal — DP prior converges to optimal count |
| Training-free semantic | CoSAG | arXiv 2026 | 37–76× over LangSplatV2 | Minimal — zero fine-tuning, leverages CLIP features |
| Importance-based | Prune Wisely (DoG) | CVPR 2026 | 90% reduction | Minimal — DoG avoids false positives |
| Variational | VEDAL | arXiv 2026(venue 待核实) | 5.2x (0.31 dB drop) | Low — uncertainty-gated async pruning |
| Merge-based | NanoGS | arXiv 2026 | Training-free | Mass-preserving moment matching |
| Global+Local | LightGaussian | NeurIPS 2024 | 15x | SVD distillation compensates |
| Render-aware | GETA-3DGS | arXiv 2026 | ~5x storage | Transmittance-weighted saliency |
| Frequency-aware | FAD-GS | CVPR 2024 | Frequency-separated | Separates low/high freq Gaussians |
| Memory-bounded | Gaussians on a Diet | arXiv 2026 | 80% peak memory | Iterative growth+pruning |
| Hybrid | HybridGS | CVPR 2025 | Explicit+implicit | Neural coding recovers pruned info |
| Budget-controlled | MGS (Matryoshka) | arXiv 2026 | Continuous LoD | Any prefix of ordered set is coherent |
Need theoretical guarantees?
├── Yes → Provable Pruning via Coresets
└── No
├── Training-free requirement?
│ ├── Yes → NanoGS (merge) or LightGaussian (post-training)
│ └── No
│ ├── Can retrain/fine-tune after pruning?
│ │ ├── Yes → Prune Wisely (DoG) + finetune, or VEDAL
│ │ └── No → NanoGS or GETA-3DGS (auto, no per-scene thresholds)
│ └── Need continuous quality levels?
│ └── Yes → MGS (Matryoshka stochastic budget training)
Gaussian Attributes
│
▼
[1] Attribute Grouping ── group by type (position, SH, scale/rotation)
│
▼
[2] Codebook Learning ── K-means / learned / residual codebook
│
▼
[3] Assignment ── nearest-neighbor lookup per group
│
▼
[4] Residual Coding ── (optional) multi-level residual VQ
│
▼
[5] Entropy Coding ── arithmetic / ANS coding of indices
│
▼
Compressed Bitstream
| Method | Codebook Type | Venue | Compression | Key Feature |
|---|---|---|---|---|
| CompactGS | Learned per-attribute | ECCV 2024 | 10–15x | Simple codebook, minimal overhead |
| VQGS | Residual codebook | CVPR 2025 | High-ratio | Multi-level residual improves quality |
| RDO-Gaussian | ECVQ (entropy-constrained) | ECCV 2024 | 40x+ | Rate-distortion optimized VQ |
| CAGS | VQ + LoD layers | SIGGRAPH 2026 | Adaptive | VQ establishes quality LoDs for streaming |
| CGVQ | Clustered codebook | SIGGRAPH 2026 Poster | 20% bpp reduction | Cluster-guided grouping before quant |
| Sp2403GS | Codebook + pruning | CVPR 2024 | Combined | Importance-based codebook selection |
| HAC | Hash-grid context | ECCV 2024 | ~100x | Context modeling for entropy coding |
| CompGS | Importance-aware | CVPR 2025 | Progressive | Progressive decoding support |
| Method | LoD Mechanism | Venue | Latency Reduction | Key Feature |
|---|---|---|---|---|
| StreamLoD-GS | View-dependent LoD levels | arXiv 2026 | Progressive | Bandwidth-adaptive FVV delivery |
| HGS | Hierarchical Gaussian structuring | CVPR 2025 | Progressive | Level-of-detail Gaussian hierarchy |
| GS-Stream | Progressive chunk delivery | CVPR 2025 | Bandwidth-adaptive | Chunk-based 3DGS streaming |
| EvoGS | Evolution Tree (wavelet-inspired) | arXiv 2026 | 2.4x payload reduction | Continuous parent-child refinement |
| MGS | Stochastic budget training | arXiv 2026 | Continuous | Any prefix = coherent render |
| SCube | VoxSplats + hierarchical LOD | NeurIPS 2024 | Hierarchical | Voxelized splat for large-scale |
| CAGS | VQ-based LoD + reference image | SIGGRAPH 2026 | +5–20 dB PSNR | Server-side low-res reference corrects color |
| Method | Mechanism | Venue | First-frame Latency | Key Feature |
|---|---|---|---|---|
| PD-4DGS | Hierarchical Deformation Decomposition | arXiv 2026 | ~1.7s (from 73–930s) | 3 independent layers: static + global deform + local refine |
| CAGS | VQ LoD + color correction | SIGGRAPH 2026 | Adaptive | Representation-agnostic, works with diverse Gaussian types |
| QUEEN | Quantized streaming encoding | NeurIPS 2024 | Streaming | Dynamic Gaussian free-viewpoint video |
| BlitzGS | Distributed GPU sharding | arXiv 2026 | Parity-based | City-scale distributed rendering + importance scoring |
Server Client
┌──────────┐ HTTP/HLS/DASH ┌──────────────────┐
│ 3DGS │ ──── Layer 0 ────→ │ Base quality │
│ Encoder │ ──── Layer 1 ────→ │ + Deformation │
│ │ ──── Layer 2 ────→ │ + Refinement │
│ CAGS/ │ │ │
│ PD-4DGS │ ←── Bandwidth ──── │ Quality Feedback │
└──────────┘ └──────────────────┘
| Platform | Renderer | Max Gaussians | Key Feature |
|---|---|---|---|
| Spark 2.0 | WebGPU | 100M+ splats | Chunk streaming, multi-splat sorting, progressive LOD |
| Visionary | WebGPU + ONNX Runtime | Large | 4DGS + neural avatars + generative post-processing |
| SuperSplat | WebGL | ~5M | Editable viewer, selection tools |
| PlayCanvas | WebGL 2.0 | ~2M | Game engine integration |
Web deployment checklist:
| Method | Venue | FPS (Mobile) | Key Feature |
|---|---|---|---|
| Mobile-GS | ICLR 2026 | 1000+ FPS (on-device) | Depth-aware OIT + distillation + contribution pruning |
| Flux-GS | ECCV 2026 | Real-time | Monte Carlo specular energy, compact latent SH |
| PocketGS | arXiv 2026 | On-device training | Anisotropic seeding + cached alpha compositing |
Mobile deployment pipeline:
| Method | Hardware | Venue | Speedup | Key Feature |
|---|---|---|---|---|
| GEMM-GS | Tensor Core (GEMM) | arXiv 2026 | 1.42x | Reformulates blending as GEMM ops |
| TensorGS | Tensor Core (FP16 matrix) | arXiv 2026 | 1.65x | Tensorizes rasterization with cross-tile grouping |
| Axis-Shared Accelerator | ASIC (custom) | ISCA 2026 | On-chip real-time | First 3DGS hardware accelerator, order-independent transmittance |
| HiGS | GPU (hierarchical tiles) | NVIDIA 2026 | 15.8x | Macro-tile + fine render tile decoupling |
| LiteGS | GPU (Moore Threads) | SIGGRAPH Asia 2025 | Software-hardware co-opt | Won 3DGS Challenge silver at SIGGRAPH Asia |
| SpqGS | FPGA-friendly | CVPR 2025 | Parallel bit allocation | Hardware-scalable quantization |
| QuadBox | GPU (AABB optimization) | arXiv 2026 | 1.85x | Geometry-aware bounding boxes |
| StereoGS | ASIC (stereoscopic) | 2026 | Dual-eye shared | Energy-efficient stereoscopic GS processor; shared compute + memory bandwidth for VR/AR |
Deployment hardware?
├── NVIDIA GPU (RTX 30xx+)
│ ├── Tensor Core available → GEMM-GS or TensorGS
│ └── Standard CUDA → HiGS + gsplat
├── Custom ASIC / SoC design
│ └── Axis-Shared Rasterization Accelerator (ISCA 2026)
├── FPGA
│ └── SpqGS (hardware-friendly quant) + custom rasterizer
├── Mobile GPU (Mali/Adreno/Apple)
│ └── Mobile-GS depth-aware OIT + Flux-GS Monte Carlo
└── VR/AR HMD (stereoscopic)
└── StereoGS (dual-eye shared compute + memory bandwidth)
| Category | Method | Venue | Compression | Quality | Speed |
|---|---|---|---|---|---|
| Mixed-precision Q | MesonGS++ | arXiv 2026 | 34x | High | Post-training |
| Joint Prune+Q | GETA-3DGS | arXiv 2026 | ~5x | High | Auto |
| Adaptive Prune | Prune Wisely | CVPR 2026 | 90% Gaussians | High | Post-training |
| Variational Prune | VEDAL | arXiv 2026(venue 待核实) | 5.2x | 0.31 dB drop | 185 FPS |
| Coreset Prune | Provable Coresets | arXiv 2026 | Guaranteed | Theoretical | + finetune |
| Merge Simplify | NanoGS | arXiv 2026 | Training-free | High | Fast (CPU) |
| VQ+LoD Stream | CAGS | SIGGRAPH 2026 | Adaptive | +5–20 dB | Stream |
| VQ Residual | VQGS | CVPR 2025 | High-ratio | Medium | — |
| Tri-plane | TC-GS | IEEE 2026 | Implicit | — | — |
| 4D Stream | PD-4DGS | arXiv 2026 | Progressive | 3-layer | 1.7s first-frame |
| Large-scale Dist | BlitzGS | arXiv 2026 | Parity shards | City-scale | Distributed |
| Mobile | Mobile-GS | ICLR 2026 | 50–100x | Acceptable | 1000+ FPS |
| Mobile | Flux-GS | ECCV 2026 | Parameter reduction | High | Real-time |
| WebGPU | Visionary | arXiv 2025 | Stream | High | WebGPU |
| Web | Spark 2.0 | 2026 | Stream | 100M+ splats | WebGPU |
| Tensor Core | GEMM-GS | arXiv 2026 | — | Negligible loss | 1.42x |
| Tensor Core | TensorGS | arXiv 2026 | — | Negligible loss | 1.65x |
| ASIC | Axis-Shared Accel | ISCA 2026 | — | On-chip | Real-time |
| Hierarchical Tile | HiGS | NVIDIA 2026 | — | Exact compositing | 15.8x |
| Evolution Tree | EvoGS | arXiv 2026 | 2.4x payload | Continuous | Stream |
| Matryoshka LoD | MGS | arXiv 2026 | Continuous | Any prefix | Flexible |
| Hash-grid Context | HAC | ECCV 2024 | ~100x | High | Encoding |
When this skill produces a compression-deployment plan, use this template:
# 3DGS Compression & Deployment Plan
## Model Profile
- Gaussian count: N
- File size: S MB
- Scene type: static / dynamic (4DGS)
- Key bottleneck: [storage / bandwidth / compute / memory]
## Target Platform
- Platform: [Web / Mobile / Desktop / Edge]
- Constraints: [memory budget, bandwidth, GPU]
## Compression Recipe
1. Pruning: [method] → target: X% reduction
2. Quantization: [method] → [bit-width per attribute]
3. VQ: [method, codebook size] → (if applicable)
4. Entropy coding: [method]
## Expected Results
- Compression ratio: Xx
- Estimated PSNR: Y dB (drop: Δ dB)
- Estimated file size: Z MB
- Rendering speed: W FPS on target
## Streaming Architecture (if applicable)
- Layers: [base / deformation / refinement]
- First-frame latency: < T seconds
## Deployment Stack
- Renderer: [gsplat / Spark 2.0 / Mobile-GS / custom]
- Acceleration: [Tensor Core / HiGS / FPGA / none]
- Format: [PLY compressed / chunk stream / custom binary]
references/compression-methods.md for full method details before making recommendationsreferences/compression-methods.md or provided by the user[UNCERTAIN] rather than presenting as factDo NOT try to apply the method data, compression ratios, technical details, or deployment recommendations described in this skill from memory. Always read the SKILL.md and references/compression-methods.md from disk before producing any output. The knowledge base is updated frequently; stale memory may produce outdated, inaccurate, or fabricated results.
If you cannot find a method, metric, or data point in the loaded files, say so explicitly. Never invent compression ratios, venue acceptances, performance numbers, or technical features not present in the source data.
If you like it, please star this repo https://github.com/jaccen/Awesome-Gaussian-Skills