计划执行与检查节点
executing-plans
按既定实施计划完成工作,保持过程检查和反馈。
topaz-video-enhancement【效率与协作】Use when enhancing, upscaling, restoring, denoising, sharpening, deinterlacing, stabilizing, motion-deblurring, colorizing, SDR-to-HDR converting, or frame-rate/slow-motion converting video (and secondarily images) with Topaz Labs — whether cleaning up AI-generated video, compressed UGC, or old archival footage, or building a generate-low-res-then-up…
独立 GitHub 快照 · 自动分类 · 以原作者文档为准
Topaz Labs makes AI enhancement/restoration models delivered three ways: the
desktop apps (Topaz Video AI, Gigapixel, Photo AI), and the Topaz Platform
REST API (api.topazlabs.com) which exposes the same model families for
programmatic, batch, and pipeline use. This skill is about applying the models to
solve concrete footage problems and about driving the API inside an automated
pipeline. When a task is a one-off manual cleanup, the desktop app is usually faster;
when enhancement is a repeatable stage in a generate → enhance → deliver pipeline,
use the API.
Enhancement is a repair and finishing operation, not a creation operation. It cannot add information that was never plausibly there; it can only reconstruct, interpolate, or invent detail. Every model on this page trades some fidelity for some apparent quality, and the whole discipline is choosing the trade that matches the footage and the deliverable.
Verification note: model names, model codes/slugs, parameters, limits, and pricing below were verified against Topaz's developer documentation on 2026-07-10. These are volatile — Topaz ships new model versions frequently (the
-Nsuffix in a code is a version). Before hard-coding a code in a pipeline, confirm it against the liveAvailable Modelsreference / OpenAPI schema (developer.topazlabs.com/reference). Codes are used in APIfilters[].model; the desktop app shows friendly names.
Applies:
Does not apply:
(Production heuristic, corroborated by practitioner reports cited in Sources.)
Most current text/image-to-video generators are cheaper and more controllable at low resolution and short duration. A common delivery pattern:
Why enhance last, not during generation: enhancement models are deterministic given inputs and let you separate concerns (denoise, then upscale, then interpolate) so each model solves one problem. Upscaling noisy or warpy footage amplifies the noise and warping — fix those first.
Key mindset difference from camera footage: AI-generated frames contain synthetic texture the generator invented. A restoration model tuned for real footage may read that texture as detail to preserve, or a creative model may replace it. Match the model's assumptions to the source (see model selection below).
Topaz groups video models into families. Pick the family by the dominant problem, then the variant by quality/speed and source condition. Codes verified 2026-07-10.
Deterministic (non-diffusion) upscaling and detail/noise/sharpen control. Best when you want the output to stay faithful to the source and be reproducible.
| Model | Code(s) | Solves | Notes |
|---|---|---|---|
| Proteus | prob-4 | General upscale/enhance of low-to-mid quality real footage | Most versatile default; exposes manual detail/noise/sharpen params |
| Iris | iris-3 (LQ), iris-2 (MQ) | Face/detail recovery from degraded sources | Choose LQ vs MQ by source quality; strongest on faces |
| Artemis | ahq-12, amq-13, alq-13, amqs-2, alqs-2, aaa-9 | Combined denoise + sharpen, compression/halo cleanup | Variant suffixes target high/medium/low quality (HQ/MQ/LQ) sources |
| Dione | ddv-3, dtv-4, dtd-4, dtvs-2, dtds-2 | Deinterlacing 480i/576i/1080i broadcast (TV) and camcorder (DV) | Purpose-built for interlaced → progressive; TV vs DV variants |
| Gaia | gcg-5 (CG), ghq-5 (HQ) | Clean CGI / animation / rendered content | Final polish for already-clean synthetic sources |
| Rhea | rhea-1 | 4× upscale prioritizing fine/organic texture and fidelity | Use when a large jump must preserve delicate detail |
| Theia | thd-3 (Detail), thf-4 (Fidelity) | Clarity/detail sharpening with noise control | Detail vs Fidelity trade sharpening aggressiveness |
Note: any Proteus-family model can be told the source is interlaced via video_type,
but Dione is the model actually designed to deinterlace well.
Generative (diffusion) restoration. Recovers detail, stability, and texture that a deterministic model cannot, at higher cost and with more risk of invented detail. Reported (2026) as a temporal-stability leader.
| Model | Code | Primary use | Max frames* |
|---|---|---|---|
| Starlight Precise 1 | sl-1 | Archival / heavily degraded real footage, max source fidelity | 9,000 |
| Starlight Precise 2 | slp-2 | GenAI faces/skin + stable motion; has creativity (low/middle/high) | 450 |
| Starlight Precise 2.5 | slp-2.5 | AI-generated video plus some archival; improved realism | 9,000 |
| Starlight HQ | slhq-1 | Progressive video up to 4K | — |
| Starlight Mini | slm-1 | Degraded archival (8mm/16mm/MiniDV); auto-deinterlaces | — |
| Starlight Sharp | wonder-1 | Restoration + detail sharpening | — |
| Starlight Fast 1 / Fast 2 | slf-1, slf-2 | Speed-priority; Fast 2 balances speed + realism | 9,000 |
*Max frames per request — verified 2026-07-10; enforce by segmenting long clips.
ast-2 (Astra 2). A creative model for GenAI video that adds new dynamic detail
and texture, best on stylized/wide/large-scale AI shots. Parameters include
creativity (0.0–1.0, required), optional prompt, sharp (default 0.5),
realism, and input_frame_count (max 9000 without prompt, 450 with). Warning
(documented): creative models can change objects, identity, and stylization. Do not
use Astra when the output must match the source exactly — use Proteus (preserve) or
Starlight (restore with intent preserved).
| Model | Code | Use |
|---|---|---|
| Nyx | nyx-3 | Balanced high-quality denoise; camera/low-light/compression noise while keeping detail |
| Nyx XL | nxl-1 | Aggressive denoise when noise removal dominates |
| Nyx Fast | nxf-1 | Faster, cheaper — previews, batch, time-sensitive |
| Nyx High Fidelity | nxhf-1 | Denoise-only, preserves source exactly; can export a noise pass |
| Model | Code | Use |
|---|---|---|
| Apollo | apo-8 | Best all-around slow-motion + frame-rate conversion; precise 2×/4×/8× |
| Apollo Fast | apf-2 | Simpler motion, faster |
| Chronos | chr-2 | Hard frame-rate conversions, linear/layered motion |
| Chronos Fast | chf-3 | Speed over precision |
| Aion | aion-1 | Extreme slow motion with heavy parallax / fast camera; minimizes duplication/instability |
Shared params: slowmo (1–16), fps (15–240), duplicate (bool),
duplicateThreshold/duplicate_threshold (0.001–0.1). These models do not
upscale — run interpolation and upscaling as separate stages.
| Task | Model | Code | Notes |
|---|---|---|---|
| Motion deblur | Themis 2 | thm-2 | Fast camera shake / fast subjects; recovers clarity without harsh edges |
| Colorization | Video Colorization | color-1 | B&W → color, temporally consistent (no per-frame flicker); no params |
| SDR→HDR | Hyperion / Hyperion 2 | hyp-1, hyp-2 | transfer_function "pq"/"hlg"; exposure/saturation/highlight controls; Hyperion 2 supports ProRes PQ / EXR ACES |
| Foreground removal | Foreground Object Removal | remove-1 | Needs source video + tracked matte/mask video; reconstructs background |
| Stabilization | (desktop feature) | — | Available in Topaz Video AI desktop; confirm current API exposure before scripting |
slp-2.5) for faithful
realism; Astra 2 (ast-2) when you want new stylized detail on wide shots. Fix
temporal warping first; upscaling amplifies it.prob-4) default; Artemis for
denoise+sharpen on visible compression/halos; Iris if faces are the priority.sl-1) or Mini (slm-1, auto-
deinterlaces small formats); Iris LQ/MQ for a lighter deterministic pass.dtv-4 / DV ddv-3 variants), or
Starlight Mini for degraded interlaced.apo-8) default; Aion (aion-1)
for extreme slow-mo with big parallax; Chronos for tough fps conversions.nyx-3); Nyx XL for severe noise; Nyx HF to preserve source.thm-2). B&W → color-1. SDR→HDR → Hyperion.Deterministic enhancement models (Proteus, Artemis, Dione, Theia, Nyx, Themis) share a common tuning surface (verified 2026-07-10; ranges are decimals):
video_type: "Progressive" | "Interlaced" | "ProgressiveInterlaced"field_order: "TopFirst" | "BottomFirst" | "Auto" (interlaced sources)auto: "Auto" | "Manual" | "Relative" (whether the model self-tunes)focus_fix_level: "None" | "Normal" | "Strong"compression, details, noise, halo, blur, preblur: -1 … 1prenoise, grain: 0 … 0.1grain_sigma: 0 … 1; grain_size: 0 … 5grain_type: "silver_rich" | "gaussian" | "grey"recover_original_detail_value: 0 … 1 (Nyx)Heuristics: start with auto and only go manual to fix a specific defect. Raise
details/sharpen cautiously — over-sharpening is the fast road to waxy faces and
shimmer. Add a little grain back after heavy denoise to avoid a plastic look.
Diffusion models (Starlight/Astra) expose creativity/realism instead: higher
creativity = more invented detail = more identity/artifact risk.
The Video API is an async, multi-step job, not a single call. Auth on every
request: header X-API-Key: <key>. HTTPS only. Per-request source limit 500 MB
(verified 2026-07-10) — segment longer/larger sources. Expect HTTP 429 under load;
use exponential backoff.
Lifecycle (base https://api.topazlabs.com/video/):
POST /video/ with source, output, and filters objects.
Returns a requestID. Free — creating a request costs no credits (credits are
charged when the job actually processes).PATCH /video/{requestID}/accept → returns S3 upload URL(s).PUT the file to each S3 URL with Content-Type: video/mp4; keep
each returned eTag.PATCH /video/{requestID}/complete-upload with the
uploadResults array of {partNum, eTag} to start processing.GET /video/{requestID}/status until completed; response carries the
download link. Also available: create-express-request, cancel-request,
delete-files, get-request-metrics, get-request-history; account credits at
/account/credits.Formats: MP4 container in the documented examples; audio commonly AAC with
audioTransfer: "Copy" to pass audio through unchanged. output.frameRate and
output.resolution define the target; frame-interpolation fps/slowmo live in the
filter. Confirm current container/codec support in the reference before committing a
pipeline to a non-MP4 source.
Separate, simpler async flow for stills: POST /enhance/async (plus
sharpen/denoise/restore/lighting/matting/tool), GET /status/{id},
GET /download/{id}. Params include model (e.g. Gigapixel Standard/High Fidelity/Low Resolution/Art & CGI/Recover Faces, plus Wonder/Bloom/Redefine),
output_format, and the image upload. Image credit rule (verified 2026-07-10):
~1 credit per 24 MP of output, scaling up for larger outputs. Use the Image API
to upscale key frames, posters, or thumbnails from a video pipeline.
Billing is credit-based. Per-credit USD from the API product page: $0.12 (Starter/pay-as-you-go), $0.10 (Developer), $0.08 (Scale). The product page listed plans (Developer $50/500 credits/mo, Scale $240/3,000 credits/mo, Enterprise custom) while the developer docs emphasize pay-as-you-go with no expiration — treat the plan structure as changeable and re-verify before quoting.
Approximate video credit cost for a 10 s 1080p clip (scales with duration and resolution; 4K is roughly 3× the 1080p figure):
Cost implication: enhance last and only what you ship. Diffusion/creative models (Starlight, Astra) cost 3–20× a Proteus pass, so reserve them for footage that deterministic upscaling genuinely cannot fix, and prototype settings on a short clip.
Enhancement helps when the source has recoverable structure the model was trained for: real footage that is soft/noisy/compressed/low-res/interlaced, or AI footage that is merely low-res but temporally stable. It hurts — or is wasted — when:
creativity. Mitigate: lower
creativity, use Precise/Proteus for preservation, and check identity across the
whole clip, not one frame.duplicate/duplicateThreshold and split on scene cuts.(Production heuristic + practitioner reports.)
Enhancement can make a person look like they were filmed at higher fidelity than they were, and creative/diffusion models can invent facial detail — so enhanced footage of real people can misrepresent them. Only enhance footage you have the right to process. For archival/third-party footage, confirm licensing before upload (frames leave your machine to Topaz's cloud in the API path). For anything evidentiary, journalistic, or identity-sensitive, avoid models that add invented detail and disclose that AI enhancement was applied. Follow Topaz's terms and your jurisdiction's rules on synthetic-media disclosure.
slp-2.5) for AI-source realism; or Proteus
(prob-4) if budget-sensitive and the source is clean.{
"source": { "resolution": {"width":1280,"height":720}, "container":"mp4",
"size": 18450000, "duration": 8, "frameRate": 24, "frameCount": 192 },
"output": { "resolution": {"width":1920,"height":1080}, "container":"mp4",
"audioCodec":"AAC", "audioTransfer":"Copy", "frameRate": 24,
"dynamicCompressionLevel":"High" },
"filters": [ { "model":"prob-4", "details":0.2, "noise":0.0, "sharpen":0.1 } ]
}
apo-8); switch to Aion (aion-1) if heavy parallax/fast pan.{ "model":"apo-8", "fps":60, "slowmo":1, "duplicate":true, "duplicateThreshold":0.1 } (raise slowmo toward 2–2.5 for time-stretch).duplicate handling avoids
morphing across repeated frames. Do not expect any resolution change here.dtv-4) to deinterlace + enhance; or Starlight Mini (slm-1)
if the source is degraded small-format film that also needs restoration.video_type:"Interlaced", field_order:"Auto" (set explicitly if you
know top/bottom-first).nyx-3); Nyx XL (nxl-1) only if noise dominates.auto:"Auto"; if plastic, set grain:0.03,
grain_type:"gaussian" to re-add texture; keep details low.prob-4) upscale pass if resolution must increase —
never denoise and 4×-upscale in one aggressive step.Primary (official Topaz Labs):
Secondary (independent practitioner reports, disclosed-method, for artifact/QA heuristics only — not sole basis for technical claims):