算法艺术创作
algorithmic-art
通过代码和可调参数创作生成艺术与交互式视觉效果。
higgsfield-seedance-vfx【设计与创意】Writes, improves, or rewrites Seedance 2.0 prompts that TRANSFORM footage the user already has (video-to-video), rather than building a scene from scratch. Use whenever a real clip is the starting point and they want to: add a VFX element (set a head or hair on fire, transform a hand, make a limb invisible), swap the environment around a preserved su…
独立 GitHub 快照 · 自动分类 · 以原作者文档为准
This skill is for editing a clip the user already has: keep a real subject and the
real camera move, change only what they ask for. It is the video-to-video sibling of
../higgsfield-seedance/SKILL.md (the general Seedance director). It reuses that skill's
grammar verbatim — the six-slot formula, the Prompt-Craft Laws, the preflight linter —
and adds the transformation layer below. Do not contradict the parent skill; when a shot
needs filter-safety, mode selection, or engine rules, defer to it.
This file is the Seedance 2.0 v2v lane. It stays the right choice when the job needs 4K,
mode=std, or agenrehint. If the plate job is running on Seedance 2.5 — up to 1080p, up to 30 s, many references, platform start/end frames inomni_reference— the lane isomni_referencewith the clip attached as a video reference, and its production doctrine (source ≥ 4 s, duration = source, the four-batch rule, the performance-inheritance clause) lives in../higgsfield-seedance-2-5/VFX-PIPELINE.md.
This skill is a video-to-video layer on top of
../higgsfield-seedance/SKILL.md. Every VFX transform is still a Seedance prompt. This skill only changes the starting point: a real source clip whose subject, performance, and camera move must survive the edit.higgsfield-seedance§ Seedance 2.0 Prompt Modes / Transformation covers the in-clip morph (a character visibly becoming something else in one take); this skill covers preservation-VFX — lock the real plate, layer the effect in.
Routing aids — read the linked sections for the actual rules.
fast can't do 4K; Cinema Studio caps at 1080p) →@source declares the clip as the base (not a style ref); add @creature/@element only when a real texture keeps getting faked →On the line "…") + numeric (At about Ts); see references/dialogue-timing.md →total − intro = surviving window for the source performance; recompute on every change →references/first-frame.md →A transformation prompt has two jobs that pull against each other: lock everything that makes the source recognizable (the person's identity, face, wardrobe, performance, framing, lens, and camera motion), and change only the named element. If you under-specify the lock, Seedance re-rolls the face or the camera and the edit stops matching the original. So every prompt states both halves explicitly, and repeats the most fragile guardrail — usually "face and identity unchanged" — at the end of the action.
This is the whole blueprint: real footage goes in, the exact same shot comes back — same subject, same movement — with only the one requested change applied.
Run everything in Seedance 2.0, mode=std, 4K. The 4K matters: faces, lip-sync and fine
detail hold at 4K where they warp and fall apart at 1080p — and a footage transform lives or
dies on the preserved face reading as the same face. The 4k resolution enum is
model-verified (../../specs/model-specs.json → seedance_2_0); the "detail holds at 4K"
observation is a practitioner claim, strong but not a spec guarantee.
Two model constraints to respect (from ../higgsfield-seedance/SKILL.md § Pre-flight Linter):
native 4K is available in mode=std only — mode=fast (Seedance 2.0 Fast) caps at
480p/720p, and inside Cinema Studio the model is still capped at 1080p. So a 4K footage
transform must run in std mode, on the standard Seedance 2.0 surface. If the user is on fast
mode or in Cinema Studio and asks for 4K, flag the cap before they generate.
@source declarationThe source clip is the base, not a style reference. One line:
@source: Original <clip name> — <who/what is in it: subject, wardrobe, setting, action>. Preserve
<identity, face, wardrobe, performance, framing, camera and motion> exactly; <what to change —
e.g. enhance only the environment / add the creature on the tower / transform only the right arm>.
If a transformation needs a real texture the model keeps faking (an animal's fur, a specific face), add a second input as a texture reference and declare it:
@creature: Reference photo of a real <animal> — <fur / face / anatomy notes>. Appearance and
fur/skin texture reference only; ignore the photo's background and lighting, do not use it for the
environment.
The user supplies their own descriptions of what is in their files — use the tags correctly,
don't invent what the clip contains. But before writing @source for a clip you can open,
inspect it: read its duration / fps / aspect and extract a few frames. Build @source and
the specs runtime from what the footage actually shows — subject, wardrobe, framing, camera
move, time of day, key direction — not from the user's one-line summary. Set the specs duration
to the probed runtime by default. If no source clip is described, ask what footage they're
starting from before writing.
Seedance reads an uploaded video as a set of frames, not as a watched clip — so the frame content (subject, walk, light) is the context it has. Same principle as the screenshot → Claude workflow in
../higgsfield-seedance/SKILL.md§ Load-Bearing Rule.
One compact line. Always include the source-matching constraints:
Photoreal. <aspect, default 16:9>. <duration — match the source clip>s. 4K. <look / grade>.
NON-IP — generic <creature/design>, not based on any brand or character. <SFX only | SFX and
source dialogue only>.
../higgsfield-seedance/SKILL.md § The Rewrite Playbook / Brand · IP.)SFX only for added effects; SFX and source dialogue only when the source talk
track must survive (e.g. a zoom synced to a spoken line — see
references/dialogue-timing.md).The source is a single take, so describe continuous camera movement, not cuts. Lead with the shot/lens and "same framing as the source," then the preserved performance, then the transformation, then any timed camera move. Close with the lock-down clause.
End with a specific, ordered SFX note, exactly as the parent grammar requires. For added effects be behavioral: not "fire" but "a soft whoomph as it catches, then a low steady flame roar and crackle, occasional ember pop." Sync every effect (footsteps, impacts, wind, creature calls, servo whirs) to the visible action.
The workflow scales in difficulty. The steps are identical at every level — inspect the clip, name the one change, lock the rest — but the harder the camera moves, the harder the effect has to track:
Locked-off shots are easy — the frame barely changes, so the model just paints the effect in. The difficulty is entirely in how much the camera moves.
Set a head on fire, transform a hand, make a limb invisible, perch a creature on a landmark. Keep the whole plate; layer the effect in.
Keep the person, their vehicle, the seatbelt, the camera rig and its move; swap the whole world.
First decide the fork with the user — it changes everything:
Color matching alone is not enough to make a preserved subject sit in a new world — that's the most common "looks pasted in" failure. When integrating a subject (or a creature) into a plate, go beyond color with this recipe:
State the time of day and key direction concretely ("soft, diffused midday daylight with the key
coming from screen-right"). "Softer" means a larger, more diffuse source: gentle soft-edged
shadows, low contrast, smooth highlight rolloff, light haze. Full cinematic-lighting vocabulary is
in ../../vocab.md § Lighting.
When a creature or hard-surface element is added and must read as real:
@creature above). When
you already know exactly what you want, it's better to show the model than to describe it;
generate the reference in ../higgsfield-gpt-image-2/SKILL.md (GPT Image 2) or Nano Banana Pro,
then point the prompt at it.A crash zoom or smooth push-in landing on a beat is a recurring payoff. Anchor it two ways at
once so it lands even if Seedance's internal timing drifts: a semantic cue and a numeric cue.
The full measurement procedure — how to read T off the source audio and convert a timecode —
is in references/dialogue-timing.md.
On the line "<exact words>," the camera <snaps into a hard crash zoom | begins a smooth, steady push-in> …. Requires SFX and source dialogue only in the specs so the talk
track survives.At about <T> seconds … the camera …. Get T from the source audio (or a visible
action beat — "at about 2.2s, on his finger snap").The mirror of the push-in: open tight on the added element in isolation — a long-telephoto, compressed framing of the creature/effect with the subject out of frame — then move outward to land on the real plate. Two flavors, match the user's word:
Anchor the landing the same two ways as a timed zoom, and demand a 100% match of the source composition at the landing: name the matched attributes — same angle, headroom, horizon, lens character — or the model lands on a near-miss framing that no longer cuts against the original. After the landing, hand off to the preserved take and keep the source's own camera motion running.
When the payoff is the subject's mouth matching a specific line, quote it verbatim and anchor
it twice: once inside the action ("…lips matching the source exactly, saying clearly: ''…")
and once in the SFX/dialogue line. Require SFX and source dialogue only in the specs so the talk
track survives, and add "lips matching the source exactly" to the lock-down clause. Then check the
line against the surviving dialogue window (see § Duration discipline / Prepended-intro budget) —
a line that runs ~6s cannot sit in a 5s tail. If it doesn't fit, resolve the runtime before
delivering; don't ship a prompt that can't lip-sync. Dialogue + [AUDIO: Xs] mechanics live in
../higgsfield-audio/SKILL.md.
Default to the source clip's exact runtime. When the user changes the runtime, recompute any numeric zoom timing and tell them the new mark. When a long hold lands on a static creature, add small "living" micro-movements (a slow blink, jaw shift, steady breath) so it doesn't look frozen.
When you prepend a beat (a reveal, a telephoto hold, an establishing creature shot) to footage you must preserve, the preserved take does not get longer — it gets pushed back. State the arithmetic every time and flag what falls off:
total runtime − intro length = surviving window for the source performance
If the source take is longer than that surviving window, some of it cannot play. Say so explicitly and offer the three resolutions, in order of fidelity:
Never promise "100% lip-sync" and a prepended intro on a fixed total without doing this subtraction first. Recompute and re-flag it on every change to either number.
Before spending video credits, it's often worth generating the transformed opening still as an
image, locking the look, then animating from it. See references/first-frame.md for the full
procedure (model, settings, inputs, upload mechanics, and how to hand the still back to Seedance
as a start_image). This pairs with ../higgsfield-seedance/SKILL.md § Drafts Validate the Prompt
— pin the frame, not the roll.
The user iterates fast and in small steps ("softer light," "from the right," "bigger snowier
mountains," "make the chimp huge," "a beat before the zoom," "keep the original runtime"). Change
only the named thing and keep the rest of the prompt stable — re-rolling the whole prompt loses
what already worked. When refining a generated still, edit the chosen result (pass it back as the
base) and fix only what's off rather than starting over. This is the footage-transform case of
../higgsfield-prompt/SKILL.md § The Iteration Rule.
Output in English first, plain text — no bold, no headers, no bullets inside the prompt, not in a code block. Easy to copy as-is. Chinese translation only if asked, after the English, same format.
A short label above each prompt (e.g. Hook_2 · Variant 1 — Through the clouds) is fine and helps
when you deliver several variants; the prompt body itself stays plain text.
Skeleton:
@source: ...
@creature: ... (only if a texture reference is used)
Photoreal. 16:9. <N>s. 4K. <look/grade>. NON-IP — generic <X>. SFX [and source dialogue] only.
<Continuous shot, same framing as source. Preserved performance. The transformation, with physics
and plate interaction. Any timed camera move with semantic + numeric anchor. Lock-down clause: face
and identity unchanged; everything else identical to the source.>
SFX [and source dialogue] only: <specific, ordered sounds>.
Terse and kinetic; physically precise (exact materials, behaviors, scale); director-minded (lenses,
angles, moves); non-generic (no "beautiful / stunning / amazing" — texture words instead);
emotionally controlled. Don't inflate, don't soften, don't explain what things "represent." Same
anti-slop discipline as ../higgsfield-seedance/SKILL.md § Voice Rewrite.
Images ≤ 9; videos ≤ 3 items, total ≤ 15s; audio ≤ 3 MP3s, total ≤ 15s; total mixed inputs ≤ 12;
generation duration 4–15s. A source clip plus a texture-reference photo fits easily. If a request
needs more inputs than allowed, flag it and say what to prioritize. (Verified against
../../specs/model-specs.json → seedance_2_0: media_roles include video, image, audio,
start_image, end_image; 4k is a legal resolution in mode=std.)
@source (preserve all, add effect) → specs + 4K + NON-IP + SFX only →
continuous shot, preserved performance, effect igniting/creeping with plate interaction, subject unfazed → lock-down clause → SFX.@source (preserve subject + vehicle + rig + motion, replace world) →
specs + 4K + grade for the new world → continuous shot from the same rig, new world streaming past with parallax, relight to match or relight-all → lock-down → SFX.@source + @creature (texture ref) → specs + 4K + NON-IP + SFX and source dialogue only → continuous locked shot, giant photoreal creature integrated on the landmark, subject delivering to camera → at ~T / on the line "…", smooth push-in keeping the landmark in frame, creature turns to camera → lock-down → SFX and dialogue.@source (preserve subject + performance + lip-sync + framing, add element, prepend a telephoto intro) + @creature (texture ref) → specs + 4K + NON-IP + SFX and source dialogue only → open tight/telephoto on the added element in isolation for the intro beat, hard or smooth zoom-out at ~T landing on a 100% match of the source composition, then the preserved take plays with exact lip-sync to the quoted line while the added element continues behind → budget check (intro + remaining = total) →
lock-down → SFX and dialogue.A ready-to-fill skeleton plus worked variants live in
../../templates/seedance/footage-vfx-transform.md.
../higgsfield-seedance/SKILL.md — the parent Seedance director: six-slot formula, Prompt-Craft
Laws, engine rules, content-filter preflight linter, and the in-clip Transformation prompt mode../higgsfield-audio/SKILL.md — audio-as-conditioning, [AUDIO: Xs] dialogue/SFX, lip-sync (the
timed-zoom-to-dialogue and source-dialogue-preservation cases)../higgsfield-camera/SKILL.md — video reference, the Load-Bearing Rule, camera-move vocabulary
(handheld preservation + moves you never filmed)../higgsfield-gpt-image-2/SKILL.md — generate the creature/texture reference image and the
transformed start frame../higgsfield-facs/SKILL.md — muscle-level facial control when a dialogue-preserving transform
also needs an exact expressionreferences/dialogue-timing.md · references/first-frame.md — the two procedures this skill leans on