90 lines
5.6 KiB
Markdown
90 lines
5.6 KiB
Markdown
# Segment Frame Image Prompts (Segment-img-N.json)
|
||
|
||
This reference defines how the skill writes the per-segment frame image prompts.
|
||
The image generation engine accepts image input, so it renders every segment frame
|
||
while using the character sheets (`Image-N.json`) as reference images — that is what
|
||
keeps the people consistent from sheet to frame to video.
|
||
|
||
Two kinds of frame files exist:
|
||
|
||
| File | Frame | Modes |
|
||
| --- | --- | --- |
|
||
| `Segment-img-N.json` | the FIRST frame of segment N (what the segment's video opens on) | always (ref2va default and FL2VA) |
|
||
| `Segment-img-N-last.json` | the LAST frame of segment N (what the segment's video ends on) | FL2VA mode only — never written in ref2va mode |
|
||
|
||
N is the segment number (1..n), not a subject number. One file per frame, written into
|
||
the project folder next to `segments.txt`.
|
||
|
||
## 1. Output contract (exact)
|
||
|
||
Identical to the character-sheet contract — one compact single-line JSON object with
|
||
exactly two keys, no markdown fence, no commentary:
|
||
|
||
```json
|
||
{"expanded_caption": "ONE_DETAILED_ENGLISH_CAPTION", "aspect_ratio": "16:9"}
|
||
```
|
||
|
||
- `aspect_ratio` is ALWAYS the string `"16:9"`.
|
||
- Every ASCII double quote inside the caption is serialized as `\"`; prefer wording
|
||
without quotes at all. The file must parse with a standard JSON parser.
|
||
|
||
## 2. What each frame depicts
|
||
|
||
A frame caption describes ONE story state, frozen. Derive it from the segment text
|
||
that is already drafted — never invent new story content:
|
||
|
||
- `Segment-img-1.json` — the scene's opening composition: the state at the very start
|
||
of segment 1's `[Shot 1]`.
|
||
- `Segment-img-N.json` (N > 1) — segment N's opening state, which continues segment
|
||
N−1's ending story state: same characters, positions, wardrobe, props, and lighting
|
||
(the camera may re-frame). This is the handoff that keeps segments flowing as one
|
||
longer scene.
|
||
- `Segment-img-N-last.json` (FL2VA mode) — the state at the very END of segment N's
|
||
final `[Shot N]`, i.e. the state the FL2VA instruction pins to the `S.SS`-second
|
||
mark. In FL2VA mode, segment N's last frame and segment N+1's first frame describe
|
||
the same story state (word them independently; they must not contradict).
|
||
|
||
Compose from the matching shot description: keep its composition, character placement,
|
||
wardrobe, environment, lighting, and palette. Convert process verbs into pose states
|
||
(where she "is walking", write "mid-step"; where a light "is flickering", write its
|
||
visible glow state).
|
||
|
||
## 3. Caption design rules
|
||
|
||
ONE fluent English descriptive paragraph, present tense, covering:
|
||
|
||
1. **Medium declaration**: a photorealistic, cinematic film still in 16:9 widescreen.
|
||
This is a single full-bleed frame — no panels, no grids, no borders, no text, no
|
||
labels, no watermark, no character-sheet layout of any kind.
|
||
2. **Reference anchor**: for each on-screen character, state that it is the same
|
||
character as in the supplied character reference images (e.g. "the same woman as
|
||
in the supplied character reference images", "the same scout robot as in the
|
||
supplied reference images").
|
||
3. **Locked traits**: each on-screen character's full story-bible look in the exact
|
||
locked wording — hair, eyes, skin, build, every wardrobe piece with color and
|
||
material, worn props. Off-screen characters are simply absent; never mention them.
|
||
4. **Composition**: shot size and camera angle, each character's position and pose in
|
||
the frame, the environment, the light, and the palette — mirroring the opening
|
||
(or closing) state written in the segment's shot description.
|
||
5. **Photorealism cues**: natural skin texture, realistic fabric/material texture,
|
||
sharp focus, believable proportions — the same photographic language the sheets
|
||
use, so the frame reads as the same world as the reference sheets.
|
||
|
||
Banned in frame captions (same list as the sheets — these words pull the generation
|
||
toward cartoons): cartoon, anime, manga, illustration, stylized, CGI, 3D render,
|
||
mascot, avatar, character design board, name tag, swatch, palette strip, drafting
|
||
paper. Also never write: "four panels" or any sheet vocabulary, any meta wording
|
||
("first frame", "last frame", "segment", timestamps, shot labels), any
|
||
`<Subject N>` / `<Picture N>` markup, and never any lyric text.
|
||
|
||
## 4. Example
|
||
|
||
First frame of segment 1 for the desert project (story bible: astronaut — woman in
|
||
her thirties, short black hair, brown eyes, matte-white EVA suit with orange stripe
|
||
accents, grey reinforced gloves, clear dome helmet, wrist scanner on the left
|
||
forearm; robot — boxy, pale-grey shell, single round blue lens eye, short antenna):
|
||
|
||
```json
|
||
{"expanded_caption": "A photorealistic cinematic film still in 16:9 widescreen showing the same characters as in the supplied character reference images: the astronaut, a woman in her thirties with short black hair and brown eyes, and her scout robot. Wide establishing shot at dusk on a red desert dune: the woman crests the rippled dune ridge on the left of frame, mid-step with boots pressing into the sand, wearing the exact matte-white EVA suit with orange stripe accents, grey reinforced gloves, clear dome helmet, and the wrist-mounted scanner on her left forearm, her face visible through the dome with natural skin texture. The boxy scout robot with the pale-grey shell, single round blue lens eye, and short antenna wheels up the slope to her right, treads leaving a neat triple track. Ahead of them the three-story monolith of black glass stands small on the basin floor under a sky grading from burnt orange into indigo, low dusk light casting long violet shadows across the sand, true-to-life fabric and rubber texture, sharp focus, single full-bleed frame with no text, no borders, no panels.", "aspect_ratio": "16:9"}
|
||
```
|