MM-prompter/references/frame-image-prompts.md

90 lines
5.6 KiB
Markdown
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# Segment Frame Image Prompts (Segment-img-N.json)
This reference defines how the skill writes the per-segment frame image prompts.
The image generation engine accepts image input, so it renders every segment frame
while using the character sheets (`Image-N.json`) as reference images — that is what
keeps the people consistent from sheet to frame to video.
Two kinds of frame files exist:
| File | Frame | Modes |
| --- | --- | --- |
| `Segment-img-N.json` | the FIRST frame of segment N (what the segment's video opens on) | always (ref2va default and FL2VA) |
| `Segment-img-N-last.json` | the LAST frame of segment N (what the segment's video ends on) | FL2VA mode only — never written in ref2va mode |
N is the segment number (1..n), not a subject number. One file per frame, written into
the project folder next to `segments.txt`.
## 1. Output contract (exact)
Identical to the character-sheet contract — one compact single-line JSON object with
exactly two keys, no markdown fence, no commentary:
```json
{"expanded_caption": "ONE_DETAILED_ENGLISH_CAPTION", "aspect_ratio": "16:9"}
```
- `aspect_ratio` is ALWAYS the string `"16:9"`.
- Every ASCII double quote inside the caption is serialized as `\"`; prefer wording
without quotes at all. The file must parse with a standard JSON parser.
## 2. What each frame depicts
A frame caption describes ONE story state, frozen. Derive it from the segment text
that is already drafted — never invent new story content:
- `Segment-img-1.json` — the scene's opening composition: the state at the very start
of segment 1's `[Shot 1]`.
- `Segment-img-N.json` (N > 1) — segment N's opening state, which continues segment
N−1's ending story state: same characters, positions, wardrobe, props, and lighting
(the camera may re-frame). This is the handoff that keeps segments flowing as one
longer scene.
- `Segment-img-N-last.json` (FL2VA mode) — the state at the very END of segment N's
final `[Shot N]`, i.e. the state the FL2VA instruction pins to the `S.SS`-second
mark. In FL2VA mode, segment N's last frame and segment N+1's first frame describe
the same story state (word them independently; they must not contradict).
Compose from the matching shot description: keep its composition, character placement,
wardrobe, environment, lighting, and palette. Convert process verbs into pose states
(where she "is walking", write "mid-step"; where a light "is flickering", write its
visible glow state).
## 3. Caption design rules
ONE fluent English descriptive paragraph, present tense, covering:
1. **Medium declaration**: a photorealistic, cinematic film still in 16:9 widescreen.
This is a single full-bleed frame — no panels, no grids, no borders, no text, no
labels, no watermark, no character-sheet layout of any kind.
2. **Reference anchor**: for each on-screen character, state that it is the same
character as in the supplied character reference images (e.g. "the same woman as
in the supplied character reference images", "the same scout robot as in the
supplied reference images").
3. **Locked traits**: each on-screen character's full story-bible look in the exact
locked wording — hair, eyes, skin, build, every wardrobe piece with color and
material, worn props. Off-screen characters are simply absent; never mention them.
4. **Composition**: shot size and camera angle, each character's position and pose in
the frame, the environment, the light, and the palette — mirroring the opening
(or closing) state written in the segment's shot description.
5. **Photorealism cues**: natural skin texture, realistic fabric/material texture,
sharp focus, believable proportions — the same photographic language the sheets
use, so the frame reads as the same world as the reference sheets.
Banned in frame captions (same list as the sheets — these words pull the generation
toward cartoons): cartoon, anime, manga, illustration, stylized, CGI, 3D render,
mascot, avatar, character design board, name tag, swatch, palette strip, drafting
paper. Also never write: "four panels" or any sheet vocabulary, any meta wording
("first frame", "last frame", "segment", timestamps, shot labels), any
`<Subject N>` / `<Picture N>` markup, and never any lyric text.
## 4. Example
First frame of segment 1 for the desert project (story bible: astronaut — woman in
her thirties, short black hair, brown eyes, matte-white EVA suit with orange stripe
accents, grey reinforced gloves, clear dome helmet, wrist scanner on the left
forearm; robot — boxy, pale-grey shell, single round blue lens eye, short antenna):
```json
{"expanded_caption": "A photorealistic cinematic film still in 16:9 widescreen showing the same characters as in the supplied character reference images: the astronaut, a woman in her thirties with short black hair and brown eyes, and her scout robot. Wide establishing shot at dusk on a red desert dune: the woman crests the rippled dune ridge on the left of frame, mid-step with boots pressing into the sand, wearing the exact matte-white EVA suit with orange stripe accents, grey reinforced gloves, clear dome helmet, and the wrist-mounted scanner on her left forearm, her face visible through the dome with natural skin texture. The boxy scout robot with the pale-grey shell, single round blue lens eye, and short antenna wheels up the slope to her right, treads leaving a neat triple track. Ahead of them the three-story monolith of black glass stands small on the basin floor under a sky grading from burnt orange into indigo, low dusk light casting long violet shadows across the sand, true-to-life fabric and rubber texture, sharp focus, single full-bleed frame with no text, no borders, no panels.", "aspect_ratio": "16:9"}
```