MM-prompter/README.md

48 lines
3.1 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# Moxie Multimedia Prompt Creator
An agent skill that turns a vague prompt plus a total video length (seconds) into a
ready-to-run generation package:
- `segments.txt` — N segment prompts, joined by `|`. The video creator node splits the
total length evenly across segments (`N = max(1, round(total_seconds / 10))`) and
generates them one by one. Default format is full-reference (ref2va); FL2VA
(first–last frame) and segmented (one `segment-N/segment.txt` file per segment with
`@PictureN`/`@AudioN` tokens) are opt-in alternatives.
- `Image-N.json` — one 16:9 character-sheet text-to-image prompt per character that
has no user-provided image reference, consumed one at a time by a ComfyUI workflow.
- `Segment-img-N.json` — one 16:9 first-frame image prompt per segment, rendered by
the image engine with the character sheets as reference inputs; FL2VA mode adds
`Segment-img-N-last.json` per segment for the last frame.
- `image-map.txt` — manifest mapping each `<Subject N>` to its image file
(user-provided filename or generated `Image-N.json`).
## Layout
| Path | Purpose |
| --- | --- |
| `SKILL.md` | Skill entry point: triggers, mode selection, pipeline, output contract, validation checklist |
| `references/ref2va-segment-format.md` | Authoritative per-segment format for the default mode (sections, labels, shots, audio template) |
| `references/fl2va-segment-format.md` | The opt-in FL2VA first–last frame video prompt format |
| `references/segmented-output-format.md` | The opt-in segmented layout: one `segment-N/segment.txt` per segment with `@PictureN`/`@AudioN` tokens, otherwise identical to ref2va |
| `references/t2i-character-sheet.md` | Character-sheet caption rules (four-panel photorealistic turnaround) and the two-key JSON contract |
| `references/frame-image-prompts.md` | Per-segment first/last frame image prompt rules (`Segment-img-N.json`) |
| `references/worked-example.md` | Complete end-to-end example, including the audio (singing) and FL2VA variants |
| `scripts/validate_outputs.py` | Optional validator the agent can run on its outputs |
| `segment-guide.md`, `t2i-prompt-rules/` | Source rule documents the skill was adapted from |
## Usage
1. Pull this repo into your agent's skills folder so that `SKILL.md` is discoverable.
2. Give the agent a vague scene prompt and the total video length in seconds, plus
optionally: song lyrics, an audio file mention (e.g. "use midnight.mp3"),
per-character image references, style hints, and — only if wanted — an explicit
request for FL2VA / first-last frame mode or segmented one-file-per-segment
output with `@PictureN`/`@AudioN` references.
3. The agent writes `segments.txt`, `Image-N.json` for characters lacking references,
`Segment-img-N.json` (and `Segment-img-N-last.json` in FL2VA mode), and
`image-map.txt` into the project folder.
4. Verify before use: `python3 scripts/validate_outputs.py --segments segments.txt
--expected-n <N> [--dir .] [--lyrics-file lyrics.txt]` — add
`--mode fl2va --total-seconds <seconds>` for FL2VA runs, or
`--mode segmented --segments-dir <folder>` for segmented runs.