48 lines
3.1 KiB
Markdown
48 lines
3.1 KiB
Markdown
# Moxie Multimedia Prompt Creator
|
||
|
||
An agent skill that turns a vague prompt plus a total video length (seconds) into a
|
||
ready-to-run generation package:
|
||
|
||
- `segments.txt` — N segment prompts, joined by `|`. The video creator node splits the
|
||
total length evenly across segments (`N = max(1, round(total_seconds / 10))`) and
|
||
generates them one by one. Default format is full-reference (ref2va); FL2VA
|
||
(first–last frame) and studio (one `segment-N/segment.txt` file per segment with
|
||
`@imageN`/`@audioN` tokens) are opt-in alternatives.
|
||
- `Image-N.json` — one 16:9 character-sheet text-to-image prompt per character that
|
||
has no user-provided image reference, consumed one at a time by a ComfyUI workflow.
|
||
- `Segment-img-N.json` — one 16:9 first-frame image prompt per segment, rendered by
|
||
the image engine with the character sheets as reference inputs; FL2VA mode adds
|
||
`Segment-img-N-last.json` per segment for the last frame.
|
||
- `image-map.txt` — manifest mapping each `<Subject N>` to its image file
|
||
(user-provided filename or generated `Image-N.json`).
|
||
|
||
## Layout
|
||
|
||
| Path | Purpose |
|
||
| --- | --- |
|
||
| `SKILL.md` | Skill entry point: triggers, mode selection, pipeline, output contract, validation checklist |
|
||
| `references/ref2va-segment-format.md` | Authoritative per-segment format for the default mode (sections, labels, shots, audio template) |
|
||
| `references/fl2va-segment-format.md` | The opt-in FL2VA first–last frame video prompt format |
|
||
| `references/studio-output-format.md` | The opt-in studio layout: one `segment-N/segment.txt` per segment with `@imageN`/`@audioN` tokens, otherwise identical to ref2va |
|
||
| `references/t2i-character-sheet.md` | Character-sheet caption rules (four-panel photorealistic turnaround) and the two-key JSON contract |
|
||
| `references/frame-image-prompts.md` | Per-segment first/last frame image prompt rules (`Segment-img-N.json`) |
|
||
| `references/worked-example.md` | Complete end-to-end example, including the audio (singing) and FL2VA variants |
|
||
| `scripts/validate_outputs.py` | Optional validator the agent can run on its outputs |
|
||
| `segment-guide.md`, `t2i-prompt-rules/` | Source rule documents the skill was adapted from |
|
||
|
||
## Usage
|
||
|
||
1. Pull this repo into your agent's skills folder so that `SKILL.md` is discoverable.
|
||
2. Give the agent a vague scene prompt and the total video length in seconds, plus
|
||
optionally: song lyrics, an audio file mention (e.g. "use midnight.mp3"),
|
||
per-character image references, style hints, and — only if wanted — an explicit
|
||
request for FL2VA / first-last frame mode or studio one-file-per-segment
|
||
output with `@imageN`/`@audioN` references.
|
||
3. The agent writes `segments.txt`, `Image-N.json` for characters lacking references,
|
||
`Segment-img-N.json` (and `Segment-img-N-last.json` in FL2VA mode), and
|
||
`image-map.txt` into the project folder.
|
||
4. Verify before use: `python3 scripts/validate_outputs.py --segments segments.txt
|
||
--expected-n <N> [--dir .] [--lyrics-file lyrics.txt]` — add
|
||
`--mode fl2va --total-seconds <seconds>` for FL2VA runs, or
|
||
`--mode studio --segments-dir <folder>` for studio runs.
|