MM-prompter/README.md

3.1 KiB
Raw Blame History

Moxie Multimedia Prompt Creator

An agent skill that turns a vague prompt plus a total video length (seconds) into a ready-to-run generation package:

  • segments.txt — N segment prompts, joined by |. The video creator node splits the total length evenly across segments (N = max(1, round(total_seconds / 10))) and generates them one by one. Default format is full-reference (ref2va); FL2VA (first–last frame) and studio (one segment-N/segment.txt file per segment with @imageN/@audioN tokens) are opt-in alternatives.
  • Image-N.json — one 16:9 character-sheet text-to-image prompt per character that has no user-provided image reference, consumed one at a time by a ComfyUI workflow.
  • Segment-img-N.json — one 16:9 first-frame image prompt per segment, rendered by the image engine with the character sheets as reference inputs; FL2VA mode adds Segment-img-N-last.json per segment for the last frame.
  • image-map.txt — manifest mapping each <Subject N> to its image file (user-provided filename or generated Image-N.json).

Layout

Path Purpose
SKILL.md Skill entry point: triggers, mode selection, pipeline, output contract, validation checklist
references/ref2va-segment-format.md Authoritative per-segment format for the default mode (sections, labels, shots, audio template)
references/fl2va-segment-format.md The opt-in FL2VA first–last frame video prompt format
references/studio-output-format.md The opt-in studio layout: one segment-N/segment.txt per segment with @imageN/@audioN tokens, otherwise identical to ref2va
references/t2i-character-sheet.md Character-sheet caption rules (four-panel photorealistic turnaround) and the two-key JSON contract
references/frame-image-prompts.md Per-segment first/last frame image prompt rules (Segment-img-N.json)
references/worked-example.md Complete end-to-end example, including the audio (singing) and FL2VA variants
scripts/validate_outputs.py Optional validator the agent can run on its outputs
segment-guide.md, t2i-prompt-rules/ Source rule documents the skill was adapted from

Usage

  1. Pull this repo into your agent's skills folder so that SKILL.md is discoverable.
  2. Give the agent a vague scene prompt and the total video length in seconds, plus optionally: song lyrics, an audio file mention (e.g. "use midnight.mp3"), per-character image references, style hints, and — only if wanted — an explicit request for FL2VA / first-last frame mode or studio one-file-per-segment output with @imageN/@audioN references.
  3. The agent writes segments.txt, Image-N.json for characters lacking references, Segment-img-N.json (and Segment-img-N-last.json in FL2VA mode), and image-map.txt into the project folder.
  4. Verify before use: python3 scripts/validate_outputs.py --segments segments.txt --expected-n <N> [--dir .] [--lyrics-file lyrics.txt] — add --mode fl2va --total-seconds <seconds> for FL2VA runs, or --mode studio --segments-dir <folder> for studio runs.