MMnode/CHANGELOG.md
Z User eefca88d35 feat: Moxie bench - standalone python/web harness for the fixed pipeline
- bench/ FastAPI server: fixed 9-stage pipeline parsed from the base
  workflow, serial render jobs, WS progress mirroring ComfyUI's push
  events, /api/view + ComfyUI-compatible /view, /upload/image,
  /easy-media/* aliases for the ported editor
- dual backend: self-contained mock renderer (numpy+ffmpeg, deterministic
  per prompt/seed, native + RTX-upscaled mp4 branches) and a ComfyUI
  bridge (substitutes the plan into base_workflow.json, converts to the
  /prompt API format, polls history, downloads outputs)
- timeline port: frontend/src/bench mounts the unmodified MultiTrack
  editor against a comfyAPI shim (fetchApi/toast/dialog/custom events);
  build.bench.ts emits bench/ui-dist served by the server
- packaging: PyInstaller onedir spec + Tauri2 sidecar docs
- tests: bench/tests contract suite + scripts/test_bench_pipeline.py
  e2e (API+WS+render); prebuilt bench UI committed
2026-09-28 01:42:58 +00:00

25 KiB

Changelog


[Unreleased]

⚡ Improvements

  • Moxie Bench (new): A standalone Python + web harness for the fixed Moxie pipeline (bench/) — the first step toward running the pack outside ComfyUI as a Tauri 2 sidecar. It locks to the base workflow's nine-stage graph (loader, LoRA, preview override, multitrack editor, project, combine, RTX upscale, create/save) and ships two interchangeable backends: a self-contained mock renderer (numpy + ffmpeg, deterministic per prompt/seed, real mp4 outputs on both the native and upscaled branches) and a ComfyUI bridge that drives a running ComfyUI over /prompt with the substituted workflow. The multitrack timeline editor UI is ported as-is (frontend/src/bench/ shim mounts the same React components against a REST + WebSocket API), the server (FastAPI) exposes /api/render, /api/jobs, WS /api/ws progress plus ComfyUI-compatible /view, /upload/image, and /easy-media/* aliases, and bench/moxie_bench.spec + bench/tauri/README.md cover PyInstaller packaging and sidecar wiring. Run python bench/run.py --port 8787.
  • MultiTrack Editor: The editor frontend was reverted to the pristine upstream v1.3.3 source — the MiniMax/Moxie format display-label mapping and every workaround built around it were removed. The shipped editor bundle is now built from that pristine source, so its behavior is exactly the battle-tested upstream editor (Shot/Context continuity, reference-size, audio lock, and MiniMax prompt placeholders all key on the native MiniMax format value again).
  • Editor delivery fix: A fresh browser could previously end up without the editor bundle entirely. ComfyUI core lets a pack's WEB_DIRECTORY overwrite its extension web-dir registration, so the browser's /extensions listing only ever contained this pack's helper scripts — never the editor entry — and the editor only appeared from stale browser cache. A small static loader (web/js/editor-loader.js, served with the helpers) now imports the editor entry from the pack's own route, which serves index.js with no-cache so the entry is always revalidated while its content-hashed chunks stay cacheable. After updating: restart ComfyUI and reload the page once; no cache-clearing gymnastics required.
  • MultiTrack Editor / MultiTrack Project: T2V resolves natively again (t2v stays t2v, matching upstream) — the model now handles text-to-video with the updated prompting, so the earlier T2V→R2V normalization was removed from the editor type computation, h3_task_type, _multitrack_task_type, and the generation-mode mapping. The reference-mode-with-zero-media cloud fallback was removed accordingly (reference mode raises for missing media again, as upstream).
  • Moxie Multimedia Loader: The loader now looks like it loads a single model. Only the diffusion-model picker (plus the attention backend) is visible; the LoRA, video VAE, audio VAE, and CLIP widgets were removed and their files are auto-selected from the pack's models/loras, models/vae, models/audio_vae, and models/clip folders (first file in sorted order, matching the bundled model set). The LoRA is applied automatically with strength 1.0; remove the file from models/loras to disable it. Missing auxiliary models raise the same clear setup error as before. Workflows saved before this change keep working — extra widget values are ignored.
  • MultiTrack Project / Moxie Project Video Combine: Single-pass projects now condition and sample at half the editor-selected resolution internally. The project timeline is composed at the segments' own size, and Moxie Project Video Combine restores the exact editor-selected resolution in pixel space before any output leaves the node (RTX Video Super Resolution via the optional nvidia-vfx package when available, with an automatic Lanczos fallback otherwise) — so every output carries the full editor resolution regardless of template wiring. The editor resolution therefore stays the final output resolution while the sampling chain runs smaller and faster. Dual-pass, SelfLift, and passthrough modes are unchanged.
  • Moxie Project Video Combine: Removed the leftover VIDEO and FILENAME_PREFIX outputs. The node now exposes exactly the components consumed downstream — images, audio, and fps, matching the core GetVideoComponents layout — and the output file name is chosen on easy saveVideo. The full-featured easy multitrackProjectVideoCombine node keeps its VIDEO and FILENAME_PREFIX outputs. Workflows saved before this change that wired the removed outputs need those links reconnected once; the shipped Moxie-consolidated template is already rewired.
  • MultiTrack Editor / MultiTrack Project: The format combo shows MiniMax again (the Moxie Multimedia display label was removed together with the rest of the mapping). Workflows saved while the label was shown need the format re-picked once; queued legacy label values are still normalized to MiniMax at execution time. The per-run Output upscale console line was removed earlier; the resolution restore now happens silently.
  • Moxie Multimedia Loader: The lora_name combo now defaults to the bundled turbo LoRA (MM3step.safetensors) so a fresh clone of the pack works out of the box, with a none entry to disable LoRA. Previously the default was a "<no files found>" placeholder, which silently skipped LoRA application even when a LoRA was bundled.
  • Moxie Preview Override: The tiny_vae combo now lists files from the node pack's own models/vae_approx folder first (shipping MM-preview.safetensors for MiniMax H3 previews as the default), falling back to ComfyUI's standard models/vae_approx directory. The folder is rescanned on every schema refresh, so newly dropped files appear without restarting ComfyUI.
  • Moxie Multimedia Loader: Locked the loader to the MiniMax H3 model set. The clip_type dropdown (which previously exposed every CLIP recipe in ComfyUI) was removed; the H3 Qwen3-VL text encoder is now always loaded with the minimax CLIP recipe. Any older ComfyUI build without CLIPType.MINIMAX raises a clear startup error instead of silently loading the wrong encoder.
  • Moxie Multimedia Loader / Moxie MultiTrack Project: Removed the legacy FAST_MODEL_LOADER (model_loader) bundle. The loader now outputs exactly model, clip, video_vae, and audio_vae (with the attention backend and LoRA already applied to the model), and the Moxie MultiTrack Project takes those four outputs as required direct inputs instead of a bundled loader. Moxie Preview Override likewise dropped its model_loader pass-through slots and now patches the model input directly. The generic easy multitrackProject node keeps its model_loader input for non-Moxie workflows.

[1.3.3] - 2026-09-25

✨ New Features

  • Multi-Image Loader: Added the easy multiImagesLoader node, supporting loading up to 25 images.

🐛 Bug Fixes

  • MultiTrack Project: Fixed TE being executed an extra time in Dual mode.
  • MultiTrack Editor: When a single segment covers the entire task window, crop and resize it directly instead of recomputing through the reference path, fixing #84. The media loading timeout in this path is set to 60 seconds.
  • MultiTrack Editor: [Motion transfer & subject replacement] When the source video frame rate differs from the editor frame rate, smart-split segments now split using the editor frame rate, and when paused or stepping frame-by-frame the requested frame is returned via ffmpeg's fps filter as the preview image.
  • MultiTrack Project: [Motion transfer & subject replacement] Locked videos now use uniform temporal resampling. Previously, when the locked duration did not conform to the 17k+5 frame pattern, the value was rounded up and padded to fit the current frame count, which caused some frames to freeze early. Resampling now uses a uniform temporal distribution so added frames are spread evenly across the timeline rather than clustered at the tail, eliminating the freeze.
  • Audio Lock: Fixed redundant repeated encoding/loading when locking audio across multiple segments of long videos. Due to the multitrack project design, all audio locks are processed before the reference video generation node, so when video is present, ffmpeg is used to extract and cache the audio. Videos without audio and muted tracks no longer lock audio or repeat audio probing, while their video timeline timing remains unchanged. The audio input on easy minimaxH3AudioLock is now optional; leaving it disconnected passes the latent through unchanged instead of erroring.

[1.3.2] - 2026-09-20

⚡ Improvements

  • MultiTrack Project: Optimized project media, segment media, TaskOutput, and per-segment H3 conditioning caching to avoid media reloads and repeated first-pass conditioning encodes when re-executing without parameter changes.
  • H3 Conditioning Cache: Store up to five recently used segment caches in ComfyUI's temporary directory, reset the pool when its project, model, or upstream media cache scope changes, rebuild zero-filled initial AV latents from compact metadata, and report a per-category tensor size breakdown after each write.
  • MultiTrack Project: Enhanced action continuity in context mode and optimized lip-sync when audio is locked.
  • MultiTrack Editor: Added the ability to freely drag and adjust the width ratio between the image item area and the prompt area within segments. Optimized the UI display of user prompt highlight tags.
  • MultiTrack Project: Added selflift option to sampling_mode, adapted from comfyui-SelfLift
  • Character Swap Context: Switched to drive_control approach instead of the previous noise-based method. Testing shows drive_control is more stable and preserves more motion details. Although it may appear slightly less sharp visually than the noise approach, it is better suited for preserving source motion during character replacement and motion transfer.

🐛 Bug Fixes

  • Context: Fixed context loading latent preferring the previous segment's selected latent instead of the most recently generated latent by timestamp.
  • Video Reference: Fixed video reference frame alignment. Previous version had frame loss in motion transfer scenarios when timeline was locked, causing reference to fall back to image.
  • MultiTrack Editor: When segment A has a gap with segment B, adjusting segment A's duration should first fill the gap duration before propagating changes to subsequent segments.
  • MultiTrack Editor: Fixed some UI interaction compatibility issues with Node2.0, improving the overall operational experience.

[1.3.1] - 2026-09-07

✨ New Features

  • MultiTrack Prompt Enhance to Project: Added easy multiTrackPromptEnhanceToProject node, which supports directly applying the MultiTrack Prompt Enhancer's output to the MultiTrack Project.
  • Character Swap Context: Added the context_swap continuity mode for MiniMax H3 task segments. It preserves motion continuity while weakening the previous character's appearance with disposable tapered latent noise.
  • Dual-Pass Swap Continuity: Apply swap noise independently to the low-resolution first-pass context and the high-resolution second-pass context. Audio remains untouched, and only clean trimmed/re-encoded context latents are saved for later segments.
  • Video-Track Audio Lock: Lock a video track segment as the timeline constraint for MiniMax H3 generation, ensuring the output duration matches the video; once locked, the audio is synchronized and locked as well. To replace the audio lock, you can lock another audio track as the new audio source while keeping the video track unchanged for the visual. (Mainly used for motion transfer and character replacement.)
  • Minimax Prompt Override: Added the easy minimaxPromptOverride node, which supports assembling prompts and other parameters into the multitrack editor's prompt_override, suitable for explicit passing in.

⚡ Improvements

  • Character Swap Context (drive_control): Switched from the previous noise-based approach to drive_control. Testing shows drive_control is more stable and preserves more motion details. Although it may appear slightly less sharp visually than the noise approach, it is better suited for preserving source motion in character replacement and motion transfer scenarios.
  • MultiTrack Project Media Preparation: Consolidated task-scoped image, audio, video, shared-media, and locked-audio preparation so project expansion loads and forwards only the media required by each segment.
  • Clear Redundant Subgraph Cache: Fixed an issue where execution_cache in multi-track project subgraphs was unnecessarily storing video objects, causing additional memory accumulation.

🐛 Bug Fixes

  • Responsive Width Preservation: Fixed an issue where all custom easymedia components would shrink in width after clicking the ComfyUI properties panel.
  • Frame-Accurate Video Trimming: Normalize source frame rates before trimming merged video inputs to keep segment boundaries aligned with the project timeline.

The tapered context-noise approach used by Character Swap Context is adapted from MacroSony/minimax-h3-chained-character-swap.

[1.3.0] - 2026-09-03

✨ New Features

  • MultiTrack Project: Currently adapted for MiniMax, mainly used to simplify the pipeline. It handles multi-track loop segment encoding, sampling, and decoding/saving, supports specifying segment start position and maximum generation count.
  • MultiTrack Project Video Combine: Preview uncombined segment outputs, supports automatic and manual combining.

⚡ MiniMax H3 Optimizations

  • Motion Context & Resampling: Optimized the pairing of the original MotionContext with resampling. In the current default sampling configuration: medium produces smoother results, while light cannot sample sufficiently in the first sampling due to sigma separation.
  • Motion Context Latent Memory: Keep only the 22-frame high-resolution audio/video context tail on CPU between segments and in completed project artifacts, while retaining the complete low-resolution first-pass checkpoint for deferred second-pass runs.
  • Multi-Track Editor (Audio Track): Added Lock Audio feature, only applicable under MultiTrack Project. When generating video, audio will no longer regenerate, but instead schedules video frame output based on this audio.
  • Multi-Track Editor (Audio Track): Added Reuse Audio - all segments can reuse this audio (previously required cloning to each segment), supports up to 15 seconds without being truncated by segments.
  • Multi-Track Editor (Shared Media): Images, audio clips, and video clips can be marked as shared references when context segments need to reuse the same media. Shared images are placed before each task's local images; shared audio uses up to the first 15 seconds of its source.
  • Multi-Track Editor (Task Track): When multi-selecting task segments, you can uniformly adjust task mode, transition mode, and reference image size.
  • Multi-Track Editor (Task Track): New feature added.
  • Multi-Track Editor: Adjusted many texts for better understanding.
  • Multi-Track Task Output: Adjusted minimum value of task_index to -1. When -1, it can output all track complete media information like the previous Multi-Track Editor. (Due to the previous optimization, the Multi-Track Editor cannot directly output complete content)
  • Multi-Track Editor: Defer file and URL media loading when no slot resources are referenced; task output nodes now materialize only the media they need, reduce unnecessary media resource overhead in long-form video tasks. (Now you just need to connect TRACKS_INFO; the image, video, and audio output by the multi-track editor will all be None in Slot-less resource mode.)

🐛 Bug Fixes

  • Multi-Track Slot Media: Added video slot selection and fixed image, audio, and video slot discovery and downstream delivery through TRACKS_INFO, including sparse lists that skip empty inputs and graphs whose link ID is 0.

[1.2.1] - 2026-08-22

✨ New Features

  • Multi-Track Editor: Added right-click context menu to clone audio segments and video segments

🐛 Bug Fixes

  • Multi-Track Task Output: Fixed that segments without audio/video in MiniMax format should output as None

[1.2.0] - 2026-08-21

✨ New Features

  • Compare Video: Added Side-by-side Compare mode, support for directly selecting media for comparison, and Watch Output History mode
  • Media Selector: Added support for multi-selecting image items and selecting all images in current path
  • Multi-Track Prompt Enhancer: Added this node, supports prompt enhancement for models like h3-context-ir, supports local model usage
  • Multi-Track Prompt Enhancer to Project: Added easy multiTrackPromptEnhanceToProject node, supports directly applying the output of the multi-track prompt enhancer to the multi-track project
  • Multi-Track Editor: Added user prompt A/B output, supports selecting different user prompt outputs
  • Multi-Track Editor: Added user prompt reference functionality, supports referencing resources via <Picture 1>, <Audio 1>, <Video 1>, @图片1 and similar methods, supports multi-element combinations

🐛 Bug Fixes

  • Multi-Track Editor: When two adjacent task segments are connected, modifying the front segment's duration should increase the total duration
  • Media Selector: Fixed breadcrumbs should support recursive subdirectories
  • Media Selector: Fixed image re-selection issue

[1.1.4] - 2026-08-05

✨ Features

  • MultiTrack Editor: Add MiniMax video format
  • MiniMax H3: Add easy minimaxH3ToVideo for text-to-video, reference-to-video, and first/last-frame conditioning
  • Media List Utilities: Add easy splitAudios and easy splitVideos to split media lists into independent outputs
  • MultiTrack Editor: Video, audio, and subtitle tracks support dragging the left-side icon to adjust sorting; each track type is limited to a maximum of 3 tracks

🐛 Bug Fixes

  • Multitrack Editor: Fixed an issue where, in MiniMax format, the Multitrack Editor and Multitrack Task Output would output empty clips when neither the video track nor the audio track contained any clips.
  • MultiTrack Editor: Fix TRACK_INFO output when duration is less than 5 seconds — total duration should be the actual total duration of task segments, not the default 5 seconds
  • MultiTrack Editor: Task track segments support free placement while preserving gaps; new task segments can be added directly between segments to fill gaps
  • MultiTrack Editor: Fix issue where dragging to trim from segment edge hot zone caused the trim frame to shift based on mouse position or canvas zoom level
  • MultiTrack Editor: Fix incorrect time ruler click position calculation after canvas zoom, causing playhead positioning and toolbar left/right trim time offset issues
  • MultiTrack Task Output: MiniMax format trims audio/video from the next task segment's start point to the media track segment's actual end; the last task trims from its own start to the media's effective end, without outputting trailing black frames or silent audio
  • MultiTrack Info Output: Total duration is calculated as the sum of task segment durations, automatically skipping gaps between task segments
  • MultiTrack Editor: Fix node height recalculation when adding or removing tracks — should recalculate node height instead of adapting to the preview area height

[1.1.3] - 2026-07-30

✨ Features

  • MultiTrack Editor: Add task markers, allowing multiple task segments to be used as one loop task
  • MultiTrack Editor: Add track overview, allowing segments to be expanded to view prompts and reference images
  • MultiTrack Editor: Support importing SRT files to subtitle track
  • MultiTrack Audio Output: Add cropped audio output mode, outputting cropped audio clips and starting frame number for easier S2V usage
  • LTX Workflow Simplification: Add easy ltxMultiTrackEncode and multiple simplified LTX workflow nodes

🐛 Bug Fixes

  • MultiTrack Task Output: Should output empty system prompt when prompt format is default or promptRelay
  • MultiTrack Editor: Fix issue where only the first audio was output when inputting audio list in App mode
  • MultiTrack Editor: Fix issue where segments cannot be added at the beginning or between segments on audio and subtitle tracks

[1.1.2] - 2026-07-12

✨ Features

  • MultiTrack to S2V Output: Outputs cropped audio clips and starting frame number for easier S2V usage

🐛 Bug Fixes

  • Media Selector: Fix issue where media selector did not stay in subdirectory after reopening when subdirectory was selected last time
  • LTXV Reference Video: Optimizing the Use of LTXVMakeRefVideo
  • MultiTrack Editor: Fixed inconsistent left-side crop behavior compared to standard editing tools
  • MultiTrack Editor: Fixed incorrect waveform display after cropping audio clips

[1.1.1] - 2026-07-11

🐛 Bug Fixes

  • MultiTrack Editor: Added empty state prompt message, removed 720 panorama feature from image items, added single image preview
  • Merge Videos From Paths: Optimize video processing and add audio option
  • Compare Video: Fix mute issue by default, and add option to save video to reduce the need for extra video save nodes

[1.1.0] — 2026-07-09

✨ Features

  • MultiTrack Editor: Add initial version of multitrack editor with supporting nodes, supporting multitrack video, audio editing, segment editing and preview
  • Media Selector: Add directory store cache for media selector to solve the problem of frequent fetching of list data from backend
  • Split Image: Support image list or image batch type image splitting, applicable to Bernini multi-reference scenario
  • Merge Videos From Paths: Add frame_count to support clipping

🐛 Bug Fixes

  • MultiTrack Editor、TimelineEditor: Fixed the default width and height when creating nodes
  • Media Selector: Fix resource sorting should be by name, creation time, folder first
  • Media Selector: Fix issues where keyword is not cleared when entering subdirectory after searching

[1.0.4] — 2026-06-16

✨ Features

  • Save Video: Add hide&save option to hide output video node output while saving video
  • Timeline Editor (App Mode): Add [0-5s] time range parsing support for prompt_override
  • Timeline Editor (UI Mode): Sub-track supports drag and drop to import images

🐛 Bug Fixes

  • Timeline Editor (UI Mode): Fix the issue where sub-track image should proportionally adjust duration when segment duration is modified in main track
  • Timeline Editor (UI Mode): Fix incorrect audio preview display after importing audio subdirectory

[1.0.3] — 2026-06-06

✨ Features

  • Bernini Temporary Solution: Add Bernini conditioning and Bernini Model Patch nodes as a temporary solution before ComfyUI official Bernini support
  • LTXV Reference Video: Add new node for multi-reference Lora model

🐛 Bug Fixes

  • Timeline Editor (UI Mode): Fix node height being reset to default when canvas refresh and resolution option are switched
  • Timeline Editor (UI Mode): Fix issue where segment content cannot be edited in some cases under overall editing prompt mode
  • Timeline Editor (UI Mode): Fix adaptive node and track height issues, add clone segment in right-click menu for wan2.1 bernini and LTX2.3 R2V usage

[1.0.2] — 2026-05-31

🐛 Bug Fixes

  • Timeline Editor (App Mode): Fix issue where segments should evenly distribute default duration when prompt_override is not strictly in prompt format
  • Timeline Editor (App Mode): Fix issue where only one audio segment is used to fill the entire timeline - need to filter out empty audio first
  • Timeline Editor (UI Mode): Fix resource output and sorting errors when a single segment contains different formats

[1.0.1] — 2026-05-27

✨ Features

  • Workflow: Add wan2.2 loop segment example workflow
  • Frontend: Add + button when segment is selected to add segments before or after, and fix some known bugs

🐛 Bug Fixes

  • Fix incorrect image links imported from output and subdirectory, causing images and outputs to be filtered out in editor

[1.0.0] — 2026-05-25

💥 BREAKING CHANGES

  • Duration & Frame Rate input only takes effect on blur (must press enter or click outside input box to confirm changes)
  • Duration Input step change: step is 4 when format is frame count, 1 when format is seconds
  • Segment duration editing no longer affects other segments - if total duration exceeds main track after modification, main track will automatically adapt to the sum of all segments

✨ Features

  • Timeline Editor: Track auto-adapt height, image and audio segments require double-click to enter media selection interface to avoid accidental triggering
  • Timeline Editor: Add dynamic parameter injection settings, support prompt template format + multimedia input for timeline editor usage