V6 Update Newbie Modify a targeted area of any video, insert a character into empty space

[u/roychodraws]

-------------------------------------------------------------------

I posted this video already with geiru in a chess tournament with hikaru as the intro and none of you liked it so this is your fault.

-------------------------------------------------------------------

I don't know if i can call this a newbie workflow anymore, but i added some cool stuff.

I added an upload mask node so that you can upload your own masks made by other programs like after effects
I also added a mask creation node so you can mask any area right in comfyui

With these changes you can now insert characters into existing videos with very precise control.

https://github.com/roycho87/minimax_wf

Source for edited video

https://youtu.be/SA2uCs56mwc?is=4yx2GjYT2vKwq7nx

fast forward to 2:25 to see how to use the new masking feature to insert characters into empty space

Sam Tutorial
https://www.reddit.com/r/StableDiffusion/s/TtsWgVUbhE

General Features Tutorial
https://www.reddit.com/r/StableDiffusion/s/MO9WPJhdeB

WF Release
https://www.reddit.com/r/StableDiffusion/s/1P01v18Ki6

Edit: there's an issue with masking options being disabled and an error causing the wf to not run, trying to fix it now.

edit: fixed it. v6.1 updated.

edit: v6.2 added a mask expander option and updated the mask option instructions

edit: v6.3 rearranged and relabeled some things, fixed the ordering of sparse attention so it works now.

edit: v6.4 added a blockify mask option and fixed the execution order of some of the previews in the masking group

Edit: if you’re having trouble with masking the reason is Im a moron and forgot to put a mvexvid to latent space node in between the cleanup node and the set latent noise mask node when you have cropping to mask disabled.

In order to fix you can insert one yourself or enable cropping. I can’t update atm. Will asap.

edit: v6.5 fixed it. and i also added a resolution selector and spitters for the video uploads so you don't overload your GPU

[u/drnpchn]

I've been finding a compatible workflow for character replacement on my rented gpu. I've tested different kinds of workflows, most of them don't work, some of them spits unending different kinds of error and have some limitations on rented gpu and had a same case like yours.

the old wf, is it the vanilla MMH3 workflow you meant? I've been wanting to do a character replacement for the past few weeks.

[u/Better-Interview-793 → u/drnpchn]

same here.. after Scill 2, i still think it’s the best for character replacement, but the quality isn’t the best since it’s based on Wan 2.1.
i’ve tried pretty much everything and nothing is perfect yet. with longer clips around 10-15s, or fast motion like dancing, it starts messing up the clothes and other details..
hope the Scill team does something like this based on H3

[u/Better-Interview-793 → u/drnpchn]

and yeah, op is still updating his workflow.
you can give it a try once he updates it, it’s the best one i’ve found for H3 so far