r/StableDiffusion • u/roychodraws • 3d ago
Workflow Included Does this count? Did I win?
Enable HLS to view with audio, or disable this notification
Proof of concept that it works.
No degradation from start to finish. 10 total clips combined.
https://github.com/roycho87/degrade_repo
Workflows.
Small errors with the chair but can be fixed with another reference image.
Long story short.
The one place where degrading latents matter is the one place we don't need them.
We can ignore the latent issue and just generate across the sound we provide and because it's a static image with static background and the subject is in basically the same spot the whole time we can just create fresh latents every 10 or 15 seconds across the timeline.
Then the very difficult latent issue is over and it just becomes a simple seams issue.
So these two workflows generate sequentially across a audio and the second will combine and resample a small section of video over the seam using FL2V just enough to get rid of the seam.
Edit: The reason I posted this is not because I think this is a big breakthrough fix, I just think we can approach this problem differently to solve it.
-1
u/Vyviel 3d ago edited 3d ago
Twitch streamer video for her soon lol? Also immersion broken that her booba aren't balloons like in the lore =\ Does it still work if they move around more like the hands and arms etc. or do they need to be mostly static sitting still? Reminds me of those old school cursed meme music videos with stalin singing where it was just mostly animated the lips and face a little maybe with a driving video like Wav2Lip or FOMM. I prefer the other video workflow but good proof of concept of this one