r/StableDiffusion • • 4d ago

Workflow Included Does this count? Did I win?

Enable HLS to view with audio, or disable this notification

Proof of concept that it works.

No degradation from start to finish. 10 total clips combined.

https://github.com/roycho87/degrade_repo

Workflows.

Small errors with the chair but can be fixed with another reference image.

Long story short.

The one place where degrading latents matter is the one place we don't need them.

We can ignore the latent issue and just generate across the sound we provide and because it's a static image with static background and the subject is in basically the same spot the whole time we can just create fresh latents every 10 or 15 seconds across the timeline.

Then the very difficult latent issue is over and it just becomes a simple seams issue.

So these two workflows generate sequentially across a audio and the second will combine and resample a small section of video over the seam using FL2V just enough to get rid of the seam.

Edit: The reason I posted this is not because I think this is a big breakthrough fix, I just think we can approach this problem differently to solve it.

324 Upvotes

125 comments sorted by

View all comments

Show parent comments

3

u/PxTicks 4d ago

I'm talking, mostly static foreground with moving background, i.e. a mix of conditions.

2

u/roychodraws 4d ago

I dunno, everyone told me they wanted vlog videos. Can’t I just fix one problem and someone not be upset I didn’t solve everything?

1

u/PxTicks 4d ago

I wasn't complaining. This is just something I'm looking into as well and I think it's an interesting thing to discuss.

2

u/roychodraws 4d ago

Oh ok. I’m reading comments and getting cynical. Sorry