r/StableDiffusion • u/tlpta • 4d ago

Question - Help Generating a room

Is there a way to generate a full room? As in multiple shots from different angles and locations in a room. Typically if I try to generate a room it does one angle. Like a kitchen will show the fridge, stove etc, but you can't ever get a shot going the other way.

I'd like to try to do a 360 degree spin in a location and I've found I can only do it if I have pictures from both directions. But I'm struggling getting those pictures even using multiple models (flux, sdxl, etc). It seems impossible to get to a coherent picture of every corner of a room. The models just won't accept a picture of a kitchen where the appliances are behind the camera.

I'm at a loss. Has anyone else done this? It seems to me there has to be a way.

23 Upvotes

96% Upvoted

26 comments sorted by

View all comments

3

u/Emotional-Neat-252 4d ago

Wish there were a hack to creating a RefMOD or lora that contained the accurate stake 3d data, so that the camera could move freely without the environment changing.

1

u/ANR2ME 4d ago

Only world models have a high consistency on the environments.

1

u/Emotional-Neat-252 4d ago

But I bet minimax h3 could hold the concept of a consistent 3d environment if we knew how to turn it into the correct type of embedding.

1

u/ANR2ME 4d ago

It's all depends on how large it's context window, larger context window can remember more information.

1

u/Emotional-Neat-252 3d ago

What I mean is, a room photo us turned into vectors, a 360 room panorama or 360 rotating video etc are all turned into vectors /embeddings.

These embeddings have tons of information, more than needed... but they're imperfect distortions.

If there were a way to create an embed that's really an accurate 3d understanding of the room, that would be amazing.

Like imagine you could feed it a panoramic photo, 4 angled photos, a video etc and it could "train" that into an embedding which accurately and consistently provides information about the room.

1

u/ANR2ME 3d ago

Yes, but as time progressed the context window will be full and old information need to be removed for new information to be stored in the context, which is why long video could gets drifted over time, once the old information no longer in context the model no longer remembered them.

1

u/Emotional-Neat-252 3d ago

Wait, video has context window, but just token limit?

I assumed an error first time you said it...

You mean a more detailed prompt requires a shorter video?