2D to VR180 workflow

[gituser123456789000]

https://civitai.com/models/447057/jjs-panoramic-livingroom
This 180/360* living room LORA just came out for Stable Diffusion... but you don't have to only make a living room.. just use your own prompts and CFG scale and you can make other locations with this VR180 or VR360 distortion profile

1. Create 180*/360* Location images (which can be reused.. just don't overwrite them and you can reload them to inpaint something different into them)
2. Inpaint objects or characters into the 3D scene of your choice (I haven't tried near the distorted edges.. for likely obvious reasons (I doubt you'd get the correct distortions, if any), but inpainted things look plenty good in the middle area)
3. (Technically optional, but certainly recommended) Upscale for higher quality, better clarity.
4. Convert to 3D (SBS VR180)

This is for VR viewing.. you inside the scene. If you convert to cross-eyed, anaglyph, etc.. you'll see the distortions on top and bottom.. but in VR, you are in the scene, same as regular VR180 content.

[gituser123456789000]

Now what's this have to do with iw3?

Not sure.

This shows the distortion profile at least, and gives a proof of concept of what is possible. (I've already made VR180 images myself).

For movies.. or for converting 2D images to VR180.. we would need to separate out the background from the subjects/objects.. recreate the background in this distortion profile.. then reintroduce the subjects/objects.

Tough task to do this with already real images.. then tougher to do a full movie. But I'm starting to see the workflow for converting 2D movies into VR movies, with you inside the movie.