With the technological leap in generative AI, there are countless new businesses and startups which are using AI image generation in their pipeline. A non significant amount of these ventures can get supercharged with the ability to convert their 2D images to immersive environments and 3D objects A simple and intuitive tool to produce immersive 360° views using Dall-E 2 API as Proof of Concept Further iterations include integrating this with unity engine so the immersive environment can be manipulated and populated with 3D objects like in a video game. This use case has been verified by our first customers and by the industry leader StabilityAI.
Table
https://dalle-2-360.vercel.app/
https://github.com/ronykris/panoraven-auto
View the Demo App
| Technology | Description |
|---|---|
| React | User for frontend |
| Express.js | Backend framework |
| Dall-e-2 | OpenAI LLM |
| panoraven | 360 degree image viewer |
| Deployment | Vercel, AWS |
-
Integration with Blender
-
ntegration with Unity.
-
API for 2D panorama to immersive AR/VR environment.
-
Faithful reproduction of 2D objects in 3D
Step #1 - Setup frontend
$ git clone https://github.com/faranbutt/dalle-360
cd dalle-360
npm install
npm run dev
Open http://localhost:5173/Step #2 - Setup backend
$ git clone https://github.com/ronykris/panoraven-auto
cd panoraven-auto
npm install
npm start| Name | Link |
|---|---|
| Faran Taimoor Butt | https://www.linkedin.com/in/faranbutt/ |
| Krish | https://github.com/ronykris |
| Mohd Noman | https://lablab.ai/u/@juliojaja |
Hackathon Submission
