LLM-3D-Generation

🏠 About

Here is a curated list of papers about LLM-3D-Generation. The repository is forked from Awesome-LLM-3D.

Table of Content

• Awesome-LLM-3D
  • 3D Scene Generation
  • 3D Generation with LLM

3D Scene Generation

Date	Keywords	Paper	Publication	Project	Code
2 Feb 2023	SceneScape	SceneScape: Text-Driven Consistent Scene Generation	NeurIPS 2023	project	code
21 Mar 2023	Text2Room	Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models	ICCV 2023	project	code
22 Nov 2023	LucidDreamer	LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes	Arxiv 2023	project	code
19 May 2023	Text2NeRF	Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields	TVCG 2024	project	code
14 Dec 2023	Text2Immersion	[Text2Immersion: Generative Immersive Scene with 3D Gaussians](Text2Immersion: Generative Immersive Scene with 3D Gaussians))	Arxiv 2023	project
10 Apr 2024	DreamScene360	DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting	ECCV 2024	project
9 May 2024	FastScene	FastScene: Text-Driven Fast 3D Indoor Scene Generation via Panoramic Gaussian Splatting	IJCAI 2024		code
4 Jun 2024	RoomTex	RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting	ECCV 2024	project	code
21 Jul 2024	HoloDreamer	HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions	Arxiv 2024	project
25 Aug 2024	SceneDreamer360	SceneDreamer360: Text-Driven 3D-Consistent Scene Generation with Panoramic Gaussian Splatting	Arxiv 2024	project	code

3D Generation with LLM

Date	Keywords	Paper	Publication	Project	Code
29 Nov 2023	ShapeGPT	ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Model	Arxiv 2023	project
27 Nov 2023	MeshGPT	MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers	CVPR 2024	project	code
14 Apr 2024	DreamScape	DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling	Arxiv 2024
4 Apr 2024	DreamScene	DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling	ECCV 2024	project	code
30 Nov 2023	GraphDreamer	GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs	CVPR 2024	project	code
24 May 2023	LayoutGPT	LayoutGPT: Compositional Visual Planning and Generation with Large Language Models	NeurIPS 2023	project	code
11 Feb 2024	GALA3D	GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting	ICML 2024	project
30 Jul 2024	SceneTeller	SceneTeller: Language-to-3D Scene Generation	ECCV 2024	project
19 Oct 2023	3D-GPT	3D-GPT: Procedural 3D MODELING WITH LARGE LANGUAGE MODELS	Arxiv 2023	project
2 Mar 2024	SceneCraft	SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code	ICML 2024
14 Dec 2023	Holodeck	Holodeck: Language Guided Generation of 3D Embodied AI Environments	CVPR 2024	project	code
11 Dec 2023	AnyHome	AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes	ECCV 2024		code

Acknowledgement

This repo is inspired by Awesome-LLM