Authors
Yang Chen, Jingwen Chen, Yingwei Pan, Xinmei Tian, Tao Mei
Publication date
2023/10/26
Book
Proceedings of the 31st ACM International Conference on Multimedia
Pages
9408-9410
Description
We demonstrate an automatic 3D creation system, which can create realistic 3D assets solely from a text or image prompt without requiring any specialized 3D modeling skills. Users can either describe the object they envision in natural language or upload a reference image that records what they have seen with the phone. Our system will generate a high-quality 3D mesh that faithfully matches the users' input. We propose a coarse-to-fine framework to achieve this goal. Specifically, we first obtain a low-resolution mesh instantly by utilizing a pre-trained text/image conditional 3D generative model. Using such coarse mesh as the initialization, we further optimize a high-resolution textured 3D mesh with fine-grained appearance guidance from large-scale 2D diffusion models. Our system can create visually-pleasing results in minutes, which is significantly faster than existing methods. Meanwhile, the system ensures …
Total citations
2023202413
Scholar articles
Y Chen, J Chen, Y Pan, X Tian, T Mei - Proceedings of the 31st ACM International Conference …, 2023