davidvgilmore commited on
Commit
357cb38
·
1 Parent(s): cd6e6e6

Update Space configuration

Browse files
Files changed (1) hide show
  1. README.md +3 -216
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- title: Hunyuan3D-2.0
3
  emoji: 🌍
4
  colorFrom: purple
5
  colorTo: red
@@ -7,223 +7,10 @@ sdk: gradio
7
  sdk_version: 4.44.1
8
  app_file: hg_app.py
9
  pinned: false
10
- short_description: Text-to-3D and Image-to-3D Generation
11
  models:
12
  - tencent/Hunyuan3D-2
13
  ---
14
 
 
15
 
16
- [中文阅读](README_zh_cn.md)
17
- [日本語で読む](README_ja_jp.md)
18
-
19
- <p align="center">
20
- <img src="./assets/images/teaser.jpg">
21
-
22
-
23
- </p>
24
-
25
- <div align="center">
26
- <a href=https://3d.hunyuan.tencent.com target="_blank"><img src=https://img.shields.io/badge/Official%20Site-black.svg?logo=homepage height=22px></a>
27
- <a href=https://huggingface.co/spaces/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Demo-276cb4.svg height=22px></a>
28
- <a href=https://huggingface.co/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Models-d96902.svg height=22px></a>
29
- <a href=https://3d-models.hunyuan.tencent.com/ target="_blank"><img src= https://img.shields.io/badge/Page-bb8a2e.svg?logo=github height=22px></a>
30
- <a href=https://discord.gg/GuaWYwzKbX target="_blank"><img src= https://img.shields.io/badge/Discord-white.svg?logo=discord height=22px></a>
31
- <a href=https://github.com/Tencent/Hunyuan3D-2/blob/main/assets/report/Tencent_Hunyuan3D_2_0.pdf target="_blank"><img src=https://img.shields.io/badge/Report-b5212f.svg?logo=arxiv height=22px></a>
32
- </div>
33
-
34
-
35
- [//]: # ( <a href=# target="_blank"><img src=https://img.shields.io/badge/Report-b5212f.svg?logo=arxiv height=22px></a>)
36
-
37
- [//]: # ( <a href=# target="_blank"><img src= https://img.shields.io/badge/Colab-8f2628.svg?logo=googlecolab height=22px></a>)
38
-
39
- [//]: # ( <a href="#"><img alt="PyPI - Downloads" src="https://img.shields.io/pypi/v/mulankit?logo=pypi" height=22px></a>)
40
-
41
- > Join our **[Wechat](#find-us)** and **[Discord](#find-us)** group to discuss and find help from us.
42
-
43
-
44
- <p align="center">
45
- “ Living out everyone’s imagination on creating and manipulating 3D assets.”
46
- </p>
47
-
48
- ## 🔥 News
49
-
50
- - Jan 21, 2025: 💬 Enjoy exciting 3D generation on our website [Hunyuan3D Studio](https://3d.hunyuan.tencent.com)!
51
- - Jan 21, 2025: 💬 Release inference code and pretrained models
52
- of [Hunyuan3D 2.0](https://huggingface.co/tencent/Hunyuan3D-2).
53
- - Jan 21, 2025: 💬 Release Hunyuan3D 2.0. Please give it a try
54
- via [huggingface space](https://huggingface.co/spaces/tencent/Hunyuan3D-2)
55
- our [official site](https://3d.hunyuan.tencent.com)!
56
-
57
- ## **Abstract**
58
-
59
- We present Hunyuan3D 2.0, an advanced large-scale 3D synthesis system for generating high-resolution textured 3D assets.
60
- This system includes two foundation components: a large-scale shape generation model - Hunyuan3D-DiT, and a large-scale
61
- texture synthesis model - Hunyuan3D-Paint.
62
- The shape generative model, built on a scalable flow-based diffusion transformer, aims to create geometry that properly
63
- aligns with a given condition image, laying a solid foundation for downstream applications.
64
- The texture synthesis model, benefiting from strong geometric and diffusion priors, produces high-resolution and vibrant
65
- texture maps for either generated or hand-crafted meshes.
66
- Furthermore, we build Hunyuan3D-Studio - a versatile, user-friendly production platform that simplifies the re-creation
67
- process of 3D assets. It allows both professional and amateur users to manipulate or even animate their meshes
68
- efficiently.
69
- We systematically evaluate our models, showing that Hunyuan3D 2.0 outperforms previous state-of-the-art models,
70
- including the open-source models and closed-source models in geometry details, condition alignment, texture quality, and
71
- e.t.c.
72
-
73
-
74
-
75
- <p align="center">
76
- <img src="assets/images/system.jpg">
77
- </p>
78
-
79
- ## ☯️ **Hunyuan3D 2.0**
80
-
81
- ### Architecture
82
-
83
- Hunyuan3D 2.0 features a two-stage generation pipeline, starting with the creation of a bare mesh, followed by the
84
- synthesis of a texture map for that mesh. This strategy is effective for decoupling the difficulties of shape and
85
- texture generation and also provides flexibility for texturing either generated or handcrafted meshes.
86
-
87
- <p align="left">
88
- <img src="assets/images/arch.jpg">
89
- </p>
90
-
91
- ### Performance
92
-
93
- We have evaluated Hunyuan3D 2.0 with other open-source as well as close-source 3d-generation methods.
94
- The numerical results indicate that Hunyuan3D 2.0 surpasses all baselines in the quality of generated textured 3D assets
95
- and the condition following ability.
96
-
97
- | Model | CMMD(⬇) | FID_CLIP(⬇) | FID(⬇) | CLIP-score(⬆) |
98
- |-------------------------|-----------|-------------|-------------|---------------|
99
- | Top Open-source Model1 | 3.591 | 54.639 | 289.287 | 0.787 |
100
- | Top Close-source Model1 | 3.600 | 55.866 | 305.922 | 0.779 |
101
- | Top Close-source Model2 | 3.368 | 49.744 | 294.628 | 0.806 |
102
- | Top Close-source Model3 | 3.218 | 51.574 | 295.691 | 0.799 |
103
- | Hunyuan3D 2.0 | **3.193** | **49.165** | **282.429** | **0.809** |
104
-
105
- Generation results of Hunyuan3D 2.0:
106
- <p align="left">
107
- <img src="assets/images/e2e-1.gif" height=250>
108
- <img src="assets/images/e2e-2.gif" height=250>
109
- </p>
110
-
111
- ### Pretrained Models
112
-
113
- | Model | Date | Huggingface |
114
- |----------------------|------------|--------------------------------------------------------|
115
- | Hunyuan3D-DiT-v2-0 | 2025-01-21 | [Download](https://huggingface.co/tencent/Hunyuan3D-2) |
116
- | Hunyuan3D-Paint-v2-0 | 2025-01-21 | [Download](https://huggingface.co/tencent/Hunyuan3D-2) |
117
-
118
- ## 🤗 Get Started with Hunyuan3D 2.0
119
-
120
- You may follow the next steps to use Hunyuan3D 2.0 via code or the Gradio App.
121
-
122
- ### Install Requirements
123
-
124
- Please install Pytorch via the [official](https://pytorch.org/) site. Then install the other requirements via
125
-
126
- ```bash
127
- pip install -r requirements.txt
128
- # for texture
129
- cd hy3dgen/texgen/custom_rasterizer
130
- python3 setup.py install
131
- cd hy3dgen/texgen/differentiable_renderer
132
- bash compile_mesh_painter.sh
133
- ```
134
-
135
- ### API Usage
136
-
137
- We designed a diffusers-like API to use our shape generation model - Hunyuan3D-DiT and texture synthesis model -
138
- Hunyuan3D-Paint.
139
-
140
- You could assess **Hunyuan3D-DiT** via:
141
-
142
- ```python
143
- from hy3dgen.shapegen import Hunyuan3DDiTFlowMatchingPipeline
144
-
145
- pipeline = Hunyuan3DDiTFlowMatchingPipeline.from_pretrained('tencent/Hunyuan3D-2')
146
- mesh = pipeline(image='assets/demo.png')[0]
147
- ```
148
-
149
- The output mesh is a [trimesh object](https://trimesh.org/trimesh.html), which you could save to glb/obj (or other
150
- format) file.
151
-
152
- For **Hunyuan3D-Paint**, do the following:
153
-
154
- ```python
155
- from hy3dgen.texgen import Hunyuan3DPaintPipeline
156
- from hy3dgen.shapegen import Hunyuan3DDiTFlowMatchingPipeline
157
-
158
- # let's generate a mesh first
159
- pipeline = Hunyuan3DDiTFlowMatchingPipeline.from_pretrained('tencent/Hunyuan3D-2')
160
- mesh = pipeline(image='assets/demo.png')[0]
161
-
162
- pipeline = Hunyuan3DPaintPipeline.from_pretrained('tencent/Hunyuan3D-2')
163
- mesh = pipeline(mesh, image='assets/demo.png')
164
- ```
165
-
166
- Please visit [minimal_demo.py](minimal_demo.py) for more advanced usage, such as **text to 3D** and **texture generation
167
- for handcrafted mesh**.
168
-
169
- ### Gradio App
170
-
171
- You could also host a [Gradio](https://www.gradio.app/) App in your own computer via:
172
-
173
- ```bash
174
- python3 gradio_app.py
175
- ```
176
-
177
- Don't forget to visit [Hunyuan3D](https://3d.hunyuan.tencent.com) for quick use, if you don't want to host yourself.
178
-
179
- ## 📑 Open-Source Plan
180
-
181
- - [x] Inference Code
182
- - [x] Model Checkpoints
183
- - [x] Technical Report
184
- - [ ] ComfyUI
185
- - [ ] TensorRT Version
186
-
187
- ## 🔗 BibTeX
188
-
189
- If you found this repository helpful, please cite our reports:
190
-
191
- ```bibtex
192
- @misc{hunyuan3d22025tencent,
193
- title={Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation},
194
- author={Tencent Hunyuan3D Team},
195
- year={2025},
196
- }
197
-
198
- @misc{yang2024tencent,
199
- title={Tencent Hunyuan3D-1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation},
200
- year={2024},
201
- author={Tencent Hunyuan3D Team},
202
- eprint={2411.02293},
203
- archivePrefix={arXiv},
204
- primaryClass={cs.CV}
205
- }
206
- ```
207
-
208
- ## Acknowledgements
209
-
210
- We would like to thank the contributors to
211
- the [DINOv2](https://github.com/facebookresearch/dinov2), [Stable Diffusion](https://github.com/Stability-AI/stablediffusion), [FLUX](https://github.com/black-forest-labs/flux), [diffusers](https://github.com/huggingface/diffusers), [HuggingFace](https://huggingface.co), [CraftsMan3D](https://github.com/wyysf-98/CraftsMan3D),
212
- and [Michelangelo](https://github.com/NeuralCarver/Michelangelo/tree/main) repositories, for their open research and
213
- exploration.
214
-
215
- ## Find Us
216
-
217
- | Wechat Group | Xiaohongshu | X | Discord |
218
- |--------------|-------------|---|---------|
219
- | | | | |
220
-
221
- ## Star History
222
-
223
- <a href="https://star-history.com/#Tencent/Hunyuan3D-2&Date">
224
- <picture>
225
- <source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=Tencent/Hunyuan3D-2&type=Date&theme=dark" />
226
- <source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=Tencent/Hunyuan3D-2&type=Date" />
227
- <img alt="Star History Chart" src="https://api.star-history.com/svg?repos=Tencent/Hunyuan3D-2&type=Date" />
228
- </picture>
229
- </a>
 
1
  ---
2
+ title: Hunyuan3D-2 Clone
3
  emoji: 🌍
4
  colorFrom: purple
5
  colorTo: red
 
7
  sdk_version: 4.44.1
8
  app_file: hg_app.py
9
  pinned: false
 
10
  models:
11
  - tencent/Hunyuan3D-2
12
  ---
13
 
14
+ # Hunyuan3D-2 Clone
15
 
16
+ This is a clone of the original Hunyuan3D-2 Space by Tencent.