新加坡南洋理工大学S-Lab团队在三维数字人生成领域取得重大突破，提出了一种名为结构化隐空间扩散模型（StructLDM）的新范式。该模型通过引入结构化的高维人体表征、结构化的自动解码器以及结构化的隐空间扩散模型，有效解决了传统三维数字人制作耗时耗力的难题。
StructLDM模型能够从图像和视频中学习，生成高质量、多样化的三维数字人，并且支持不同层级的可控生成与编辑功能。在实验中，StructLDM在多个数据集上展示了其优越的性能，与现有3D GAN方法相比，StructLDM能够生成视角一致、高质量的三维数字人，并且不受特定服装类型或遮罩条件限制，适用性更强。
该团队的研究成果不仅为数字孪生、元宇宙、游戏和全息通讯等领域提供了新的技术支持，还为人工智能在数字化转型中的应用开辟了新的路径。StructLDM的提出，标志着三维数字人生成领域进入了一个新的阶段，为未来的技术创新和产业发展奠定了坚实的基础。
英语如下：
News Title: “Nanyang Technological University Breaks New Ground: Structural Diffusion Model Innovates 3D Digital Human Generation”
Keywords: Nanyang Technological University, StructLDM, 3D Generation
News Content: The S-Lab team from Nanyang Technological University in Singapore has achieved a significant breakthrough in the field of 3D digital human generation, proposing a new paradigm named the Structured Latent Space Diffusion Model (StructLDM). This model effectively addresses the time-consuming and labor-intensive challenges of traditional 3D digital human creation by introducing structured high-dimensional body representations, structured automatic decoders, and a structured latent space diffusion model.
The StructLDM model is capable of learning from images and videos to generate high-quality and diverse 3D digital humans, and it supports controllable generation and editing functions at different levels. In experiments, StructLDM demonstrated superior performance on multiple datasets, outperforming existing 3D GAN methods by generating high-quality 3D digital humans with consistent viewpoints and without being limited by specific types of clothing or mask conditions, making it more versatile.
The team’s research outcomes not only provide new technical support for the fields of digital twins, metaverse, gaming, and holographic communication but also open up new avenues for the application of artificial intelligence in digital transformation. The introduction of StructLDM marks a new phase in the 3D digital human generation field, laying a solid foundation for future technological innovation and industrial development.
【来源】https://www.jiqizhixin.com/articles/2024-08-12-4
Views: 1