Meta and DGIST Collaborate on ExAvatar: A 3D Digital AvatarGeneration Model
Seoul, South Korea – A groundbreaking collaboration between the Daegu Gyeongbuk Institute of Science and Technology (DGIST) and Meta’s Codec Avatars Lab has resulted in the creation of ExAvatar, acutting-edge 3D digital avatar generation model. This innovative technology allows users to transform short videos of themselves into realistic 3D avatars, complete with full-body motion and facial expressions.
ExAvatar leverages a combination of advanced technologies to achieve its impressive results. The model utilizes the SMPL-X model, a highly parameterized 3D human body model, to capture precise body posesand movements. This is further enhanced by 3D Gaussian splatting technology, which simulates light scattering on surfaces, contributing to a more realistic and efficient rendering process.
The integration of 3D Gaussian and surface mesh techniques in ExAvatar’s hybrid representation ensures consistency in geometry and appearance across different poses, minimizing artifacts that can occur during animation. This is further refined by a multi-layer perceptron (MLP) that processes features of each Gaussian, extracting key information and combining it with the standard mesh to create a 3D avatar that canbe animated within a standard space.
ExAvatar’s animation process is powered by the Linear Blend Skinning (LBS) algorithm, which generates smooth and natural transitions between movements. The model also incorporates joint and facial offsets, optimized during training, to enhance the expressiveness and naturalness of the avatars, particularly inhand and facial regions.
A key feature of ExAvatar is its user-friendly interface. Users can quickly create 3D avatars simply by scanning themselves with their smartphones, eliminating the need for complex and time-consuming processes. This accessibility opens up a wide range of potential applications across various industries.
Potential Applicationsof ExAvatar:
- 3D Animation: Animators can utilize ExAvatar to rapidly create realistic 3D characters for animation films, TV series, or short films, significantly streamlining the character creation process.
- Game Development: Game developers can leverage ExAvatar technology to design dynamic full-body movements andfacial expressions for game characters, enhancing the overall gaming experience.
- Virtual Reality (VR): ExAvatar allows users to generate their own 3D avatars within VR environments, providing a more immersive and personalized experience.
- Augmented Reality (AR): ExAvatar can be integrated into AR applications,such as social media, advertising, and educational platforms, to enhance interactivity and engagement.
- Film Special Effects: Film special effects artists can utilize ExAvatar to capture actors’ movements and expressions for use in post-production special effects, creating more realistic and believable characters.
Availability and Future Development:
ExAvatar’s code is publicly available on GitHub, allowing developers and researchers to explore and build upon its capabilities. The research paper detailing the technology has been published on arXiv, providing a comprehensive understanding of its technical underpinnings.
The development team at DGIST and Meta’s Codec Avatars Lab are actively workingto further improve ExAvatar’s capabilities. Future enhancements may include:
- Enhanced realism: Improving the fidelity of the generated avatars to achieve even more realistic representations.
- Increased customization: Expanding the range of customization options for users to create avatars that reflect their unique features and preferences.
- Integration withother platforms: Enabling seamless integration with popular VR and AR platforms to broaden ExAvatar’s reach and accessibility.
ExAvatar represents a significant advancement in the field of 3D avatar generation, offering a powerful tool for creating realistic and expressive digital representations. Its user-friendly interface and wide range of potential applications make ita promising technology with the potential to revolutionize how we interact with digital worlds.
【source】https://ai-bot.cn/exavatar/
Views: 1