近日,Meta公司公布了一项名为audio2photoreal的AI框架,该技术能够通过输入配音文件,自动为人物模型对口型、摆动作,生成逼真的NPC人物模型。这一创新技术的出现,无疑为虚拟现实世界带来了更为真实和丰富的互动体验。
据了解,audio2photoreal AI框架能够将配音文件中的声音转化为逼真的人物口型和动作,从而实现虚拟人物与用户的自然对话。这意味着,用户在虚拟世界中可以与NPC人物进行更为真实、自然的交流,提升了虚拟现实体验的真实感和沉浸感。
Meta公司表示,audio2photoreal AI框架的未来应用前景广阔,不仅可以应用于游戏、影视等领域,还可以用于虚拟现实教育、在线医疗咨询等方面,为用户提供更加个性化和真实的互动体验。
Title: Meta Unveils audio2photoreal AI Framework: Voiceover Transforms into Realistic Dialogue Scenes
Keywords: Meta, AI framework, audio2photoreal
News content:
Recently, Meta has announced the audio2photoreal AI framework, a technology that can generate realistic NPC character models by inputting voiceover files, automatically syncing the lip movements and actions for the character models. This innovative technology undoubtedly brings a more realistic and rich interactive experience to the virtual reality world.
It is understood that the audio2photoreal AI framework can convert the sounds in the voiceover files into realistic character lip movements and actions, thus enabling natural dialogue between virtual characters and users. This means that users can have more realistic and natural interactions with NPC characters in the virtual world, enhancing the sense of reality and immersion in the virtual reality experience.
Meta stated that the future applications of the audio2photoreal AI framework are vast, and can be used in fields such as gaming, film and television. It can also be applied in virtual reality education, online medical consultation, and other areas, providing users with more personalized and realistic interactive experiences.
【来源】https://www.ithome.com/0/744/255.htm
Views: 1