AI视频生成工具Pika上线人物配音口型同步功能
北京时间2023年3月8日，AI视频生成平台Pika宣布推出人物配音口型同步功能LipSync，目前仅支持Pro用户体验。该功能由AI语音克隆初创公司ElevenLabs提供技术支持，旨在为视频中的虚拟人物提供逼真的语音和口型同步效果。
LipSync功能允许用户输入文本，由AI生成与文本匹配的语音，并自动与视频中人物的口型同步。目前，该功能仅支持英文配音，但Pika表示未来将支持更多语言。
Pika表示，LipSync功能的推出将极大提升视频制作的效率和质量。用户无需聘请配音演员或进行繁琐的口型同步工作，即可为视频添加逼真的语音效果。
不过，实测结果显示，LipSync功能的效果与其他同类产品，如Heygen和出门问问的奇妙元相比，仍有一定差距。在某些情况下，生成的语音可能存在失真或不自然的情况，口型同步也不完全准确。
Pika表示，将继续优化LipSync功能，以提供更优质的配音和口型同步效果。同时，公司还计划推出更多AI驱动的视频生成工具，以满足用户不断变化的需求。
业内专家认为，AI视频生成技术的快速发展正在重塑视频制作行业。LipSync功能的推出将进一步降低视频制作的门槛，让更多人能够轻松创建高质量的视频内容。
英语如下：
**Headline: AI Video Dubbing Tech: Lip-Syncing That’sAlmost Too Real**
**Keywords:** AI dubbing, lip-syncing, video generation
**News Content:**
AI video generation tool Pika haslaunched a new feature called LipSync, which allows users to add lip-synced voiceovers to their videos. The feature is currently available to Pro users only and is powered by AI voice cloning startup ElevenLabs. It aims to provide realistic voice and lip-syncing for virtual characters in videos.
LipSync allowsusers to input text, which is then converted into speech by AI and automatically synced to the lip movements of a character in a video. Currently, the feature only supports English voiceovers, but Pika says it plans to add support for more languages in the future.
Pika says the LipSync feature will greatly improve the efficiency and quality of video production. Users can add realistic voiceovers to their videos without having to hire voice actors or go through the tedious process of manually lip-syncing.
However, early tests show that LipSync’s performance still lags behind other similar products, such as Heygen and Outfunnel’s Miao Yuan. In some cases, the generated speech can sound distorted or unnatural, and the lip-syncing is not always accurate.
Pika says it will continue to improve the LipSync feature to provide higher-quality dubbing and lip-syncing. The company also plans to release more AI-powered video generation tools in the future to meet the evolving needs of its users.
Industry experts say the rapid development of AI video generation technology is transforming the video production industry. The launch of LipSync will further lower the barrier to video creation, making it easier for more people to create high-quality video content.
【来源】https://mp.weixin.qq.com/s/8CLmrQH7snh5GeQ4iNc_0A
Views: 1