8月19日，昆仑万维在业界率先推出首个集成视频大模型与3D大模型的AI短剧平台SkyReels。该平台集成了昆仑万维自研的剧本大模型SkyScript、分镜大模型StoryboardGen、3D生成大模型Sky3DGen，以及业界首个将AI3D引擎与视频大模型深度融合的创新平台WorldEngine。
SkyReels平台能够一键生成完整剧本、分镜、人物对白与背景音乐，支持角色形象、音色与分镜的自定义调整，并能够自动将内容转换为1080P60帧的高清视频。相比市场上其他AI视频生成工具，SkyReels能够在剧本质量、分镜质量、人物表演等各维度上提供更高质量的成果，显示出其在AI视频创作领域的领先地位。
SkyReels的AI剧本生成功能基于昆仑万维自研剧本大模型SkyScript打造。SkyScript模型通过构建高质量短剧结构化数据集SkyScript-100M，并对算法进行优化，能够输出高度结构化的精彩剧本，为不同水平的剧作家提供创作灵感。
分镜生成则由昆仑万维自研的分镜生成大模型StoryboardGen提供技术支持。StoryboardGen模型采用DiT-MoE架构，能够实现高密度分镜信息生成，大幅增强视觉叙事表达能力。
SkyReels平台的推出，不仅极大提高了视频的创作效率，降低了创作成本，也推动了“一人一剧”时代加速来临。同时，WorldEngine结合了引擎的精确可控能力和AI视频大模型的幻想生成能力，提供了全新的线上混合视频创作模式，让视频创作从模糊生成迈向更加精确可控。
昆仑万维的这一创新举措，有望引领AI视频创作领域的全新发展，为创作者提供更加便捷和高质量的创作工具，同时也为观众带来更多样化和个性化的内容体验。
英语如下：
News Title: “Kunlun万维率先推出AI Short Drama Platform SkyReels, Merging Video with 3D Models”
Keywords: AI Short Drama, Kunlun Wanwei, Integrated Models
News Content: On August 19, Kunlun Wanwei became the first in the industry to introduce SkyReels, a pioneering AI short drama platform that integrates video and 3D models. The platform incorporates Kunlun Wanwei’s proprietary models: SkyScript, a script generation model; StoryboardGen, a scene-layout generation model; Sky3DGen, a 3D generation model; and WorldEngine, an innovative platform that integrates AI 3D engines with video models for the first time.
SkyReels can generate complete scripts, storyboards, character dialogues, and background music with a single click. It supports custom adjustments for character images, voice tones, and storyboard layouts, and automatically converts content into high-definition 1080P60 videos. Compared to other AI video generation tools on the market, SkyReels offers higher-quality outcomes in terms of script quality, scene quality, and character performance, showcasing its leading position in the AI video creation field.
The AI script generation function of SkyReels is based on Kunlun Wanwei’s proprietary script generation model, SkyScript. The SkyScript model, by constructing a high-quality short drama structured dataset of SkyScript-100M and optimizing the algorithm, can output highly structured and compelling scripts, providing creative inspiration for writers at different levels.
Scene-layout generation is supported by Kunlun Wanwei’s proprietary StoryboardGen model, which uses the DiT-MoE architecture to generate high-density scene-layout information, significantly enhancing visual narrative expression capabilities.
The launch of SkyReels greatly enhances the efficiency of video creation and reduces production costs, accelerating the arrival of the era of “one person, one drama.” Additionally, WorldEngine combines the precise control capabilities of the engine with the fantasy generation capabilities of AI video models, providing a new online mixed video creation mode that moves video creation from fuzzy generation to more precise control.
Kunlun Wanwei’s innovative initiative is expected to lead the new development of the AI video creation field, providing creators with more convenient and high-quality creation tools, as well as offering viewers a more diverse and personalized content experience.
【来源】http://www.chinanews.com/cj/2024/08-19/10271024.shtml
Views: 1