近日,谷歌研究院的杰出Student Researcher Omer Bar-Tal宣布转投新兴科技公司Pika,担任其创始科学家,引领公司在视频生成领域的新一轮创新。在谷歌的9个月学生研究生涯中,Bar-Tal以其在人工智能和视频处理领域的深厚造诣,经过7个月的刻苦钻研,共同推出了名为Lumiere的视频生成技术。
Lumiere的发布在业界引起广泛关注,其核心技术在于创新的时空U-Net(STU-Net)架构。这一架构首次实现了视频在空间和时间两个维度的同步下采样和上采样,能够在网络的中间层生成视频的压缩时空表示。这一突破性的设计,使得Lumiere在学习了3000万个视频后,具备了强大的功能,包括文本生成视频、视频编辑修复、图片转视频以及视频风格化等。
尽管Omer Bar-Tal目前仍在攻读硕士学位,但他的科研成果已经显示出了非凡的潜力和影响力。此次加盟Pika,他将有望进一步推动AI在视频生成领域的应用,为用户提供更智能、更丰富的多媒体体验。这一动向也预示着Pika在人工智能与视频技术的交叉领域将可能迎来重大突破。
来源:量子位
英语如下:
**News Title:** “Google AI Rising Star Omer Bar-Tal Joins Pika as Founding Scientist to Lead Lumiere Video Revolution”
**Keywords:** Google AI researcher, Pika founding scientist, Lumiere video generation
**News Content:**
Title: Google AI Phenom Omer Bar-Tal Takes on Pika as Founding Scientist, Pioneering Video Generation Tech Innovations
Recently, Omer Bar-Tal, an outstanding Student Researcher from Google Research, announced his move to the emerging tech company Pika as a founding scientist, spearheading innovation in the field of video generation. During his 9-month tenure at Google, Bar-Tal, with his profound expertise in artificial intelligence and video processing, dedicated 7 months to the development of the groundbreaking Lumiere video generation technology.
Lumiere’s launch has garnered significant industry attention, largely due to its innovative Spatio-Temporal U-Net (STU-Net) architecture. This pioneering design enables synchronized spatial and temporal down-sampling and up-sampling in videos, creating a compressed spatiotemporal representation in the network’s intermediate layers. After learning from 30 million videos, Lumiere now boasts powerful capabilities, including text-to-video generation, video editing and restoration, image-to-video conversion, and video stylization.
Despite still pursuing his master’s degree, Bar-Tal’s research achievements have demonstrated exceptional potential and impact. With his move to Pika, he is poised to further advance AI applications in video generation, offering users a smarter and more diverse multimedia experience. This development signals that Pika might be on the brink of major breakthroughs in the intersection of AI and video technology.
**Source:** Quantum Bit
【来源】https://www.qbitai.com/2024/02/123274.html
Views: 1