【苹果与UCSB合作，开源全新图片编辑框架MGIE】
近日，科技巨头苹果公司与美国加州大学圣芭芭拉分校（UCSB）的研究团队共同开源了一项名为MGIE（MLLM-Guided Image Editing）的创新图片编辑框架。这一框架旨在解决传统指令引导不足的问题，为图像编辑带来更为智能和精准的体验。
MGIE的核心是利用多模态大模型MLLM（Multimodal Large Language Model），该模型能够学习并生成简洁明了的编辑指令，同时提供与视觉内容紧密相关的引导。通过端到端的训练，扩散模型能够同步更新，激活并利用对预期目标的潜在想象力来执行图像编辑任务。
据机器之心报道，MGIE不仅支持类似Photoshop的复杂图像修改，还能够进行全局照片优化以及精确的局部对象修改。这一技术的开源，意味着广大用户和开发者将有机会利用这一先进工具，以更直观、自然的方式实现图像创意编辑，进一步推动了人工智能在图像处理领域的应用和发展。
苹果与UCSB的这项合作再次展示了科技巨头在科研创新上的深度合作，以及将尖端技术普惠大众的决心。MGIE的开源将为图像编辑行业带来革命性的变化，我们期待看到更多基于此框架的创新应用在未来涌现。
英语如下：
**News Title:** “Apple and UCSB Collaborate on Open-Source Innovation: MGIE Framework, AI-Powered Image Editing for a Photoshop-Level Experience”
**Keywords:** Apple UCSB collaboration, MGIE framework, AI image editing
**News Content:**
**Apple and UCSB Team Up to Open-Source the Innovative MGIE Image Editing Framework**
Recently, tech giant Apple has joined forces with the research team from the University of California, Santa Barbara (UCSB) to release an open-source, groundbreaking image editing framework called MGIE (MLLM-Guided Image Editing). This framework aims to address the limitations of traditional instruction-guided methods, offering a smarter and more precise image editing experience.
At the core of MGIE is the MLLM (Multimodal Large Language Model), which learns and generates concise editing instructions while providing visually correlated guidance. Through end-to-end training, diffusion models can simultaneously update, activate, and leverage latent imagination of the intended target for image editing tasks.
According to reports from Machine之心, MGIE not only supports complex image modifications similar to Photoshop but also enables global photo optimization and precise local object alterations. The open-sourcing of this technology means that a wide user base and developers now have the opportunity to leverage this advanced tool for more intuitive and natural image creative editing, further advancing AI applications in image processing.
This collaboration between Apple and UCSB underscores the commitment of tech giants to deep research innovation and democratizing cutting-edge technology. The open-source release of MGIE is set to bring a revolutionary change to the image editing industry, and we look forward to witnessing more innovative applications emerging from this framework in the future.
【来源】https://www.jiqizhixin.com/articles/2024-02-05-10
Views: 1