**苹果与UCSB合作开源创新图片编辑框架MGIE**
近日，科技巨头苹果公司与加利福尼亚大学圣巴巴拉分校（UCSB）的研究团队共同发布了一项名为MGIE（MLLM-Guided Image Editing）的开源图片编辑框架，旨在解决指令引导不足的问题，为图像编辑领域带来革命性的进步。MGIE利用了多模态大模型MLLM（Multi-Modal Large Language Model），该模型能够学习生成简洁明了的编辑指令，并提供与视觉内容紧密相关的指导。
据机器之心报道，MGIE通过端到端的训练机制，使得扩散模型能够同步更新，并借助对预期目标的潜在想象力来执行图像编辑任务。这一创新框架使得用户能够根据简单的文本指令，进行如同Photoshop般精细的图像修改，同时也能进行全局照片优化和局部对象的精确调整。
这一开源项目为图像编辑和设计社区提供了强大的工具，将人工智能的智能与人类的创意指令相结合，有望推动图像编辑技术的进一步发展，为用户带来更为智能、便捷的编辑体验。苹果和UCSB的这项合作再次展示了科技与艺术的融合，以及学术界与产业界携手创新的强大力量。
英语如下：
**News Title:** “Apple and UCSB Collaborate on Open-Source Innovation: MGIE Framework, Pioneering AI-Powered Photoshop-Level Image Editing”
**Keywords:** Apple UCSB collaboration, MGIE framework, AI image editing
**News Content:**
Recently, tech giant Apple and researchers from the University of California, Santa Barbara (UCSB) jointly unveiled the MGIE (MLLM-Guided Image Editing) open-source image editing framework. Aimed at addressing the issue of inadequate directive guidance, this innovation promises a revolutionary advancement in the field of image editing. MGIE employs the MLLM (Multi-Modal Large Language Model), a model capable of learning to generate concise editing instructions closely tied to visual content.
According to reports from Jiqizhixin, MGIE utilizes an end-to-end training mechanism, enabling diffusion models to update simultaneously and execute image editing tasks using an imagined understanding of the intended target. This innovative framework allows users to perform fine-grained image modifications akin to Photoshop, as well as global photo optimization and precise adjustments to local objects, all guided by simple text instructions.
This open-source project equips the image editing and design community with powerful tools, combining the intelligence of AI with human creative directives. It has the potential to propel further development in image editing technology, offering users a smarter and more convenient editing experience. The collaboration between Apple and UCSB underscores the fusion of technology and art, as well as the strength of innovation when academia and industry join forces.
【来源】https://www.jiqizhixin.com/articles/2024-02-05-10
Views: 1