近日，科技巨头苹果公司与美国加利福尼亚大学圣芭芭拉分校（UCSB）的研究团队共同开源了一项名为MGIE（MLLM-Guided Image Editing）的图片编辑框架，旨在解决传统图像编辑中指令引导不足的难题。这一创新技术将多模态大模型MLLM（Multimodal Large Language Model）巧妙地融入其中，以提升图像编辑的智能与精准度。
据机器之心报道，MLLM通过深度学习能够理解并生成简洁的编辑指令，为用户提供清晰的视觉引导。在MGIE框架下，扩散模型通过端到端的训练得到优化，能根据预期目标的潜在想象力执行图像编辑任务。这一框架的灵活性和智能性使得它不仅能够实现Photoshop级别的复杂修改，还能进行全局照片的优化以及对局部对象的精确调整。
MGIE的开源，为开发者和设计师提供了强大的工具，使得图像编辑更加智能化、人性化。这一技术的突破不仅可能重塑数字图像编辑的未来，也为人工智能在创意领域的应用开辟了新的可能。苹果和UCSB的这一合作，再次证明了科技与艺术的深度融合在推动创新方面所发挥的巨大作用。
英语如下：
**News Title:** “Apple and UCSB Collaborate on Open-Source Innovation: The MGIE Framework, Revolutionizing Image Editing with AI on a Photoshop-Level”
**Keywords:** Apple UCSB collaboration, MGIE Framework, Image editing
**News Content:**
In a recent development, technology giant Apple has joined forces with the research team from the University of California, Santa Barbara (UCSB) to release an open-source image editing framework called MGIE (MLLM-Guided Image Editing). This groundbreaking technology aims to address the limitations of traditional image editing by incorporating AI-driven guidance.
According to reports from Machine之心, MLLM (Multimodal Large Language Model) utilizes deep learning to comprehend and generate concise editing instructions, offering users clear visual guidance. Within the MGIE framework, diffusion models are optimized through end-to-end training, enabling them to perform image editing tasks based on the potential imagination of the intended outcome. The framework’s flexibility and intelligence allow it not only to execute complex edits on par with Photoshop but also to refine overall photographs and make precise adjustments to specific objects.
By making MGIE open-source, developers and designers now have access to a powerful tool that enhances image editing with increased intelligence and user-friendliness. This technological breakthrough has the potential to reshape the future of digital image editing and opens up new possibilities for AI applications in creative fields. The collaboration between Apple and UCSB underscores the significant role that the fusion of technology and art plays in driving innovation.
【来源】https://www.jiqizhixin.com/articles/2024-02-05-10
Views: 1