苹果公司近日在研究领域取得重大突破，推出了一款名为 Ferret-UI 的多模态大语言模型，旨在改善人工智能系统对手机应用程序屏幕内容的理解。据IT之家报道，当前的多模态大模型在处理移动应用界面时面临挑战，主要由于手机屏幕的特殊宽高比与大多数训练图像的标准比例不一致，以及需要识别的图标和按钮尺寸相对较小。
Ferret-UI 系统针对这些问题进行了优化设计，它能够更准确地解析和理解手机屏幕上的各种元素，包括图标、按钮和其他用户界面组件。这一创新技术有望提升人工智能在移动设备上的交互体验，使得智能助手和自动化工具能够更精准地执行用户指令，从而提高效率和便利性。
苹果公司这一举措进一步展示了其在人工智能领域的技术领先地位，同时也预示着未来移动设备与人工智能的融合将更加紧密。随着 Ferret-UI 的发展和应用，我们可以期待智能设备在理解和响应用户需求方面将达到一个新的水平，为日常生活和工作带来更多智能化的解决方案。
英语如下：
**News Title:** “Apple Breakthrough: Ferret-UI Paves the Way for AI to Accurately Understand Mobile Apps, Marking a New Era for Multimodal Large Language Models”
**Keywords:** Apple Ferret-UI, Multimodal Large Models, Understanding Mobile Screens
**News Content:** Apple has recently made a significant breakthrough in research with the introduction of Ferret-UI, a multimodal large language model designed to enhance artificial intelligence systems’ understanding of mobile application screens. According to IT Home, current multimodal large models face challenges when dealing with mobile app interfaces, primarily due to the discrepancy between the unique aspect ratio of phone screens and the standard ratios used for most training images, as well as the relatively small size of recognizable icons and buttons.
Ferret-UI has been optimized to address these issues, enabling more precise parsing and comprehension of various elements on smartphone screens, including icons, buttons, and other user interface components. This innovative technology is poised to enhance the interaction experience of AI on mobile devices, allowing smart assistants and automation tools to execute user commands with greater accuracy, thereby increasing efficiency and convenience.
This move by Apple further underscores its technological leadership in the AI domain and foreshadows an even closer integration of mobile devices with artificial intelligence in the future. As Ferret-UI evolves and is implemented, we can anticipate a new level of understanding and responsiveness in smart devices to user needs, bringing more intelligent solutions to daily life and work.
【来源】https://www.ithome.com/0/760/905.htm
Views: 1