【苹果公司推出Ferret-UI：革新AI对手机屏幕内容的理解能力】
苹果公司近日在研究领域迈出重要一步，发布了其最新的Ferret-UI多模态大语言模型。这一创新系统旨在克服当前多模态大模型（MLLMs）在理解移动应用程序屏幕内容上的局限性，为人工智能与手机交互开启新的可能。
据IT之家报道，现有的MLLMs在处理手机屏幕内容时面临两大挑战：一是手机屏幕独特的宽高比与大多数训练图像的标准比例不一致，导致模型在理解和解析时产生困难；二是手机应用中的图标和按钮尺寸相对较小，使得模型在识别上面临挑战。针对这些问题，苹果研发的Ferret-UI系统进行了专门优化。
Ferret-UI通过深度学习和先进的图像处理技术，能够更准确地理解手机应用程序的界面布局，包括识别微小的图标和按钮，从而提升了AI在移动设备上的交互体验。这一突破性的技术有望为苹果的iOS生态系统带来更智能、更个性化的用户体验，同时也为未来移动设备的人工智能应用设定了新的标准。
苹果公司的这一创新举措再次体现了其在人工智能领域的领先地位，Ferret-UI的推出将可能引领手机界面理解和AI交互的新趋势，为用户和开发者带来更高效、更直观的手机应用体验。
英语如下：
**News Title:** “Apple Revolutionizes AI with Ferret-UI: Unlocking Multimodal Language Model’s Understanding of Mobile Screens”
**Keywords:** Apple Ferret-UI, Multimodal Large Models, UI Understanding
**News Content:**
**Apple Unveils Ferret-UI: Transforming AI’s Understanding of Mobile Screen Content**
Apple has recently taken a significant stride in research with the announcement of its cutting-edge Ferret-UI multimodal large language model. This innovative system aims to overcome the limitations of current multimodal large language models (MLLMs) in comprehending mobile app screen content, paving the way for new possibilities in AI-device interaction.
According to IT Home, existing MLLMs encounter two main challenges when dealing with smartphone screens: the unique aspect ratio of phone screens, which differs from the standard proportions used in most training images, leading to difficulties in understanding and parsing; and the relatively small size of icons and buttons in mobile apps, posing challenges for recognition. The Ferret-UI system, developed by Apple, addresses these issues with specialized optimization.
Ferret-UI, leveraging deep learning and advanced image processing techniques, enhances the accuracy in understanding mobile app interfaces, including the identification of minute icons and buttons, thereby improving AI interaction on mobile devices. This groundbreaking technology is poised to bring smarter, more personalized user experiences to Apple’s iOS ecosystem and sets new standards for AI applications in future mobile devices.
This innovative move by Apple underscores its leading position in the AI domain. The introduction of Ferret-UI is expected to drive new trends in mobile screen understanding and AI interactions, offering users and developers more efficient and intuitive app experiences.
【来源】https://www.ithome.com/0/760/905.htm
Views: 2