【苹果公司推出Ferret-UI：多模态大语言模型助力理解手机屏幕内容】
苹果公司近日在科研领域迈出重要一步，发布了关于Ferret-UI人工智能系统的研究论文。这款创新的多模态大语言模型（MLLMs）旨在解决现有技术在理解移动应用程序屏幕内容时的局限性。
当前，尽管MLLMs在处理各种信息方面表现出色，但在理解和解析手机应用程序的屏幕内容时，仍存在挑战。主要问题在于手机屏幕的宽高比与大多数训练图像使用的比例不同，以及应用程序中的图标和按钮尺寸相对较小，这使得模型在识别时面临困难。
为了解决这些问题，苹果公司研发了Ferret-UI系统。该系统特别优化了对手机屏幕内容的理解，能够更准确地识别和解析应用程序中的图标、按钮和其他交互元素。这一突破性的技术有望提升移动设备的用户体验，使用户与应用程序的交互更加顺畅，同时为未来的智能设备和人机交互设计开辟新的可能。
据来源IT之家的报道，Ferret-UI的推出，标志着苹果公司在人工智能和多模态理解领域的领先地位，同时也预示着移动设备界面的智能化程度将达到新的高度。苹果公司的这一创新将对整个行业产生深远影响，推动移动应用的用户体验达到前所未有的水平。
英语如下：
**News Title:** “Apple Breakthrough: Ferret-UI Paves the Way for AI to Accurately Understand Mobile Apps, Launching a New Era for Multimodal Large Language Models”
**Keywords:** Apple Ferret-UI, Multimodal Large Language Models, Mobile Screen Understanding
**News Content:**
**Apple Unveils Ferret-UI: Multimodal Language Model Enhances Understanding of Mobile App Screens**
Apple has recently taken a significant stride in research by releasing a paper on its Ferret-UI artificial intelligence system. This innovative Multimodal Large Language Model (MLLMs) aims to overcome limitations in current technology when it comes to understanding the content displayed on mobile application screens.
Presently, while MLLMs excel in processing diverse information, they still face challenges when it comes to interpreting app screen content. Key issues stem from the difference in aspect ratios between mobile screens and the proportions typically used in training images, as well as the relatively small size of icons and buttons within applications, posing difficulties for recognition.
To address these challenges, Apple has developed the Ferret-UI system. Specifically optimized for understanding mobile screen content, it can more accurately identify and parse icons, buttons, and other interactive elements within applications. This groundbreaking technology promises to enhance the user experience on mobile devices, facilitating smoother interactions with apps, and opens up new possibilities for future smart devices and human-computer interaction design.
According to a report from IT Home, the introduction of Ferret-UI underscores Apple’s leadership in artificial intelligence and multimodal understanding, and signals a new level of sophistication in the智能化 of mobile device interfaces. Apple’s innovation is expected to have a profound impact on the industry, propelling the user experience in mobile applications to unprecedented heights.
【来源】https://www.ithome.com/0/760/905.htm
Views: 1