北京，2023年6月15日 —— 苹果公司今日发布了一篇研究论文，揭示了其最新的Ferret-UI人工智能系统，该系统能够更有效地理解移动应用程序的屏幕内容。这项创新标志着苹果在人工智能领域的一个重要突破，为用户带来了更为智能化的交互体验。
传统的多模态大语言模型（MLLMs）在面对手机屏幕时存在局限性，主要是因为手机屏幕的宽高比与大多数训练图像使用的比例不同，导致模型难以识别图标和按钮等小尺寸元素。为了解决这些问题，苹果设计了Ferret-UI系统。
Ferret-UI系统通过先进的机器学习和深度学习技术，能够准确识别和理解手机屏幕上的各种元素。它不仅能够识别图标和按钮，还能够理解应用程序的布局和用户界面，从而为用户提供更加个性化和智能化的服务。
苹果的这项技术将首先应用于其最新的iOS操作系统，预计将在今年晚些时候发布。随着Ferret-UI系统的广泛应用，苹果希望进一步提升用户在移动设备上的体验，同时也为其他科技公司提供了新的研究方向。
苹果公司的这一创新再次证明了其在人工智能领域的领导地位，也为未来的技术发展奠定了坚实的基础。随着Ferret-UI系统的推出，苹果预计将引领一场移动交互方式的革命，为用户带来更加便捷和智能的体验。
英语如下：
News Title: “Apple Innovates: Ferret-UI Multimodal AI Analyzes Mobile App Screen Content”
Keywords: Apple, AI System, Application Understanding
News Content:
Title: Apple Launches Ferret-UI Multimodal Large Language Model to Enhance Screen Content Understanding on Mobile Devices
Beijing, June 15, 2023 — Apple today released a research paper unveiling its latest Ferret-UI artificial intelligence system, which can more effectively understand the content of mobile application screens. This innovation marks a significant breakthrough in the field of artificial intelligence for Apple, bringing a more intelligent interaction experience to users.
Traditional multimodal large language models (MLLMs) face limitations when encountering mobile screen content, primarily because the aspect ratio of mobile screens differs from that of the majority of training images, making it difficult for the models to recognize small elements such as icons and buttons. To address these issues, Apple designed the Ferret-UI system.
The Ferret-UI system utilizes advanced machine learning and deep learning technologies to accurately recognize and understand various elements on mobile screen content. It can not only recognize icons and buttons but also understand the layout and user interface of applications, thus providing users with more personalized and intelligent services.
This technology from Apple will initially be applied to its latest iOS operating system and is expected to be released later this year. With the widespread application of the Ferret-UI system, Apple aims to further enhance the user experience on mobile devices and also offers new research directions to other tech companies.
Apple’s innovation once again demonstrates its leadership in the field of artificial intelligence and lays a solid foundation for future technological developments. With the launch of the Ferret-UI system, Apple expects to lead a revolution in mobile interaction methods, bringing users more convenient and intelligent experiences.
【来源】https://www.ithome.com/0/760/905.htm
Views: 4