开发者利器!XREAL Air 2 ULTRA开售,沉浸式体验AI开发
北京时间7月31日下午2点整,XREAL系列AR眼镜的最新成员XREAL Air 2 Ultra在国内正式发售,目前在京东、天猫和抖音等平台都已上线,首发价3999元。这款AR眼镜是主要面向开发者群体打造的旗舰级产品,旨在降低广大开发者进入空间计算的门槛,推动空间计算领域革新,建立更繁荣的AR生态体系。
赋能开发者六大核心能力作为XREAL第二款6 DoF(Six Degrees of Freedom,六自由度)全功能眼镜,XREAL Air 2 Ultra也是目前业界唯一通过双环境感知传感器(SLAM Camera)来实现空间计算的轻量化AR设备。其通过搭载双环境感知传感器硬件+软件SDK,支持高精确度和低延迟的6DoF空间定位和手势交互,这意味着AR交互体验迈入全新阶段。
6DoF技术是重塑AR沉浸体验的重要环节,在增强现实(AR)眼镜设备中具有关键作用,它赋予了全方位的空间感知能力,让用户能够在虚拟与现实之间自由穿梭。该技术利用位于XREAL Air 2 Ultra两侧的双环境感知传感器,可以识别特征点,并监控摄像头图像中显示的特征点随时间推移而发生的移动。将这些点的移动与眼镜的IMU传感器数据相结合,NSDK就能在空间导航过程中准确追踪眼镜的位置和方向。6DoF追踪功能不仅能实时构建地图,还能整合空间锚点,为开发人员提供有关环境中物理结构的详细信息,从而增强应用功能。
在6DoF运动追踪之外,XREAL基于跨平台游戏引擎Unity构建的最新软件NRSDK,进一步强化了手部追踪和手势识别功能,可供开发者开发应用,为Air 2 Ultra注入强大的生命力。其中,NRSDK的“手部追踪”功能尤为出色,不仅稳定追踪手部关键点位置,同时无缝执行手势的实时识别。识别出的手部姿势会以第一人称视角直观呈现,便于开发者在真实世界中与虚拟对象进行直观、自然、身临其境的交互。
更深入来看,在6DoF运动追踪和手势交互之外,NRSDK还具备平面检测、图像识别、深度网格、空间锚点等几大核心能力,皆可通过Ultra的硬件能力实现,全面释放眼镜的硬件潜能。通过计算机视觉和先进算法的融合,NRSDK的平面检测功能可实时准确地识别水平和垂直平面,精准捕捉并追踪环境特征,为开发者描绘精准、动态的三维空间地图。深度网格也是NRSDK提供的一项核心功能,能够实时生成带有语义标签的三角形网格表面,在处理虚拟内容时发挥关键作用。借助图像追踪功能,NRSDK还可以识别和追踪特定的图像,为AR应用开辟新天地。空间锚点是重要的AR功能,NRSDK本次为XREAL眼镜提供了空间锚点功能,为多人协作场景开辟了全新可能性。
由此可见,Ultra眼镜凭借其卓越的硬件性能与NRSDK软件功能的紧密融合,为开发者铺就了一条实现全方位、沉浸式AR体验的高速通路。也由于支持了大量前述空间计算技术,Ultra眼镜在开发者之外,还面向追求AR极致体验的先锋用户以及已具备AR应用场景、追求高效解决方案的企业级市场,能成为各界探索AR世界的重要能力伙伴。针对追求极致体验的AR先锋用户时,Air 2 Ultra打造了顶配的空间计算体验。Air 2 Ultra引行业之先,加入钛合金边框,在进一步减重、提升舒适度的同时,也保证了产品的高端定位。
XREAL Air 2 Ultra的发布,不仅为开发者提供了强大的工具,也为广大用户带来了全新的AR体验,预示着未来空间计算和增强现实技术将迎来新的发展高潮。
英语如下:
News Title: “XREAL Air 2 Ultra AR Glasses: New Weapons for Developers and Pioneer Users”
Keywords: XREAL Air 2 Ultra, AR Developer Tool, Spatial Computing Innovation
News Content:
Developer’s Arsenal! XREAL Air 2 ULTRA Launches, Offering Immersive AI Development Experience
On July 31st, at 2 p.m. Beijing Time, the latest member of the XREAL AR glasses series, the XREAL Air 2 Ultra, was officially launched in China. Currently available on platforms such as JD.com, Tmall, and Douyin, the launch price is 3,999 yuan. This AR glass is a flagship product designed for the developer community, aiming to lower the threshold for developers to enter spatial computing and drive innovation in the field, establishing a more prosperous AR ecosystem.
Equipping Developers with Six Core Capabilities As XREAL’s second 6 DoF (Six Degrees of Freedom) full-function AR glass, the XREAL Air 2 Ultra is currently the only lightweight AR device in the industry that realizes spatial computing through dual environmental perception sensors (SLAM camera). By integrating dual environmental perception sensor hardware with software SDK, it supports high precision and low latency 6 DoF spatial positioning and hand gesture interaction, marking a new phase for AR interaction experience.
The 6 DoF technology is an important component in reshaping the immersive AR experience, playing a key role in AR glasses devices. It grants users a comprehensive spatial perception ability, enabling them to freely navigate between the virtual and real worlds. This technology utilizes the dual environmental perception sensors on either side of the XREAL Air 2 Ultra to identify feature points and monitor the movement of these points in camera images over time. By combining these sensor data with the IMU sensors, the NSDK accurately tracks the position and orientation of the glasses during spatial navigation. The 6 DoF tracking function not only builds real-time maps but also integrates spatial anchors, providing developers with detailed information about physical structures in the environment, thereby enhancing application functions.
In addition to 6 DoF motion tracking, XREAL’s latest software, the NRSDK, built on the cross-platform game engine Unity, further strengthens hand tracking and gesture recognition capabilities, enabling developers to create applications and infusing the Air 2 Ultra with powerful vitality. Among these, the NRSDK’s “hand tracking” feature stands out, reliably tracking the key points of the hand and seamlessly performing real-time gesture recognition. The recognized hand poses are presented in a first-person perspective, facilitating developers’ intuitive, natural, and immersive interaction with virtual objects in the real world.
Furthermore, beyond 6 DoF motion tracking and hand gesture interaction, the NRSDK also features core abilities such as plane detection, image recognition, depth grids, and spatial anchors, all of which can be realized through the Ultra’s hardware capabilities, fully unleashing the potential of the glasses’ hardware. Through the fusion of computer vision and advanced algorithms, the NRSDK’s plane detection function can accurately recognize horizontal and vertical planes in real-time, capturing and tracking environmental features precisely, providing developers with a precise and dynamic three-dimensional space map. The depth grid, another core feature provided by the NRSDK, can generate real-time triangle mesh surfaces with semantic tags, playing a crucial role in processing virtual content. With image tracking functionality, the NRSDK can also recognize and track specific images, opening up new possibilities for AR applications. Spatial anchors are an important AR feature, and the NRSDK this time provides spatial anchors for XREAL glasses, opening up new possibilities for multi-user collaborative scenarios.
It is clear that the Ultra glasses, with their outstanding hardware performance and the close integration of NRSDK software functions, have paved the way for developers to achieve comprehensive and immersive AR experiences. Also, due to the support of a wide range of aforementioned spatial computing technologies, the Ultra glasses, in addition to developers, are also suitable for pioneering users seeking the ultimate AR experience and the enterprise market with existing AR application scenarios, aiming to explore AR with important capabilities. When targeting users seeking the ultimate experience, the Air 2 Ultra offers top-tier spatial computing experiences. Leading the industry, the Air 2 Ultra incorporates a titanium alloy frame, further reducing weight and improving comfort while maintaining a high-end positioning.
The launch of the XREAL Air 2 Ultra not only provides developers with a powerful tool but also brings a new AR experience to the public, signaling a new wave of development for spatial computing and augmented reality technologies.
【来源】https://www.jiqizhixin.com/articles/2024-08-04-6
Views: 2