Ultraleap and Prophesee showcase new AR vision system at CES
The annual Consumer Electronics Show is the largest showcase for new consumer-focused, sensor-driven products. Ultraleap, an innovator of haptic technology, and Prophesee, a company that enables sensor technology, have jointly launched a new system for augmented reality (AR) devices. It combines event sensors with hand tracking.
The news follows Prophesee’s late-year unveiling of the GenX320 event-focussed Metavision sensor, the company’s newest event-based vision sensor. Using AR glasses, the new system combines Ultraleap’s cutting-edge computer vision and machine learning algorithms with the GenX320.
According to Ultraleap’s co-founder and CEO Tom Carter, there isn’t anything on the marketplace that uses finger tracking and event monitors to enable augmented reality. In addition to offering the most natural method of engagement, hand contact significantly improves augmented reality by increasing functionality and improving the ergonomics of the control system. A large dynamic range, low latency, low power consumption, and enhanced privacy are all necessary to achieve the glasses form factor required for widespread use. The Ultraleap and Prophesee crews aim to address these difficulties with their innovative approach.
The GenX320 is a stacked event-based vision sensor with 320×320 6.3-micrometer pixels and a compact 1/5-inch optical size on a 3×4-mm chip. With the use of smart wake-on-events functionality and intelligent power management variations, power consumption may be as low as 36 microwatts. The sensor only activates when there is movement in the scene.
According to Prophesee, event-based vision sensors—which, in contrast to frame-based sensors, only record changes in movement—are a suitable match for always-on consumer goods like augmented reality glasses because of their low battery consumption and low latency. More recently, the business told Fierce Electronics that although AR was an obvious first step, the Ultraleap cooperation is merely a sample of what is to come when its technology is integrated into additional consumer gadgets.
The company said in an email that although its team is working on various products for other lines, the fundamental advantages of event sensors solve some of the major issues facing augmented reality at the moment, including the requirement for privacy, low battery usage, and a wide dynamic range. This makes them perfect for the section.
Although the two are openly declaring their alliance at this year’s CES, Prophesee noted that the business and Ultraleap had been collaborating for some time prior to the revelation and had written papers and given talks at meetings within the computer vision circle. Ultraleap was listed as an early adopter of the technology when Prophesee unveiled the GenX320 last October, although in that instance, the application shown was a touch-free, gesture-tracking restaurant ordering kiosk.
Regarding the new augmented reality glasses system, Prophesee is offering an appointment-only product presentation at CES. The company hopes this will launch more consumer market options for its technology, maybe in TVs and video gaming consoles. Computers, smart home gadgets, and more.
