Gesture Recognition Comes to Virtual Reality Platforms
Inuitive, a developer of advanced 3D computer vision and image processors, and gestigon, the global market leader for hand and finger tracking gesture control middleware, have announced a collaboration to bring gesture recognition to embedded virtual reality platforms. The first stage of this collaboration will be demonstrated by both companies at CES 2016 in Las Vegas.
“Using today’s head-mounted VR displays, my hands are either not visible, or the tracking is so slow and inaccurate that the hands feel more like a robot’s and not my own,” says Moritz v. Grotthuss, CEO of gestigon.
Second generation head-mounted-devices will include front-facing 3D sensors to improve realism, but component cost and power consumption are key concerns. Bringing together the Inuitive NU3000 multi-core imaging processor and gestigon gesture recognition algorithms, the collaboration between the two companies aims to address these concerns.
“Our unique technology and architecture uses input from standard, low-cost cameras to efficiently generate depth maps. Now, through our collaboration with gestigon, we can offer a complete one-stop solution to our customers, shortening the development cycle,” said Shlomo Gadot, CEO and Co-Founder of Inuitive.
Inuitive’s NU3000 processor incorporates two CEVA MM3101 high-performance, low-power imaging and computer vision vector DSP cores. In addition, it integrates a dedicated hardware accelerator capable of extracting real-time depth maps from stereo vision input. The gestigon gesture recognition algorithms, based on its Carnival AR/VR Interaction Suite, are customized and optimized to run directly on this processor to provide fingertip and hand tracking, as well as gesture recognition.
“gestigon is in the business of enabling new 3D sensors for global OEMs; Inuitive provides a unique and attractive solution especially suited for embedded environments.” states Moritz v. Grotthuss. “This collaboration is a key step Inuitive is taking towards the goal of offering a complete reference design for VR and AR products,” adds Shlomo Gadot.
The CES 2016 demonstration consists of a depth sensing module utilizing the Inuitive NU3000 processing engine and featuring gestigon’s gesture recognition software. For demo purposes, the unit is assembled on an Oculus Rift development kit.
About Inuitive
Inuitive is an Israeli company founded in March 2012; NU3000 is Inuitive’s flagship product, aimed mostly at mobile applications. Since it was first introduced to the market, NU3000 has gained growing momentum as the leading solution for depth sensing and processing in mobile platforms. NU3000 is already in mass production.
About gestigon
gestigon develops middleware algorithms that work with 3D depth sensors to recognize human poses, gestures and biometrical features. Addressed markets are AR/VR headsets, automotive and consumer electronics/smart home. The software solution is recognized for its speed (low latency) and a wide range of deployment, including embedded systems. The company is headed by co-founders Moritz v. Grotthuss (CEO) and Sascha Klement (CTO) and has grown to 27 employees since it was founded in 2011. The main office is located in Lübeck/Germany, with a project office in Sunnyvale/USA.
