At the opening keynote to this summer’s Intel Developer Forum, CEO Brian Krzanich announced a new initiative to enable a completely untether VR platform called Project Alloy. Using Intel processors and sensors the goal of Project Alloy is to move all of the necessary compute into the headset itself, including enough battery to power the device for a typical session, removing the need for a high powered PC and a truly cordless experience.
This is indeed the obvious end-game for VR and AR, though Intel isn’t the first to demonstrate a working prototype. AMD showed the Sulon Q, an AMD FX-based system that was a wireless VR headset. It had real specs too, including a 2560×1440 OLED 90Hz display, 8GB of DDR3 memory, an AMD FX-8800P APU with R7 graphics embedded. Intel’s Project Alloy is currently using unknown hardware and won’t have a true prototype release until the second half of 2017.
There is one key advantage that Intel has implemented with Alloy: RealSense cameras. The idea is simple but the implications are powerful. Intel demonstrated using your hands and even other real-world items to interact with the virtual world. RealSense cameras use depth sensing to tracking hands and fingers very accurately and with a device integrated into the headset and pointed out and down, Project Alloy prototypes will be able to “see” and track your hands, integrating them into the game and VR world in real-time.
The demo that Intel put on during the keynote definitely showed the promise, but the implementation was clunky and less than what I expected from the company. Real hands just showed up in the game, rather than representing the hands with rendered hands that track accurately, and it definitely put a schism in the experience. Obviously it’s up to the application developer to determine how your hands would actually be represented, but it would have been better to show case that capability in the live demo.
Better than just tracking your hands, Project Alloy was able to track a dollar bill (why not a Benjamin Intel??!?) and use it to interact with a spinning lathe in the VR world. It interacted very accurately and with minimal latency – the potential for this kind of AR integration is expansive.
Those same RealSense cameras and data is used to map the space around you, preventing you from running into things or people or cats in the room. This enables the first “multi-room” tracking capability, giving VR/AR users a new range of flexibility and usability.
Though I did not get hands on with the Alloy prototype itself, the unit on-stage looked pretty heavy, pretty bulky. Comfort will obviously be important for any kind of head mounted display, and Intel has plenty of time to iterate on the design for the next year to get it right. Both AMD and NVIDIA have been talking up the importance of GPU compute to provide high quality VR experiences, so Intel has an uphill battle to prove that its solution, without the need for external power or additional processing, can truly provide the untethered experience we all desire.
Really both AMD and
Really both AMD and Imagination Technologies(PowerVR Wizard) are getting their better than Intel GPU technology into wired/wireless VR headsets using APUs/SOCs and The PowerVR Wizard with the Ray Tracing units on the GPU will make for some very realistic lighting effects(1). AMD will probably have some Bristol Ridge SKUs to update that FX8800p first generation excavator product with a Bristol Ridge/DDR4 and a little more GPU performance in a headset wireless or otherwise. 2017 will bring on Zen/Polaris at 14nm and even more GCN CUs and ACE units to make for even better performance at a more affordable prices than any Intel offerings. I’m sure that SoftBank’s ARM Holdings will have some Mali/Bifrost offerings to compete with both AMD and Imagination Technologies for the Headset with its own SOC/APU compute market for wired and wireless headsets with a little bit of their own compute to accelerate games driven from Tablet/Phones and even laptops more realistically than any Intel graphics IP.
Nvidia is the big unanswered question in the VR headset integrated APU/SOC wired/wireless market with Nvidia canceling its update for its next generation Tegra powered Tablets, but Intel lacks the total GPU IP that Imagination Technologies, and AMD, Nvidia, and ARM has for low power using graphics with good performance metrics relative to Intel’s SKUs.
That PowerVR Wizard GR6500’s dedicated Ray Tracing hardware is going to put Imagination Technologies in the lead for self contained VR headsets with their own SOC/APU processing power at low wattage for the Mobile VR headset market. Apple really needs to get that PowerVR Ray Tracing hardware in its next iPad Tablet SKUs.
“Otoy gets cinematic VR to run on low-power PowerVR graphics chips”
Wireless headsets with
Wireless headsets with integrated tablet level hardware (not powerful PC) are nothing compared to what beefy PC can provide. That and also it is much easier to introduce walled garden app store into these.
It was a neat demonstration,
It was a neat demonstration, but previous testing of the Realsense devices available have shown they are not performant enough for inside-out head tracking for VR (tracking fidelity too low, jitter too high, latency too high). It may be this is a newer and more capable revision of the Realsense hardware, but I’d wait to actually test this device before betting on it. Intel seems to not want to release it themselves but rather sell it as a ‘solution’ to vendors, so that puts someone else on the hook to actually get positional tracking working to an acceptable degree (or more likely, drop it as a feature and just do Leap Motion-style hand tracking).