Most 360 content isn’t very good. Whether or not you consider this content to be “true” VR, the truth is much of it isn’t even worth debating. For every standout from a team like Felix and Paul, there are 20 low-resolution examples overflowing with meh. But even the best ones now look like garbage compared to what I just finished seeing at F8.
Hidden in a side hall of the San Jose Convention Center, and shown by invitation only, were Facebook’s and FLIR‘s brand new cameras. The x24 and x6 were both on display in the Facebook Surround 360 demo chamber. After being ushered past a series of security guards I emerged in a room divided by a few temporary walls. In the center were the two cameras in all their spherical glory.
Representatives from the Facebook Surround 360 team brought me into the first phase of what would become a marathon of demos. Step one was to see what the x24 can produce inside an Oculus Rift.
Inside the Rift I saw what appeared to be a standard, but very high resolution 360-degree video. I was standing inside on the balcony of a massive room housing what appeared to be a lush indoor rainforest. From what I could hear a river was flowing somewhere and leafy trees swayed playfully in the breeze. I was impressed by the high image quality and then my handler informed me he would be turning on the true magic of the Facebook Surround experience: true freedom to move around.
With the push of a button my world exploded outward. Suddenly the palm tree I had been admiring was inches from my face rather than part of a two dimensional wall of color. I could suddenly tell just how high up I was as the ground fell away. All around me reality had gone from a flat plane to a vibrant swath of depth and color. In all of this, the image clarity remained incredibly high resolution. The only glitch was a stitching bug that placed a sort of blur effect on certain edges.
Here’s where things get really cool. Just as I was getting used to my surroundings I was instructed to take a step. As I did so the world stayed exactly where it should while I started to move. For the first time in my life I was walking through a 360-degree video and I couldn’t help but smile. Honestly, if it wasn’t for the occasional blur or glitch, I would have believed I was truly standing in this indoor arboretum.
From here I was shown an additional scene featuring a group of tourists ogling a tropical aquarium as an instructor explains the fish. Again, I was shown a comparison between a traditional, flat 360-degree video, and Facebook’ new walkable, 3D experiment. The difference is remarkable. It’s all of the presence-inducing factors that make a CG experience built in Unity believable, but with high-res video instead of assets from the Unity store.
This isn’t to say that Unity is getting left behind. The next stop on my demo tour was with OTOY, one of the Facebook Surround team’s early partners. OTOY showed me a simple park scene captured by the x24. Once again, the fidelity was incredible and the three dimensional improvements are outstanding. However, the real kicker is that OTOY was rendering all of these photorealistic images with Unity in real-time. This meant that I was able to alter what I was seeing with basic Unity lighting tools.
With a push of a button on the Oculus Touch controller I turned off the sun and started experimenting with new light sources and angles as I manipulated a white globe around my environment.
In this moment I was able to apply video game level editing features to a video of the real world.
Here’s OTOY CEO Jules Urbach showing the concept:
[gfycat data_id=”FlippantEnlightenedDartfrog”]
If this were applied to actual game design, then we might one day see vast open worlds created using actual captures of reality rather than computer generated equivalents.
Anshel Sag, an analyst with Moor Insights & Strategy also tried these demos today. He also notably got his hands on HypeVR’s tech as well, which has a very similar volumetric video demonstration. Sag says of Facebook’s current offering:
The Facebook volumetric video solution is clearly in its infancy but with their partnership with OTOY they expand the usefulness of the volumetric video and images in ways that we have yet to comprehend. In terms of visual quality and 6-DoF the Facebook 6-DoF solution still has a ways to go to be where other 6-DoF video solutions like HypeVR are today. Admittedly, the HypeVR rig is quite large and expensive, but today it produces a superior 360 6-DoF video experience. Because Facebook has only been at this for 10 months, I suspect there’s still lots of improvement coming and they can eventually reach what HypeVR has today.
It will be interesting to see how Facebook brings these cameras to market because the 24 camera rig is built by FLIR and the 6 camera rig is fully internally made by Facebook. The choice not to open source these cameras also means that Facebook intends to license out their design to prospective camera companies that want to offer Facebook’s technology. I believe we will start to see content from there cameras around Q4 this year or Q1 next year as they took chains for the cameras become available.”
The realities of marketing, distributing and creating this kind of content still remain to be seen. But as it stands now Facebook Surround 360 looks like it could be the most effective camera platform we have seen yet, and a huge step toward improving the overall fidelity of this rapidly emerging industry.
