‘Oasis’ Reconstructs Your Physical Room Into A VR Paradise Using Google Tango

by David Matthews • January 10th, 2017

Tired of your cramped apartment, its moldering walls, battered furniture, and the fact that it isn’t on a pirate island or in outer space?

Well, researchers have now managed to use Google’s Tango platform to create a simple app that allows you to scan your home and then walk through it in VR. The interior of a normal building is transformed into a world complete with frolicking deer, for example, as the video below shows.

They say this is a new step for Google’s room-scanning Tango system, which so far has been used to create an augmented reality overlay on a phone screen, but not a full VR experience like this.

Misha Sra, a PhD candidate at MIT’s Media Lab and one of the developers of the project, says she wants to “democratize” VR, so that anyone can pick up a phone and create a virtual environment.

“Let’s say you want to ask your Grandma to build VR for her living room, or house. All she would need to do is pick up a Google Tango-powered phone tablet, turn on the app and walk around her house,” she explains. Your VR house is then viewable on the very same phone through a headset.

So far, the software can turn an interior into four different environments: a lush wood; a rocky island surrounded by shipwreck debris; a volcanic lava flow; and a platform floating in space. The system works by detecting walls and replacing them with barriers in VR so you don’t walk in to them, depending on the environment being mimicked – so a fence in the wood, or lava in the volcano.

space

You might also worry about tripping over your coffee table, but Sra says the software has that covered.  Although the rooms shown in the demo video are clear of stumbling blocks, Sra explains that furniture can be visualized as things like rocks or ponds so users steer clear.

The system, called Oasis – named after the virtual world in the book Ready Player One, which Sra was reading while working on the project – also automatically detects chairs and represents them virtually so you can sit down as you luxuriate in your virtual home. Objects in your house are tracked in real time, so that if you move the chair it will follow you in VR.

The advantage of this kind of scanning system is that “the virtual world conforms to your space,” Sra says. “You don’t have to clear out your living room, move furniture out, and clear an open space like you do for the Vive [or other room-scale VR setups.]”

It’s the same idea as was on display at the recent CES conference from Intel’s Project Alloy, a headset that claims to be able to scan your room and replicate it in VR – meaning you can duck behind your real furniture while gaming. Oasis could be used to make your home more appealing, Sra thinks. “Let’s say it’s the middle of winter in Boston,” she says, and going outside is not the most appealing idea. “You say OK, I want to be at the beach – and so you’re at the beach.” Friends in VR are then able to come and hang out and tell stories in your spruced-up living room.

lava

Sadly, Sra’s project is an early stage research demo, and not close to being a finished, available product. But next, she and her fellow researchers want to give users the ability to customize their VR house, selecting an environment to their taste.

There is no limit to the kind of virtual homes we could walk around, she says. “I could create a Paris theme…or Lord of the Rings,” she imagines. “I think it could be a pretty interesting creativity tool.”

Tagged with: , , , , ,

What's your reaction?
Like
Wow
0%
LOL
0%
Dislike
0%
  • Robbie Cartwright

    If this gets refined enough to the point where it can be used in actual games, I can’t wait for someone to use this system to create multiplayer levels in an MMO shooter game. It’d be so awesome to invite friends over and give them a copy of your map and you both can instantly enter a mixed reality scifi-shootout! XD

    • As both users would have different room layouts, I guess interaction could be team based. Ie, the game floor has a red overlay for one players space and a green overlay for the other player. Generated puzzle levels could be built so that both users can solve a game by interacting with objects (levers/buttons or whatever) in their own overlay area which would force teamwork. Where the overlays overlap, other puzzles could be made as both players have access to those parts. Could be a lot of fun!!

      • Robbie Cartwright

        Oh yeah! Or in shooter type games you would simply either have the players play in the same area so the maps were the same, or for online experiences then the player with the smallest play area would be the one to designate the play area for everyone else/everyone has their own play areas merged on top of one another. Lots of cool things!

  • Hololens can do something similar, too. Anyway, intresting project

    • MdM

      Looking forward to the day when I can look out of the windows of my house through an AR device and see the beach, or the mountains, or outer space.

      • user

        im sure it will be possible soon-ish

      • The day that this will happen, no one will ever look again at the real landscape out of his window anymore!! 😀 😀 😀

  • user

    what happens when the chair (in the video) moves?