holoportation: virtual 3D teleportation in real-time (Microsoft Research)

Tons of AR demos try to show this feature. Tons of companies are working on it. Most believe it's a mass market feature. ▶ this video link link link But it's unlikely to work because each person's surroundings don't match every other persons. One's at a desk, One's at a cafe, One's in their bed, One's on their soft. They aren't each positioned in a way they can all appear in each others AR.

I really think that in the future people will use something like holoportation[0] to work at home or remotely across the world. Because like you say sometimes it makes sense to be present with a person to accomplish a task. It is very hard if they are trying to describe something when it would only take half a moment to visually look yourself and understand the direction the person is coming from. Holoportation looks very neat I really hope I get to try it one day. [0]: ▶ this video

This is a pretty clever way to avoid the uncanny valley for VR videoconferencing. I assume we're a long way from photorealistic avatars based on the holoportation demo from MS. ▶ this video

Depends what you mean. 3D/360-degree? It's sort of doable using cameras and software to stitch and interpolate all the different angles but you're still viewing from a fixed perspective. That works in the current crop of VR headsets. Same with 3D/180-degree (or similar wide angle but not 360 3D stuff). I've watched several on my Rift dev unit. Getting into "real" 3D, like being able to view from any angle is trickier but there are experimental and in-development methods of doing this. The easiest works for CG stuff (just look at your 3D content in your headset). The more realistic it gets, the closer to a "movie" in 3D. Combining video footage with CG environments is a nice little "cheat" that's already been played with as well. But the real challenge and (as I see it) the ultimate goal in this space is being able to use something like multiple light field cameras or RGB+depth cameras (think Kinect) arrayed around a room or environment and capturing both live video and the 3-dimensional structure of the surroundings and any objects or people. The depth data from the various angles needs to be combined and "textured" with the video data in order to create something approaching a real 3D recording of something over time (so maybe they'll need to advertise as 4D movies). Even cooler is when you can compress all of this data and stream it over networks to be decoded on the other end. The result will be like 3D telepresence where you're all but transported to another location. Mic

This is probably also the first time they showed "Holoportation"[1][2] to the public. [1] ▶ this video [2] link