Magic Leap, yet another disruptive technology

[Mallette]

Gizmodo has the most accessible write up on this emerging technology.  If you've paid attention to Oculus Rift, Google Glass, or Microsoft Hololens you will know the basic technology is already in place.  What they appear to be doing is melding it all in a single device.  Right now, it's really large but they claim they may shrink it to eyeglass size eventually. 

 

In a nutshell, this device has all the abilities of the others.  It's connected, like Google Glass, in can go opaque and put you in a completely VR environment...or anything in between.  As a training professional the applications that come to mind are transformative and could take OJT from being the most expensive, dangerous, inconsistent and inefficient means of training and make it by far the closest thing to direct dump of data to the brain.  Same for education...and many more areas.  Virtual internet shopping where you can see and experience the goods as if in a store, incredible porn, and entirely new concepts not possible any other way.

 

And danger.  The addictive potential makes Minecraft a minor vice.  Upside: You'll know where your kids are.  Downside:  You will be mistaken. 

 

Speaking of Minecraft, Microsoft will release a new version that allows virtual players to directly interact with each other in an augmented reality where one can (and I mean literally, not VR wise) pick up a virtual object in one's hands and interact with it. 

 

I'm looking forward to attending the Ring cycle at the Berlin Opera.  Naked. 

 

Dave

[ChuckAb3]

That is amazing, Dave. I'm not a tech guy so I don't get all of the background technology which goes into this, but I think I understand enough to see that the implications are huge.

 

BTW, please do NOT post 'selfies' from the Berlin Opera!!

[K5SS]

I have been put in charge with launching 3D scanning at my real estate firm. The technology is pretty crazy:

https://my.matterport.com/show/?m=3F9p8TPY7yH

I am sure these two technologies are on a collision course.

Oh, let me know if you would like your home or business scanned in WA;)

[Mallette]

If not for the brains, the proven technology, the track records of the main brains involved, and the attention of the big boys I'd be skeptical.

 

I'm not.  I'll have a developers kit as soon as it's released for my company and will purchase one as some as they market it for myself. 

 

Fun stuff with a lot of implications for business and society.

 

It will sure beat surfing with a phone on a long flight!  Further, it will make a lot of long flights completely unnecessary.  Skype meetings are boring.  At least with this one I can send conjure up a snake to crawl down the cleavage of the ***** who's bogarting the discussion.

 

Dave

Edited February 14, 2015 by Mallette

[eth2]

Speaking of Minecraft, Microsoft will release a new version that allows virtual players to directly interact with each other in an augmented reality where one can (and I mean literally, not VR wise) pick up a virtual object in one's hands and interact with it. I'm looking forward to attending the Ring cycle at the Berlin Opera. Naked.

 

Bring tweezers to pick up the "virtual object" at the Berlin Opera. 

[Mallette]

Bring tweezers to pick up the "virtual object" at the Berlin Opera.

 

Spending too much time with Michael, we are.

 

Dave

[mustang guy]

That's an awesome idea. Real time photoshop overlay. Actually it would also be underlaying. hmmmm... that seems like a tough nut to crack.

 

It could be the future of the survival of marriages.

Edited February 14, 2015 by mustang guy

[Mallette]

Think I will stick with going to the Berlin Opera naked, thank you very much.

 

Dave

I am sure these two technologies are on a collision course.

 

Not really collision, but I was talking about your post with the PAW and commented that being able to VR tour real estate is, indeed, a game changer.  Point at the fridge, and the system can tell you the model, age, original price, and customer satisfaction records, etc.

 

Only one thing.  Really, much more.

 

I am now seeing technologies obsolete before they are introduced.  That is WEIRD.  Google glass is a good example.

 

Dave

[JeffKang]

I noticed this thread in my weekly scouring of Magic Leap news.
If you are interested in a prediction from a patent reader:
Some information from the Oculus Rift subreddit from /u/FredzL:

> *Disclaimer* : pure speculation based on published patents and reviews.
>
> I think Magic Leap is :
>
> * 40°x40° FOV
> * 8 Mpx/4K (scanning fiber display with piezoelectric actuator)
> * 60 Hz
> * blocking light from the physical world (occlusion mask with LCD(s))
> * nearly correct accommodative depth cues (zone plate diffraction patterning device => 12 levels of depth from 0.5 m to 3 m)
> * low-persistence (720 Hz high-frequency binary display => 1.38 ms illumination per depth layer)
> * glasses form-factor (waveguide with embedded diffraction grating => end goal, not done yet)
> * release in 2016-2017
>
> I think Microsoft HoloLens is :
>
> * ~40°x22° FOV at most (from the reports : tiny FOV, rectangular)
> * 4 Mpx/2.5K (OLED) or 8 Mpx/4K (LCoS) but color sequential
> * 60 Hz
> * not blocking light from the physical world (additive blending)
> * no accommodative depth cues
> * full persistence
> * large and heavy glasses form-factor
> * release in 2015

reddit/com/r/oculus/comments/2t74sf/microsoft_announces_windows_holographic_ar/cnwsyny

A later update:

>Release dates were just shots in the dark based on the state of what has been shown (nothing for Magic Leap, what looks like a consumer design for Microsoft).
>The others are based on the patents I've read at that time and some known limits (no 4K OLED microdisplays).
>I since discovered other Microsoft patents about masking pixels and variable focus (not really accommodative depth cues but can limit the vergence-accommodation conflict).
>From the reviews it's not clear if that's already been implemented and if not, there is no way to known if it will in the future.

reddit/com/r/oculus/comments/2tiyos/fov_for_the_synthetic_bits_is_not_as_important_in/cnzxw3e
vrwiki.wikispaces/com/Magic+Leap
vrwiki.wikispaces/com/Microsoft+HoloLens

 

@@Mallette,

 

> I am now seeing technologies obsolete before they are introduced.

 

Check out Wired’s article on  the UI:

>Magic Leap UI: Totems: cameras on headset could track any piece of material that’s been defined as “mouse.”
>Shows keyboard made from soft rubber that would deform and provide haptic feedback while HMD overlaid images.
>AR system may render virtual computer keyboard on surface of rectangular aluminum

wired/com/2015/01/magic-leaps-vision-for-virtual-reality/

It's like the Optimus Maximum keyboard of 2008, where every keyboard key has an OLED display so that you can remap any key to do whatever you want.
It's like that, except it doesn't cost $2000.
 

>I'll have a developers kit as soon as it's released for my company

 

Same.
I don't care if the first iteration isn't mobile, or the real-time depth sensing is restricted to indoors.
I bought a Spider Monkey flexible tablet mount for $100.
I was thinking of getting a second monitor.
I don't have s 2k monitor, yet some new technology might provide me with a way to have an infinite number of 4k resolution screens floating around.

I'm part of the disability community, and we can spend a lot money on assistive technology.
Magic Leap might be able to provide solutions for multiple cases for a fraction of the price.

Some additional info:
 
> Only Oculus has given any information about motion-to-photon latency (< 20 ms), none else is able to compete with them on this for now.
> Also choosing the best one is a matter of compromise.
> Some people favor pixels per degree over FOV.
> Price and performance requirements are also very dependent on the targeted user.
> Low-persistence and wired/wireless is also a good criterion.
>
> What would be best for you ? :
>
> * a $350 100° 10 PPD (DK2)
> * a $300 110° 13 PPD (CV1?)
> * a $450 210° 8.5 PPD (InfinitEye)
> * a $500 40° 50 PPD (Magic Leap?)
> * a $800 210° 13 PPD (InfinitEye with 1080p panels)
> * a $2500 170° 11 PPD (Claire)
 
reddit/com/r/oculus/comments/2syjrx/introducing_claire_12m_170_fov_hmd_by_riftup/cnua65t
 
---
>
> Yes it's a supposition, but the technology described looks quite close to what would be required to back the Magic Leap claims (3D CG elephant appearing to exist in the real world).
>
> Requirements would be :
>
> * suitable FOV for AR
> * suitable resolution for 20/20 visual acuity
> * accommodative response to provide absolute distance information and avoid the vergence-accommodation conflict
> * blocking of light from the real world when a pixel of the object should be visible
> * transparency of pixels for which the real world should be visible
>
> The patents state these requirements to best match the capabilities of the average human visual system :
>
> * 50 pixels/° for 20/20 visual acuity (should be 60 pixels/° but close enough)
> * minimum FOV of 40°x40°, requiring 8 Mpx for 20/20 vision (looks like the best candidate)
> * desired FOV of 120°x80°, requiring 50 Mpx for 20/20 vision
>
> And their patents make these claims :
>
> * **projection device** : scanning fiber display with piezoelectric actuator with a 3840×2048 resolution (8 Mpx) at 60 Hz
> * **occlusion mask** : blocks light in specific pixels with liquid crystal display(s) operating at 60 Hz coupled with the projection device
> * **zone plate diffraction patterning device** : 12 layers (focal planes) of depth from 0.25 to 3 m operating at 720 Hz for 60 Hz viewing
> * **waveguide with embedded diffraction grating** : redirects collimated light towards the eye through the diffraction pattern while allowing transparency
>
reddit/com/r/oculus/comments/2stl1h/the_verge_posted_a_ton_of_magic_leap_patent/cntcrxd
 
---
 
> [Why You Won’t See Hard AR Anytime Soon]( blogs.valvesoftware/com/abrash/why-you-wont-see-hard-ar-anytime-soon/) :
>
> *"I’d be surprised if it was sooner than five years, and it could easily be more than ten before it makes it into consumer products."*

> So 5-10+ years actually, but that's for hard AR, and he said that 2.5 years ago.
> Soft AR (additive blending and area darkening with trailing edges) is already there.
> At this point it's not clear if HoloLens is hard or soft AR, maybe a mix of the two (still additive blending, but superposed on a 3D model of the world, so shadows and other effects would be possible).
> From their patents, Magic Leap seems to be hard AR (can mask zones of the physical world).
 
reddit/com/r/oculus/comments/2t74sf/microsoft_announces_windows_holographic_ar/cnwn0jz
 

Edited February 15, 2015 by JeffKang

[OO1]

That's an awesome idea. Real time photoshop overlay. Actually it would also be underlaying. hmmmm... that seems like a tough nut to crack.

 

It could be the future of the survival of marriages.

nice plastic surgery

[Mallette]

I noticed this thread in my weekly scouring of Magic Leap news.

 

Fascinating information.  I am not remotely up with individual emerging technology...but I have at least a better than average sense of the overall direction.

 

Good you noted my point about obsolescence before introduction.  It's critical to understanding the speed of change.

 

 

Dave

[Mallette]

Finally had time to take a look, K5SS.  You are on the cutting edge...make sure you stay there as it is becoming a moving target at ever increasing speed.  That is transformative technology you are working in. 

 

Dave

Edited February 16, 2015 by Mallette