Metaverse

Virtual Reality

This is a much more difficult problem that I originally thought it to be, a lot of these problems that arise in designing in VR headsets are also in Robotics.

Also in aerospace, when they try to figure out the orientation of the plane.

Such as

• Transformations
• How to account for errors when tracking your head

Some Headsets

• https://varjo.com/testimonial/xr-test-drive-with-volvo/

Notes from XR Workshop with Kathleen

I attended this workshop with XR and MR. Merged reality is when the real world and the Augmented reality interact with each other.

XR is going to be the umbrella term for AR, VR and MR.

• Source: https://varjo.com/testimonial/xr-test-drive-with-volvo/

Some Tools:

• Spark AR (really for beginners) by Facebook
• Lens Studio (coding in Javascript)
• Unity is the industry standard
  • Unity actually supports ARKit so that is insane. However, I think I should still use Swift because it’s more native
• AFrame (powered by 3.js), use for Web Development
• WebXR can run both in browser and headset
• ARKit (YESSS), I love Swift →

Links recommended by Kathleen:

• https://www.media.mit.edu/
• https://engineering.nyu.edu/research-innovation/centers/nyc-media-lab → this is where Kathleen did her masters
• https://ar.snap.com/ghost → Snapchat fellowship
• Verizon AR Fellowship
• MIT Reality Lab Hackathon → Highly recommended by Kathleen
• Meta Hackathon → Seems to be cancelled?

What is the common approach is compiling to Flutter, and then have both run.

AR Headsets:

• https://www.microsoft.com/en-us/hololens
• https://www.magicleap.com/
• https://www.nreal.ai/

North Focals Glasses

VR Headsets:

• Oculus

Apply for Fellowships, developer pilots where they will grant you access.