Skip to content
JT5D edited this page Nov 11, 2023 · 12 revisions

Adventures in AR VR XR AI code & research - VisionOS, iOS, ARfoundation, Oculus, ChatGPT, OpenCV, ML

Our interest lies at the intersection of virtual & real, mind & matter, imagination & manifestation and the New possibilities for collaborative creativity, education & problem solving Radical new forms of storytelling & data visualization Magic & play made possible by AR, VR, XR & AI

a438ce65-b962-4ac6-aaf7-2d66373e2039-1

Spatial computing is THE next major paradigm shift

Moving from tiny screens to VR to AR to R(eality) 
Broadening horizons & augmenting life and 
Transforming us & the universe forever.

282232367-6ec3583f-4422-40a3-b105-a16013c8b985

Apple Vision Pro Headset

Apple Vision Pro Headset
Apple Vision Pro is a groundbreaking AR headset.
Watch Overview Video

Pricing and Availability: Starting at $3,499, available early next year in the U.S.
More details

Get Started

https://developer.apple.com/visionos/developer-kit/

Overview visionOS is the operating system that powers Apple Vision Pro. Use visionOS together with familiar tools and technologies to build immersive apps and games for spatial computing.

Three scenes from visionOS apps that show the Music app, a close-up of the tools associated with a window, and a photo browser.

Developing for visionOS requires a Mac with Apple silicon. Create new apps using SwiftUI to take full advantage of the spectrum of immersion available in visionOS. If you have an existing iPad or iPhone app, add the visionOS destination to your app’s target to gain access to the standard system appearance, and add platform-specific features to create a compelling experience. To provide continuous access to your content in the meantime, deliver a compatible version of your app that runs in visionOS.

Expand your app into immersive spaces Start with a familiar window-based experience to introduce people to your content. From there, add SwiftUI scene types specific to visionOS, such as volumes and spaces. These scene types let you incorporate depth, 3D objects, and immersive experiences.

Build your app’s 3D content with RealityKit and Reality Composer Pro, and display it with a RealityView. In an immersive experience, use ARKit to integrate your content with the person’s surroundings.

An illustration that shows a person wearing Apple Vision Pro and looking at three windows and a volume in the space in front of them.

People can select an element by looking at it and tapping their fingers together. They can also pinch, drag, zoom, and rotate objects using specific hand gestures. SwiftUI provides built-in support for these standard gestures, so rely on them for most of your app’s input. When you want to go beyond the standard gestures, use ARKit to create custom gestures. Screenshot 2023-11-11 at 4 52 07 AM

Dive into featured sample apps Explore the core concepts for all visionOS apps with Hello World. Understand how to detect custom gestures using ARKit with Happy Beam. Discover streaming 2D and stereoscopic media with Destination Video. And learn how to build 3D scenes with RealityKit and Reality Composer Pro with Diorama and Swift Splash.

Hello World Use windows, volumes, and immersive spaces to teach people about the Earth. Hello-World-intro@2x

Destination Video Leverage 3D video and Spatial Audio to deliver an immersive experience. Destination-Video-intro@2x

Happy Beam Leverage a Full Space to create a fun game using ARKit. Happy-Beam-intro@2x

Diorama Design scenes for your visionOS app using Reality Composer Pro. Diorama-intro@2x

Swift Splash Use RealityKit to create an interactive ride in visionOS. Swift-Splash-intro@2x

VisionOS

VisionOS Interface
The operating system for Apple Vision Pro. Use visionOS with familiar tools to build immersive apps and games.

Features

  • Windows: Create with SwiftUI, add 3D content.
  • Volumes: Use RealityKit or Unity for 3D experiences.
  • Spaces: Shared Space for side-by-side apps, Full Space for immersive experiences.

Developing for visionOS: Requires a Mac with Apple silicon.
Get started with visionOS

Principles of spatial design

Discover the fundamentals of spatial design. Learn how to design with depth, scale, windows, and immersion, and apply best practices for creating comfortable, human-centered experiences that transform reality. Find out how you can use these spatial design principles to extend your existing app or bring a new idea to life.

skinned-mesh-sampling-example banner001

Demo 68747470733a2f2f692e696d6775722e636f6d2f546b31496c4f622e676966

1_wv65L5KTi2kKjItLat-JvA

https://github.com/imclab/Vision-PRO-AR-VR-XR-AI/assets/391299/cd42ae1d-d4c4-432f-ab17-a6405a279280 shared-spaces~dark@2x

ntugrid_neg

1_EFbxxoPRymjGCYUshrrvcQ 1_iiLBjfJiyR2pTv8AWCUx9A

overview@2x

### Video Tutorials

hqdefault(38) hqdefault(37) hqdefault(36) hqdefault(35) hqdefault(33) hqdefault(32) hqdefault(31) hqdefault(30) hqdefault(29) hqdefault(28) hqdefault(27) hqdefault(26) hqdefault(25) hqdefault(24) hqdefault(23) hqdefault(22) hqdefault(21) hqdefault(20) hqdefault(19) hqdefault(18) hqdefault(17) hqdefault(16) hqdefault(15) hqdefault(14)

Clone this wiki locally