Skip to content
JT5D edited this page Nov 11, 2023 · 12 revisions

Adventures in AR VR XR AI code & research - VisionOS, iOS, ARfoundation, Oculus, ChatGPT, OpenCV, ML

Our interest lies at the intersection of virtual & real, mind & matter, imagination & manifestation and the New possibilities for collaborative creativity, education & problem solving Radical new forms of storytelling & data visualization Magic & play made possible by AR, VR, XR & AI

a438ce65-b962-4ac6-aaf7-2d66373e2039-1

Spatial computing is THE next major paradigm shift

Moving from tiny screens to VR to AR to R(eality) 
Broadening horizons & augmenting life and 
Transforming us & the universe forever.

282232367-6ec3583f-4422-40a3-b105-a16013c8b985

Apple Vision Pro Headset

Apple Vision Pro Headset
Apple Vision Pro is a groundbreaking AR headset.
Watch Overview Video

Pricing and Availability: Starting at $3,499, available early next year in the U.S.
More details

Get Started

Apple Vision Pro developer kit

https://developer.apple.com/visionos/developer-kit/Apple Vision Pro developer kit Have an innovative idea for an app or game for visionOS that requires building and testing on Apple Vision Pro? Apply for an Apple Vision Pro developer kit. This kit will help you deliver amazing spatial experiences by letting you quickly build, iterate, and test on Vision Pro.

Apply for Unity Polyspatial Beta https://create.unity.com/spatial UNITY’S BETA PROGRAM FOR CREATING SPATIAL EXPERIENCES Get started with spatial creation Be the first to create for Apple’s visionOS platform Unity is excited to collaborate with Apple to bring familiar and powerful authoring tools for creating immersive games and apps for this new spatial computing platform, Apple Vision Pro. Your apps will get access to benefits such as pass-through and Dynamic Foveated Rendering, in addition to popular Unity features like AR Foundation and XR Interaction Toolkit.

Overview visionOS is the operating system that powers Apple Vision Pro. Use visionOS together with familiar tools and technologies to build immersive apps and games for spatial computing.

Three scenes from visionOS apps that show the Music app, a close-up of the tools associated with a window, and a photo browser.

Developing for visionOS requires a Mac with Apple silicon. Create new apps using SwiftUI to take full advantage of the spectrum of immersion available in visionOS. If you have an existing iPad or iPhone app, add the visionOS destination to your app’s target to gain access to the standard system appearance, and add platform-specific features to create a compelling experience. To provide continuous access to your content in the meantime, deliver a compatible version of your app that runs in visionOS.

Expand your app into immersive spaces Start with a familiar window-based experience to introduce people to your content. From there, add SwiftUI scene types specific to visionOS, such as volumes and spaces. These scene types let you incorporate depth, 3D objects, and immersive experiences.

Build your app’s 3D content with RealityKit and Reality Composer Pro, and display it with a RealityView. In an immersive experience, use ARKit to integrate your content with the person’s surroundings.

An illustration that shows a person wearing Apple Vision Pro and looking at three windows and a volume in the space in front of them.

People can select an element by looking at it and tapping their fingers together. They can also pinch, drag, zoom, and rotate objects using specific hand gestures. SwiftUI provides built-in support for these standard gestures, so rely on them for most of your app’s input. When you want to go beyond the standard gestures, use ARKit to create custom gestures. Screenshot 2023-11-11 at 4 52 07 AM

Dive into featured sample apps Explore the core concepts for all visionOS apps with Hello World. Understand how to detect custom gestures using ARKit with Happy Beam. Discover streaming 2D and stereoscopic media with Destination Video. And learn how to build 3D scenes with RealityKit and Reality Composer Pro with Diorama and Swift Splash.

Hello World Use windows, volumes, and immersive spaces to teach people about the Earth. Hello-World-intro@2x

Destination Video Leverage 3D video and Spatial Audio to deliver an immersive experience. Destination-Video-intro@2x

Happy Beam Leverage a Full Space to create a fun game using ARKit. Happy-Beam-intro@2x

Diorama Design scenes for your visionOS app using Reality Composer Pro. Diorama-intro@2x

Swift Splash Use RealityKit to create an interactive ride in visionOS. Swift-Splash-intro@2x

VisionOS

VisionOS Interface
The operating system for Apple Vision Pro. Use visionOS with familiar tools to build immersive apps and games.

Features

  • Windows: Create with SwiftUI, add 3D content.
  • Volumes: Use RealityKit or Unity for 3D experiences.
  • Spaces: Shared Space for side-by-side apps, Full Space for immersive experiences.

Developing for visionOS: Requires a Mac with Apple silicon.
Get started with visionOS

Create immersive Unity apps

Explore how you can use Unity to create engaging and immersive experiences for visionOS. We'll share how Unity integrates seamlessly with Apple frameworks, take you through the tools you can use to build natively for the platform, and show you how volume cameras can bring your existing scenes into visionOS windows, volumes, and spaces. Discover how to incorporate visionOS features like passthrough and scene understanding, customize your visuals with Shader Graph, and adapt your interactions to work with spatial input. https://developer.apple.com/videos/play/wwdc2023/10088

Principles of spatial design

Discover the fundamentals of spatial design. Learn how to design with depth, scale, windows, and immersion, and apply best practices for creating comfortable, human-centered experiences that transform reality. Find out how you can use these spatial design principles to extend your existing app or bring a new idea to life.

skinned-mesh-sampling-example banner001

Demo 68747470733a2f2f692e696d6775722e636f6d2f546b31496c4f622e676966

1_wv65L5KTi2kKjItLat-JvA

https://github.com/imclab/Vision-PRO-AR-VR-XR-AI/assets/391299/cd42ae1d-d4c4-432f-ab17-a6405a279280 shared-spaces~dark@2x

ntugrid_neg

1_EFbxxoPRymjGCYUshrrvcQ 1_iiLBjfJiyR2pTv8AWCUx9A

overview@2x

### Video Tutorials

hqdefault(38) hqdefault(37) hqdefault(36) hqdefault(35) hqdefault(33) hqdefault(32) hqdefault(31) hqdefault(30) hqdefault(29) hqdefault(28) hqdefault(27) hqdefault(26) hqdefault(25) hqdefault(24) hqdefault(23) hqdefault(22) hqdefault(21) hqdefault(20) hqdefault(19) hqdefault(18) hqdefault(17) hqdefault(16) hqdefault(15) hqdefault(14)

Clone this wiki locally