1984

This GitHub repo serves as a starting point for people interested in visionOS 2's new object tracking capabilities. Pairing ARKit's hand tracking + object tracking opens up fun & interesting interaction possibilities based on hand proximity.

Object Tracking Demo uses:

• visionOS 2
• ARKit
• Hand Tracking
• Object Tracking
• RealityKit
• Reality Composer Pro
• GitHub

Project Type: Open-source

Get the Code Watch the Demo

This 1984 research project syncs a map of Middle Earth to the Lord of the Rings Extended Edition movies. Once the Vision Pro recognizes the paper map, an augmented reality version of the map tracks the location of each character of The Fellowship as the story unfolds.

This demo uses:

• A Paper Map Made by the Brilliant: Myths and Maps
• ARKit
• RealityKit
• Reality Composer Pro
• Image Tracking
• ParticleEmitterComponent
• External DVD Drive

Project Type: 1984 internal research

Get the Paper Map Watch the Demo

Twin is a visionOS and iOS app that uses photogrammetry to create custom 3D models of your stuff for use in Vision Pro's spatial computing world. Twin's Shader Graph Materials enable you to remix & filter the textures of your stuff in real-time, creating brand new colorways and new versions of your things that are impossible in the real world.

Twin uses:

• RealityKit
• SwiftData
• Reality Composer Pro
• Object Capture
• Shader Graph Materials
• RevenueCat
• RealityView

Project Type: 1984 product

Download Watch the Demo

Minimap Level 2 uses two iPhones to display a real-time spatial map. This second level of the prototype understands the structure of a room, segments a human from video frames, and updates the 3D position of that frame in real-time.

Minimap Level 2 uses:

• RoomPlan
• SwiftData
• RealityKit Postprocessing
• ARKit
• VideoToolbox
• TextureResource DrawableQueue

Project Type: 1984 internal research

Watch the Demo

Primer helps you visualize your home with new wallpaper, tiling, and paint. Primer utilizes Core Animation to display intuitive, animated, augmented reality tooltips to visually onboard users.

Primer uses:

• ARKit 3
• Core Animation
• Person Segmentation with Depth

Project Type: Client work for Primer

Acquired by Shopify

1984 developed innovative AR interactions and controls for iScape's collaborative landscaping app. iScape utilizes shared world maps, persistent worlds, 3D models, and the novel ability to create custom geometry for visualizing AR textures in the user's world.
My work on iScape was featured by HBO, Axios, and Apple at both WWDC 2019 & in the App Store.

iScape uses:

• ARKit 2
• SceneKit
• AR World Maps
• Collaborative, Multi-User Sessions

Project Type: Client work for iScape

Watch the Demo Download