Spatial Computing Development Studio
I work with clients to build the spatial computing future
My work focuses on Swift, ARKit, RealityKit, and SwiftUI to build for visionOS, iOS, and macOS
Reach out to talk tech or hire me for AR dev, product, or strategy
Minimap is an ongoing internal research project exploring spatial mapping of
a location. This initial demo understands the structure of a room using RoomPlan
and paints object textures using ARKit & RealityKit.
- Metal Shaders
Project Type: 1984 internal researchWatch the Demo with Sound
Reality Synthesizer is an open-source, augmented reality app that visualizes
MIDI notes played on a paired synthesizer. The MIDI notes are interpreted by
Metal shaders to product augmented reality visualizations. Reality Synthesizer
utilizes LiDAR capabilities introduced in iOS 15.4.
Reality Synthesizer uses:
- Metal Shaders
- Linnstrument Helper
Project Type: Open-sourceGet the Code Watch the Demo with Sound
Rock Paper Checkmate is an augmented reality auto-chess game played
against a computer by playing Rock Paper Scissors. Rock Paper Checkmate includes
people occlusion with depth, a custom machine learning model, and recognizes hand
gestures shown to the camera so anyone can play augmented reality auto-chess.
Rock Paper Checkmate uses:
- ARKit 5
- RealityKit 2 and Reality Composer
- Create ML for Hand Pose Classification
- Vision Framework for Human Hand Pose Estimations
Project Type: 1984 productDownload
Primer helps you visualize your home with new
wallpaper, tiling, and paint. Primer utilizes Core Animation to display
intuitive, animated, augmented reality tooltips to visually onboard users.
- ARKit 3
- Core Animation
- Person Segmentation with Depth
Project Type: Client work for PrimerAcquired by Shopify
WebXR Viewer is an open-source, augmented reality, WebXR browser for iOS.
WebXR Viewer has a fine-grained AR permissioning system that puts privacy & ethical design first
and is built on Metal to render WebXR websites at 60 fps.
WebXR Viewer uses:
- ARKit 2
Project Type: Open-source client work for MozillaGet the Latest Code Download
1984 developed innovative AR interactions and controls for iScape's collaborative landscaping app.
iScape utilizes shared world maps, persistent worlds, 3D models, and the novel ability to create
custom geometry for visualizing AR textures in the user's world.
My work on iScape was featured by HBO, Axios, and Apple at both WWDC 2019 & in the App Store.
- ARKit 2
- AR World Maps
- Collaborative, Multi-User Sessions
Project Type: Client work for iScapeWatch a Demo Video Download
WritingI write about visionOS over here now – September 2023 and beyond
Limitations of RealityKit 1.0 – June 2020
Building with RealityKit – February 2020
Developing an Augmented Reality Browser – January 2020