passthrough-camera-api

Real-time 3D room reconstruction on Meta Quest 3. GPU TSDF + Surface Nets meshing, passthrough texturing, on-device texture refinement with Sobel normals, AI object detection (YOLO/Sentis + GPU NMS), MRUK scene understanding, Gaussian Splat training & rendering, multi-scan persistence with spatial anchors. Unity 6 URP package.

3D reconstruction from Meta Quest passthrough and depth via Reality Capture app, with Open3D/TSDF, COLMAP/Nerfstudio export, and Gaussian Splatting prep.

A Unity package that enables real-time computer vision operations on Meta Quest headsets using the Passthrough Camera API (PCA) with WebRTC streaming to external servers for AI inference.

The world's first passthrough API for Vision Pro

A Unity package to use the new Meta Quest Passthrough Camera API.

Demonstrates how to use Unity Inference Engine and YOLO11 to perform image segmentation using the Meta Quest Passthrough Camera

Record Passthrough camera frames from Meta Quest 3 devices and save as video (.mp4) on the device.

This project uses XR interaction and modern segmentation models to generate real-time “stickers” and object descriptions from controller-defined regions on the Meta Quest 3.