It is well understood that high tracking rates are critical for AR/VR systems for immersive experiences, yet there currently exists no practical, portable system that comes close to next-generation tracking performance. This UNC innovation utilizes rolling shutter and radial distortion – two image features typically treated as camera artifacts to be corrrected – and leverages them to estimate a pose configuration, which can determine what portion of the real world the viewer sees at a given instant. This ability is valuable in applications across augmented and virtual reality. Additionally, this system can attain high tracking rates that were previously unachievable.
- Rolling Shutter and Radial Distortion are Features for High Frame Rate Multi-camera Tracking Bapat, Akash, True Price, and Jan-Michael Frahm. “Rolling Shutter and Radial Distortion are Features for High Frame Rate Multi-camera Tracking.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018.