Transport and Rendering Challenges of Multi-Stream, 3D Tele-Immersion Data

For over four years, our colleagues at the University of Pennsylvania1and we have been developing an experimen- tal 3D tele-immersion testbed with the goal of provid- ing high-fidelity scene reconstruction coupled with life- size, view-dependent stereo display. The UPenn team has focused on stereo reconstruction algorithms, while UNC has worked on system architecture, network transport, and stereo rendering and display issues. This paper provides an overview of our testbed architecture and details the trans- port and rendering challenges and solutions we have ex- plored.