Autonomous Tracking For Volumetric Video Sequences

As a rapidly growing medium, volumetric video is gaining attention beyond academia, reaching industry and creative communities alike. This brings new challenges to reduce the barrier to entry from a technical and economical point of view. We present a system for robustly and autonomously performing...

Full description

Saved in:
Bibliographic Details
Published in:2021 IEEE Winter Conference on Applications of Computer Vision (WACV) pp. 1659 - 1668
Main Authors: Moynihan, Matthew, Ruano, Susana, Pages, Rafael, Smolic, Aljosa
Format: Conference Proceeding
Language:English
Published: IEEE 01-01-2021
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:As a rapidly growing medium, volumetric video is gaining attention beyond academia, reaching industry and creative communities alike. This brings new challenges to reduce the barrier to entry from a technical and economical point of view. We present a system for robustly and autonomously performing temporally coherent tracking for volumetric sequences, specifically targeting those from sparse setups or with noisy output. Our system will detect and recover missing pertinent geometry across highly incoherent sequences as well as provide users the option of propagating drastic topology edits. In this way, affordable multi-view setups can leverage temporal consistency to reduce processing and compression overheads while also generating more aesthetically pleasing volumetric sequences.
ISSN:2642-9381
DOI:10.1109/WACV48630.2021.00170