SIGGRAPH 2012
 
Videoscapes: Exploring Sparse, Unstructured Video Collections
     
  James Tompkin 1 Kwang In Kim 2 Jan Kautz 1 Christian Theobalt 2
  University College London 1 MPI für Informatik 2
 




  Abstract
 
The abundance of mobile devices and digital cameras with video capture makes it easy to obtain large collections of video clips that contain the same location, environment, or event. However, such an unstructured collection is difficult to comprehend and explore. We propose a system that analyzes collections of unstructured but related video data to create a Videoscape: a data structure that enables interactive exploration of video collections by visually navigating – spatially and/or temporally – between different clips. We automatically identify transition opportunities, or portals. From these portals, we construct the Videoscape, a graph whose edges are video clips and whose nodes are portals between clips. Now structured, the videos can be interactively explored by walking the graph or by geographic map. Given this system, we gauge preference for different video transition styles in a user study, and generate heuristics that automatically choose an appropriate transition style. We evaluate our system using three further user studies, which allows us to conclude that Videoscapes provides significant benefits over related methods. Our system leads to previously unseen ways of interactive spatio-temporal exploration of casually captured videos, and we demonstrate this on several video collections.



           
  Paper
PDF (17 MB)
  Supplemental Material
PDF (8 MB)
  Presentation
PPTX (345 MB)
 


 
  Synopsis Video
MP4 (178 MB) | YouTube


 
  Longer Video
MP4 (111 MB) | YouTube

Resources
  • London Video+GPS dataset
  • Universität des Saarlandes Bicycle Video+GPS dataset





 
@inproceedings{Tompkin:2012:SIGGRAPH,
author = {James Tompkin and Kwang In Kim and Jan Kautz and Christian Theobalt},
title = {Videoscapes: Exploring Sparse, Unstructured Video Collections},
booktitle = {ACM Transactions on Graphics (Proceedings of SIGGRAPH 2012)},
volume = {31},
number = {4},
month = {August},
year = {2012},
url = {http://doi.acm.org/10.1145/2185520.2185564/},
doi = {10.1145/2185520.2185564},
}


© ACM, 2012. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM Transactions on Graphics, Vol. 31, Issue 4, Aug. 2012, http://doi.acm.org/10.1145/2185520.2185564.

The definitive version may be downloaded at no cost through the ACM Author-izer service below:

ACM DL Author-ize serviceVideoscapes: exploring sparse, unstructured video collections
James Tompkin, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings, 2012