Eurographics 2012
 
Interactive Multi-perspective Imagery from Photos and Videos
     
  Henrik Lieng1,2 James Tompkin1 Jan Kautz1
  University College London1 University of Cambridge2
 

  Abstract
 
Photographs usually show a scene from a single perspective. However, as commonly seen in art, scenes and objects can be visualized from multiple perspectives. Making such images manually is time consuming and tedious. We propose a novel system for designing multi-perspective images and videos. First, the images in the input sequence are aligned using structure from motion. This enables us to track feature points across the sequence. Second, the user chooses portal polygons in a target image into which different perspectives are to be embedded. The corresponding image regions from the other images are then copied into these portals. Due to the tracking feature and automatic warping, this approach is considerably faster than current tools. We explore a wide range of artistic applications using our system with image and video data, such as looking around corners and up and down stair cases, recursive multi-perspective imaging, cubism, and panoramas.


   
Paper
PDF (6 MB)
  Supplemental
PDF (1 MB)
  Presentation
PPTX (30 MB)


Showreel Video
MP4 (55 MB)
Tour Video
MP4 (38 MB)

     
  MATLAB Code
ZIP (1 MB)
  Bergen Data
ZIP (140 MB)
  Ifor Evans Hall to UCL Data
ZIP (810 MB)


   
  Ifor Evans Hall / Oxford Data
ZIP (125 MB)
  Video Data
ZIP (339 MB)


 
@inproceedings{Lieng:2012:Eurographics,
author = {Henrik Lieng and James Tompkin and Jan Kautz},
title = {Interactive Multi-perspective Imagery from Photos and Videos},
booktitle = {Computer Graphics Forum (Proceedings of Eurographics 2012)},
volume = {31},
number = {2pt1},
month = {May},
year = {2012},
pages = {285-293},
url = {http://dx.doi.org/10.1111/j.1467-8659.2012.03007.x},
doi = {10.1111/j.1467-8659.2012.03007.x},
}