Download the full-sized PDF of Realtime Free Viewpoint Video System Based on a new Panorama Stitching FrameworkDownload the full-sized PDF



Permanent link (DOI):


Export to: EndNote  |  Zotero  |  Mendeley


This file is in the following communities:

Graduate Studies and Research, Faculty of


This file is in the following collections:

Theses and Dissertations

Realtime Free Viewpoint Video System Based on a new Panorama Stitching Framework Open Access


Other title
Free Viewpoint
Panorama Stitching
Real time Computer Vision
Type of item
Degree grantor
University of Alberta
Author or creator
Aziz, Muhammad Usman
Supervisor and department
Ray, Nilanjan (Computing Science)
Boulanger, Pierre (Computing Science)
Examining committee member and department
Joseph, Dileepan (Electrical and Computer Engineering)
Department of Computing Science

Date accepted
Graduation date
Master of Science
Degree level
Free Viewpoint Video and TV is regarded as the future of digital entertainment allowing users to navigate through multiple video streams of an event to select novel viewpoints. This new capability will be able to give to the users the illusion that they are present at the event. In this thesis, we propose a novel framework for real-time video panorama generation. We first present our work for acquiring multiple high-definition video streams using hardware synchronized cameras with GPU accelerated Bayer demosaicing. The multiple streams are then color corrected using camera gain adjustment and Macbeth color checker chart to remove color variations between cameras. Next, we propose an automatic real-time video stitching algorithm using feature matching based approach and automatic camera calibration that is capable of producing spherical panoramas. The algorithm works by splitting the automatic image stitching steps into one-time and recurring computations. We utilize GPUs for accelerating the recurring computations and achieve real-time performance. By effectively caching the repeated transform maps database, we improve the stitching performance by two orders of magnitude compare to CPU implementations. In order to remove seams between the stitching images, we use Vornoi diagram based optimal seam selection algorithm. The stitched video streams are blended together using the first real-time implementation of Laplacian pyramid blending algorithm using multi-GPUs. Finally, we analyze the problems associated with the scalable transmission and rendering of the virtual views using commodity computers and network resources. The multiple stitching steps are pipelined to distribute the panorama stitching computations between multiple processing nodes to produce visually appealing panoramas at 30Hz without any noticeable blurring or stitching artifacts.
Permission is hereby granted to the University of Alberta Libraries to reproduce single copies of this thesis and to lend or sell such copies for private, scholarly or scientific research purposes only. The author reserves all other publication and other rights in association with the copyright in the thesis and, except as herein before provided, neither the thesis nor any substantial portion thereof may be printed or otherwise reproduced in any material form whatsoever without the author's prior written permission.
Citation for previous publication

File Details

Date Uploaded
Date Modified
Audit Status
Audits have not yet been run on this file.
File format: pdf (PDF/A)
Mime type: application/pdf
File size: 2127267
Last modified: 2016:06:24 18:39:37-06:00
Filename: Aziz_Muhammad Usman_201508_MSc.pdf
Original checksum: c8c94231d47c4ac0dbae6afc088fe256
Well formed: true
Valid: true
Page count: 86
Activity of users you follow
User Activity Date