Hardware/software co-design of 2D-to-3D video conversion on FPGA

Thomas Schumann, Herbert Krauß, Yeong Kang Lai*, Yu Fan Lai

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


With advances in technology, 3D video technology becomes possible and attractive. However, there are still many pre-recorded 2D videos/images which need to get transferred to 3D. Hence this paper presents a high quality view synthesis algorithm and architecture for 2D-to-3D video conversion. During the process of view synthesis, the monocular depth information together with the intermediate view is synthesized to the left-eye and right-eye view. The proposed view synthesis algorithm consists of two parts: 3D image warping and inpainting (hole filling). 3D image warping transforms a 2D camera image plane to a 3D coordinate plane. However the integer grid points of the reference are warped to irregularly spaced points in the virtual view, resulting in occlusion problems. Thus inpainting is needed to fix the virtual images. The proposed algorithm shows an improved PSNR gain of 0.2~1.5dB. We adopt hardware/software co-design to accomplish the proposed view synthesis algorithm. For this we implemented the image inpainting on a FPGA device and the remaining algorithm in software.

Original languageEnglish
Title of host publicationInnovation for Applied Science and Technology
Number of pages5
StatePublished - 2013
Externally publishedYes
Event2nd International Conference on Engineering and Technology Innovation 2012, ICETI 2012 - Kaohsiung, Taiwan
Duration: 02 11 201206 11 2012

Publication series

NameApplied Mechanics and Materials
ISSN (Print)1660-9336
ISSN (Electronic)1662-7482


Conference2nd International Conference on Engineering and Technology Innovation 2012, ICETI 2012


  • 2D-to-3D
  • Hardware/software co-design
  • View synthesis


Dive into the research topics of 'Hardware/software co-design of 2D-to-3D video conversion on FPGA'. Together they form a unique fingerprint.

Cite this