Gradient-based 2D-To-3D Conversion for Soccer Videos

Kiana Calagari, Mohamed Elgharib, Piotr Didyk, Alexandre Kaspar, Wojciech Matusik, Mohamed Hefeeda

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

A wide spread adoption of 3D videos and technologies is hindered by the lack of high-quality 3D content. One promis-ing solution to address this problem is to use automated 2D-To-3D conversion. However, current conversion meth-ods, while general, produce low-quality results with artifacts that are not acceptable to many viewers. We address this problem by showing how to construct a high-quality, domain-specific conversion method for soccer videos. We propose a novel, data-driven method that generates stereoscopic frames by transferring depth information from similar frames in a database of 3D stereoscopic videos. Creating a database of 3D stereoscopic videos with accurate depth is, however, very dificult. One of the key findings in this paper is showing that computer generated content in current sports computer games can be used to generate high-quality 3D video ref-erence database for 2D-To-3D conversion methods. Once we retrieve similar 3D video frames, our technique transfers depth gradients to the target frame while respecting object boundaries. It then computes depth maps from the gradients, and generates the output stereoscopic video. We implement our method and validate it by conducting user-studies that evaluate depth perception and visual comfort of the converted 3D videos. We show that our method produces high-quality 3D videos that are almost indistinguishable from videos shot by stereo cameras. In addition, our method signifocantly out-performs the current state-of-The-Art method. For example, up to 20% improvement in the perceived depth is achieved by our method, which translates to improving the mean opinion score from Good to Excellent.

Original languageEnglish
Title of host publicationMM 2015 - Proceedings of the 2015 ACM Multimedia Conference
PublisherAssociation for Computing Machinery, Inc
Pages331-340
Number of pages10
ISBN (Print)9781450334594
DOIs
Publication statusPublished - 13 Oct 2015
Event23rd ACM International Conference on Multimedia, MM 2015 - Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015

Other

Other23rd ACM International Conference on Multimedia, MM 2015
CountryAustralia
CityBrisbane
Period26/10/1530/10/15

    Fingerprint

Keywords

  • 2D-To-3D conversion
  • 3D video
  • Depth estimation

ASJC Scopus subject areas

  • Media Technology
  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Calagari, K., Elgharib, M., Didyk, P., Kaspar, A., Matusik, W., & Hefeeda, M. (2015). Gradient-based 2D-To-3D Conversion for Soccer Videos. In MM 2015 - Proceedings of the 2015 ACM Multimedia Conference (pp. 331-340). Association for Computing Machinery, Inc. https://doi.org/10.1145/2733373.2806262