VideoForest: Interactive visual summarization of video streams based on danmu data

Zhida Sun, Mingfei Sun, Nan Cao, Xiaojuan Ma

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

Abstract

Emerging online video-sharing websites such as YouTube allow users to access a huge number of videos and generate feedback via reviews and/or live comments (a.k.a. danmu), making it possible to summarize videos based on media and user responses collectively. A video summary produced by existing techniques may not fully capture the audience's perception of and reaction to the source video, and thus may be less reflective. In this paper, we introduce VideoForest, a visualization system designed to convert an input video augmented with danmu commentary data into a treelike visual summary of content highlights under users' supervision. The proposed visualization design employs a forest metaphor. The overall summary of different video sessions is illustrated as scene trees on top of the session timeline ground, with the roots depicting the corresponding danmu messages. VideoForest can also generate a detailed synopsis of the user-selected video segment(s) as a compact storyline in the form of circle packing. We evaluate our system via case studies with real video data based on experts' feedback. The results suggest the power and potential of the system.

Original languageEnglish
Title of host publicationSA 2016 -
Subtitle of host publicationSIGGRAPH ASIA 2016 Symposium on Visualization
PublisherAssociation for Computing Machinery
Pages1-8
Number of pages8
ISBN (Electronic)9781450345477
DOIs
Publication statusPublished - 28 Nov 2016
Event2016 SIGGRAPH ASIA Symposium on Visualization, SA 2016 - Macau, China
Duration: 5 Dec 20168 Dec 2016

Publication series

NameSA 2016 - SIGGRAPH ASIA 2016 Symposium on Visualization

Conference

Conference2016 SIGGRAPH ASIA Symposium on Visualization, SA 2016
Country/TerritoryChina
CityMacau
Period5/12/168/12/16

Keywords

  • Multimedia (image/video/music)
  • Visualization

Fingerprint

Dive into the research topics of 'VideoForest: Interactive visual summarization of video streams based on danmu data'. Together they form a unique fingerprint.

Cite this