Summary

A variety of summarization techniques have recently been published to manage the growing volume of media data, but most of them are oriented toward homogeneous media conversion and are limited in terms of compression ratio. In this study, we focus on vignette illustration. An Example of vignette illustration is shown below.

 

Vignette illustration expresses the story content of a video work or game in a compact way and
allows the viewer to understand the world perspective with a single glance. If video can be converted to vignette illustration, it is expected to provide a more highly compressed summary of the media information. In addition, visualization of the world view is also realized at the same time. In this study, we propose a method for semiautomatic generation of vignette illustration.

Our method can generate the following vignette illustrations while reflecting viewer preferences using eye tracking and user selection.

input

Part of input video.

output

Examples of generated vignette illustrations. There are three background shapes.

Members

NameAffiliationWeb site
Mayu NamaiKeio University

Publications

Presentations

Domestic presentations
  1. Mayu Namai, Issei Fujishiro:”Semiautomatic generation of vignette illustrations from video: Reflecting viewer preferences”,in Proceedings of Expressive Japan 2023 (The Institute of Image Information and Television Engineers Technical Report, Vol. 47, No. 9, pp.301-304, AIT2023-120), Tokyo Polytechnic University, March 6, 2023
  2. Mayu Namai, Issei Fujishiro:”Semiautomatic generation of vignette illustrations from video”,in Proceedings of the 85th National Convention of International Processing Society of Japan, Vol. 2, pp. 255―256 (6X-03), The University of Electro-Communications, online & onsite hybrid, March 4, 2023
  3. Mayu Namai, Issei Fujishiro:”Prototyping toward automatic generation of vignette illustrations”, in Proceedings of Visual Computing Workshop 2022 in Lake Suwa, Lecture No. 16, Nagano, November 25–26, 2022, [Abstract: The Journal of the Institute of Image Electionics Engineers of Japan, Vol. 52, No. 1, pp. 252–253, January 2023]
  4. Mayu NamaiIssei Fujishiro:”Prototyping toward automatic generation of vignette illustrations”, 情報可視化合宿, Poster Presentation, Tokyo Institute of Technology, September 24-25, 2022

Awards

Domestic awards
  1. Mayu NamaiIssei FujishiroExcellent poster awardsstudioVOXEL award,in Proceedings of Expressive Japan 2023, Semiautomatic generation of vignette illustrations from video: Reflecting viewer preferences,March 6, 2023
  2. Mayu NamaiIssei FujishiroStudent encouragement awards,in Proceedings of the 85th National Convention of International Processing Society of Japan,Semiautomatic generation of vignette illustrations from video, March 4, 2023

Grants

  1. Grant-in-Aid for Challenging Research (Pioneering):20K20481 (2022―2023)

Back to SAM team page