Summary
A variety of summarization techniques have recently been published to manage the growing volume of media data, but most of them are oriented toward homogeneous media conversion and are limited in terms of compression ratio. In this study, we focus on vignette illustration. An Example of vignette illustration is shown below.
Vignette illustration expresses the story content of a video work or game in a compact way and
allows the viewer to understand the world perspective with a single glance. If video can be converted to vignette illustration, it is expected to provide a more highly compressed summary of the media information. In addition, visualization of the world view is also realized at the same time. In this study, we propose a method for semiautomatic generation of vignette illustration.
Our method can generate the following vignette illustrations while reflecting viewer preferences using eye tracking and user selection.
input
output
Members
| Name | Affiliation | Web site |
|---|---|---|
 Mayu Namai | Keio University |
Publications
Presentations
Domestic presentations
- Mayu Namai, Issei Fujishiro：”Semiautomatic generation of vignette illustrations from video: Reflecting viewer preferences”，in Proceedings of Expressive Japan 2023 (The Institute of Image Information and Television Engineers Technical Report, Vol. 47, No. 9, pp.301-304, AIT2023-120), Tokyo Polytechnic University, March 6, 2023
- Mayu Namai, Issei Fujishiro：”Semiautomatic generation of vignette illustrations from video”，in Proceedings of the 85th National Convention of International Processing Society of Japan, Vol. 2, pp. 255―256 (6X-03), The University of Electro-Communications, online & onsite hybrid, March 4, 2023
- Mayu Namai, Issei Fujishiro：”Prototyping toward automatic generation of vignette illustrations”, in Proceedings of Visual Computing Workshop 2022 in Lake Suwa, Lecture No. 16, Nagano, November 25–26, 2022, [Abstract: The Journal of the Institute of Image Electionics Engineers of Japan, Vol. 52, No. 1, pp. 252–253, January 2023]
- Mayu Namai，Issei Fujishiro：”Prototyping toward automatic generation of vignette illustrations”, 情報可視化合宿, Poster Presentation, Tokyo Institute of Technology, September 24-25, 2022
Awards
Domestic awards
- Mayu Namai，Issei Fujishiro：Excellent poster awards・studioVOXEL award，in Proceedings of Expressive Japan 2023, Semiautomatic generation of vignette illustrations from video: Reflecting viewer preferences，March 6, 2023
- Mayu Namai，Issei Fujishiro：Student encouragement awards，in Proceedings of the 85th National Convention of International Processing Society of Japan，Semiautomatic generation of vignette illustrations from video, March 4, 2023
Grants
Grant-in-Aid for Challenging Research (Pioneering)：20K20481 (2022―2023)