Summary
Virtual space can eliminate the physical constraints of real space. Three-dimensional (3D) digital twins enable us to touch cultural assets that are inaccessible in real space. In addition, it is important not only to physically preserve cultural assets, but also to preserve the ways in which they are moved and used. The creation of a virtual space in which people can experience the manipulation of cultural assets will be a great help to the assets’ preservation. However, most 3D models obtained using current reconstruction techniques are static; they cannot be dynamically manipulated. We proposed a method to reproduce the dynamic 3D model from the reconstructed model, and we showed that the method allows us to simulate the experience of manipulating cultural assets in a virtual space.
In this study, we reproduced a dynamic 3D model of a simple articulated object with a rotating joint from a static point cloud, referring only to a video of the motion and a manually specified rotation axis. The actual reconstructed cultural asset was used for first-person experiences in an augmented reality environment.
Members
| Name | Affiliation | Web site |
|---|---|---|
 Sakura Shinji |
Keio University |
Publications
Presentations
[P-1] Sakura Shinji, Issei Fujishiro “Virtual Manipulation of Cultural Assets: An Initial Case Study with Single-Joint Articulated Models”, in ACM SIGGRAPH 2023 Posters (SIGGRAPH ’23), Article 26, 1–2, Los Angeles, USA, August 6-10, 2023. DOI: 10.1145/3588028.3603649
[P-2] Sakura Shinji, Issei Fujishiro: “Motion reconstruction of articulated objects from point clouds with a sample video and a specified rotation axis,” in Proceedings of Expressive Japan 2023 (The Institute of Image Information and Television Engineers Technical Report, Vol. 47, No. 9, AIT2023-71 pp.135-138), Tokyo Polytechnic University, March 6, 2023, Excellent presentation awards
[P-3] Sakura Shinji, Issei Fujishiro: “Joint motion reconstruction of articulated object from a point cloud by specifying axes,” in Proceedings of the 85th National Convention of International Processing Society of Japan, Vol. 2, pp. 891―892(1X-06), The University of Electro-Communications, online & onsite hybrid, March 2, 2023, Student encouragement awards
Grants
Grant-in-Aid for Scientific Research (A): 22H00549 (2022－)