Walk With Me: Enhancing Virtual Walking Experience with Avatar, Shadows, and Vibrations
Category Machine Learning Tuesday - March 5 2024, 15:44 UTC - 8 months ago Researchers have developed a system that allows a seated person to experience the benefits of walking through a virtual environment. The system uses a combination of a 3DCG space, 360-degree live-action video, and physical information such as a walking avatar, shadows, and vibrations. It is compact, cost-effective, and aims to provide an immersive and embodied virtual walking experience for users.
Walking is a fundamental activity for humans and an important exercise that is central to daily activities. However, not everyone is able to walk freely due to various physical limitations. This is where the research team at Toyohashi University of Technology and the University of Tokyo come in. They have developed a system that provides a virtual walking experience for a seated person, allowing them to still experience the benefits of walking without actually moving their legs.
The system uses a combination of a 3DCG space, 360-degree live-action video, and physical information to create an immersive experience. The physical information includes a walking avatar, shadows created by light projecting onto the avatar, and vibrations created by the feet during walking. These elements are integrated with the 360-degree video, providing a realistic and multi-sensory experience for the user.
One of the key features of this system is its compactness and cost-effectiveness. Unlike other virtual walking devices that require actual limb movements, this system only requires a commercially available head-mounted display (HMD) and four vibrators attached to the feet. The system is based on an 8 K-resolution 360-degree video of a person walking and moving, which is experienced through the HMD. The avatar is synchronized with the user's head movements, creating a seamless and realistic experience.
The use of vibrations during walking is another important factor in enhancing the virtual embodiment. When the avatar walks and its feet land on the ground, the vibrations are felt on the user's feet, creating a powerful walking sensation. This adds an extra layer of realism to the experience, making the user feel more connected to the virtual environment.
The research team acknowledges that there is still much to be explored and developed in terms of virtual embodiment. However, this system is a step forward in providing a highly immersive and embodied virtual walking experience. It has the potential to benefit not only those with physical limitations, but also anyone who wants to experience the sense of walking in a virtual environment.
In conclusion, the team's research on virtual walking with the use of avatar, shadows, and vibrations has opened up new possibilities for virtual and metaverse realities. It is an exciting development that has the potential to enhance the overall virtual experience for everyone.
Share