Embodied Spatial Simulation: Enabling Embodied Interaction with Human Motion Simulation in Extended Reality

Abstract

Human Motion Simulation (HMS) predicts and visualizes how virtual agents move and behave in various scenarios, aiding decision-making. However, it does not communicate the experience behind agents' behavior. To address this, we present Embodied Spatial Simulation (ESS), a concept combining augmented reality(AR) and HMS to support in-situ decision-making. It enables an XR user to create “what-if” scenarios, simulate virtual agents' behavior in situ, and experience the scenarios from their perspectives through embodiment. To demonstrate ESS, we developed a proof-of-concept prototype featuring two scenarios (e.g., fire evacuation planning). From expert walkthroughs (N=4) and a survey (N=38) with different professions, we found that incorporating embodiment into simulations can change users' intentions to use simulation outcomes. Rather than directly obtaining solutions from the results, users showed more interest in understanding the experience behind simulated behavior and using this insight to shape decisions. We discuss the potential of ESS to support future human-centered design practices.

mehr

Mehr zum Titel

Titel Embodied Spatial Simulation: Enabling Embodied Interaction with Human Motion Simulation in Extended Reality
Medien IEEE Transactions on Visualization and Computer Graphics
Herausgeber IEEE
Heft 5
Band 32
Verfasser Yanni Mei, Jonas Wombacher, Wen-Jie Tseng, Prof. Dr. Veronika Krauß, Jan Gugenheimer
Seiten 4154-4164
Veröffentlichungsdatum 01.05.2026
Zitation Mei, Yanni; Wombacher, Jonas; Tseng, Wen-Jie; Krauß, Veronika; Gugenheimer, Jan (2026): Embodied Spatial Simulation: Enabling Embodied Interaction with Human Motion Simulation in Extended Reality. IEEE Transactions on Visualization and Computer Graphics 32 (5), 4154-4164. DOI: 10.1109/TVCG.2026.3679897