Spatial Memory in VR
Improving Spatial Memory in Virtual Reality using noisy vestibular stimulation
Role: Conception, Programming, Hardware Design, Experiment Design, Analysis
Advisor: Prof. Misha Sra
Duration: 10 weeks (2024)
Duration: 10 weeks (2024)
![](https://freight.cargo.site/t/original/i/eee7b647e491c2fcc876c7ac4095b0063471ca394f2471dbfed94fea5db58967/HeroImage.png)
Overview
How do we find our way through complex environments? The human ability to navigate space relies on sophisticated neural mechanisms that integrate multiple sensory inputs. At the heart of this process lies an unexpected player: the vestibular system. Through our research combining Noisy Galvanic Vestibular Stimulation (nGVS) with virtual reality, we reveal how this balance-sensing system might hold the key to enhancing human spatial memory. Our findings suggest that carefully calibrated vestibular stimulation can improve how people learn and remember spatial information in virtual environments, opening new possibilities for both understanding and augmenting human spatial cognition
Spatial Learning & Memory
When you navigate a new city or remember the layout of your childhood home, you're drawing on intricate neural networks that have fascinated researchers for decades. The famous Morris Water Maze experiments with rodents first illuminated how the hippocampus coordinates spatial learning. But while these foundational studies mapped the basic circuits, they left open an intriguing question: how might we actively enhance these abilities? Our research approaches this question through the novel lens of vestibular stimulation in virtual reality, where we can precisely control both environmental cues and sensory inputs.
Experiment
We created a rich virtual seaport environment where participants navigated between colorful fires placed strategically throughout the space. Using custom-built nGVS hardware interfaced with a Meta Quest headset, we could subtly modulate vestibular signals while participants explored. The environment itself balanced immediate landmarks like abandoned boats and towers with distant orientation cues like clouds and the sun, all accompanied by carefully designed spatial audio that enhanced presence.
![](https://freight.cargo.site/t/original/i/a59a6a31137bdb318c68982d298b297d306c648fdbd4457b5fb36a7739f842e6/Group-1.png)
![](https://freight.cargo.site/t/original/i/128e95590b3d86aad9af987172f7d14efaf068ac5f49bc202b0300e5d1b4dd44/3ef4345a-b2c6-4a77-8592-d0f37d84e864.png)
![](https://freight.cargo.site/t/original/i/70979e18901cb091199f5a0e8649e2b1098bdd9eefd5bcbfa2d77555c181de74/c1a03655-9a17-458b-a48d-1e4e99bbc0b3-1.png)
![](https://freight.cargo.site/t/original/i/bcd9a206d8e4e0935905b2f67ac3499c325333e8d313e44482cd1c3eeed4dcc9/f04e163c-07e9-4f10-9a0e-49f65815fa2b-1.png)
Our participants - 32 volunteers balanced across gaming experience - showed remarkable changes under vestibular stimulation. Their paths became more efficient, their movements more consistent, and their spatial memory more accurate. These improvements manifested not just in raw performance metrics but in the qualitative patterns of how they moved through and remembered the virtual space.
![](https://freight.cargo.site/t/original/i/d9baec15c59bfe3bbac23e1b9e885bcf8389e6628de63240dc619ecd0bc5a627/VR.png)
![](https://freight.cargo.site/t/original/i/df88b9f2272d7a845d0224d9d4d7b108030e2a056e335e5309c5c8fe376c25bd/image-24.png)
![](https://freight.cargo.site/t/original/i/36bc350b695422366d29f00f5833b6a3ae70a78b6c246daaf173131307c0c20f/Untitled-1.png)
Results
Our analysis revealed that participants under the nGVS condition consistently demonstrated enhanced navigational performance, as evidenced by shorter path lengths, greater path efficiencies, and more consistent movement patterns. The FFT analysis illuminated distinct movement patterns between the two conditions, underscoring the potential influence of GVS on spatial orientation and navigation.
This project is part of ongoing research and is under review. For more information or collaboration opportunities, feel free to reach out.