Effects of Visual Stimuli on Perceived Sound Volume in Virtual Reality Spaces

With the proliferation of affordable and high-performance virtual reality (VR) devices, VR content such as games and the metaverse is becoming increasingly widespread. In VR environments, users experience various sensory stimuli, primarily through visual and auditory cues. However, subjective perception of these stimuli varies based on user context. Existing studies have shown that auditory perception can be influenced by visual stimuli, however, most of them have focused on congruent audiovisual stimuli, leaving the effects of non-congruent pairings unexplored. This study investigates how visual stimuli, specifically color and crowdedness, influence perceived sound volume in VR. In the experiment that participants experienced VR environments with different room colors while listening to test tones, the results showed that warm colors led to higher perceived volume at low sound levels. Also, in the experiment that participants viewed VR scenes with varying crowd densities while hearing announcements, less crowded environments resulted in higher perceived sound volume. These findings suggest that visual context impacts auditory perception, providing insights for optimizing hearable devices and enhancing VR auditory experiences.

This is an Accepted Manuscript of a conference paper published by Springer Nature Switzerland.

HCII 2025

Lecture Notes in Computer Science, volume 15788

This fulltext file will be available in Jun. 2026.