When the Elephant Trumps": A Comparative Study on Spatial Audio for Orientation in 360◦ Videos

Bala, Paulo; Masu, Raul; Nisi, Valentina; Nunes, Nuno

http://hdl.handle.net/10400.13/5693

Use this identifier to reference this record.

Name:	Description:	Size:	Format:
When the elephant trumps.pdf		2.4 MB	Adobe PDF	Download

Send Feedback

Authors

Abstract(s)

Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orien tation purposes, namely by studying different spatialization conditions ("none", "partial", and "full" spatial manipulation) of multitrack soundtracks. We performed a between-subject mixed-methods study with 36 participants, aided by Cue Control, a tool we developed for dynamic spatial sound edit ing and data collection/analysis. Based on existing literature on orientation cues in 360◦ and theories on human listening, we discuss situations in which the spatialization was more ef fective (namely, "full" spatial manipulation both when using only music and when combining music and diegetic effects), and how this can be used by creators of 360◦ videos.

Keywords

360◦ video Spatial audio Cinematic virtual reality Orientation Virtual audio space . Faculdade de Ciências Exatas e da Engenharia

URI

http://hdl.handle.net/10400.13/5693

Citation

Bala, P., Masu, R., Nisi, V., & Nunes, N. (2019, May). " When the Elephant Trumps" A Comparative Study on Spatial Audio for Orientation in 360º Videos. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1-13).