Audiovisual elements play a crucial yet often underestimated role in shaping user experiences in interactive environments such as art exhibitions, video mapping, and installations. While visual elements tend to dominate as the primary focus, audiovisual integration—combining both sound and visuals—enhances emotional engagement, guides attention, and fosters spatial awareness. In environments where users actively interact with the space, audiovisual components transcend mere accompaniment, becoming vital parts of the experience that strengthen the connection between the user and their surroundings. This study delves into the impact of audiovisual stimuli in these settings, particularly investigating how sound and visuals together influence user cognition, emotional responses, and overall engagement.
Example 1: teamLab Borderless – This immersive exhibit blends sound, visuals, and user interactions to create a cohesive environment where sound guides participants’ movement and adds emotional depth to the visual narrative.
Example 2: In the SoundScape installation at the Museum of Modern Art (MoMA), curated soundscapes synchronize with projections to create a rich sensory experience, showing how sound can manipulate emotions and guide attention.
Example 3: BLCK SUN performance by AMIANGELIKA is experienced in spatial audio and recorded in real-time using analog synthesizers, digital instruments, and visual programming networks that interact to create a time-sensitive, immersive audio-visual environment that enhances how the audience perceives the story.
RESEARCH QUESTIONS
The research focuses on how audiovisual environments, such as sound, visual projections, and other sensory stimuli, affect user interaction and engagement in interactive spaces.
As anticipated in the main title, the question which I will try to answer is “How do audiovisual elements in interactive environments influence cognitive and emotional responses in users?”. Hopeful that these will bring me to answer the main topic I will research on sub questions such as:
- How do combinations of visuals and sound enhance emotional and cognitive engagement in interactive art?
- How can users’ interaction with audiovisual stimuli alter their perception of an installation or exhibition?
- How does interactivity in audiovisual environments shape user agency and immersion?
IS IT RELEVANT
Yes it is. understanding how audiovisual elements influence user engagement will allow designers to create more effective and emotionally engaging experiences. The findings will contribute to better user experience in interactive art installations, exhibitions and entertainments venues.
CHALLANGES EXPECTED
Some of the challenges that can be faced during the research are: finding the right balance of audiovisual stimuli without overwhelming or confusing the user. Different cultures and individuals may respond differently to audiovisual stimuli. Not all users will interact with the environment in the same way.
PERSONAL MOTIVATION
My interest in interactive environments has been deeply influenced by personal experiences in art exhibitions and installations, where the power of audiovisual elements was so overwhelming that it triggered physical discomfort to the point where I had to leave the space. This intense reaction made me realize the profound impact that sound, visuals, and their combination can have on a person’s emotional and cognitive state. This research is not only important for my academic journey but also for my future career, as it will allow me to learn how to direct user experiences more effectively. I am particularly interested in creating environments where users can not only experience but also manipulate the audiovisual elements, enabling them to have more control over their sensory interactions.