Final Thesis

The influence of varying degree of visualization on spatial audio-visual congruency effects with short-term memory performance

Key Info

Basic Information

Research Area:
Audio-visual Interaction,
Auditory Scene Analysis
Type of Thesis:


Master Thesis of Wenzel, Alissa

When understanding and recalling spoken language, various complex processes take place in the brain. Certain circumstances can either facilitate speech comprehension, e.g. visual stimuli such as lip movements or gestures, or impede it, e.g. noise. Although the field of cognitive psychology has already intensively studied short-term memory performance or listening effort in such situations, it mostly uses simple scenarios without plausible visual and auditory material. It is therefore possible that the performance of participants in such studies differs from reality.

In this work, spatial congruency effects will be investigated, i.e., the performance of the subjects depending on whether the perceived direction from which the acoustic signal comes is congruent with the direction in which a source is visually located. The established serial-recall paradigm is used, which allows the evaluation of short-term memory performance.

As a further variable, a 3D-virtual reality (VR) environment will be compared to an acoustic laboratory environment with single screens. Compared to real-life settings, the VR environment offers the advantages of being precisely controllable and reliably accessible.