Contributed Talk Sessions | Poster Sessions | All Posters | Search Papers

Poster Session B: Wednesday, August 13, 1:00 – 4:00 pm, de Brug & E‑Hall

Reverse Spatiotemporal Hierarchy during Cross-modal Memory Recall and Imagery

Yu Hu1, Yalda Mohsenzadeh1; 1University of Western Ontario

Presenter: Yu Hu

Recalling past events is often accompanied by mental imagery of those experiences. Based on previous research, this process engages memory- and sensory-related brain areas. However, the underlying spatiotemporal dynamics remain poorly investigated. Here, we used naturalistic videos of audiovisual events and recorded fMRI data during the tasks in which human participants recalled visual contents when hearing associated sounds and recalled sounds when watching silent videos, after they had well memorized the video contents. With time-resolved fMRI multivariate pattern analyses, we observed reverse spatiotemporal hierarchy during the visual memory recall and imagery: the neural activity in primary visual cortex was delayed compared with high-order visual areas. A similar trend was found during auditory memory recall and imagery, where the activity of the high-level superior temporal gyrus was earlier than the mid-level planum temporale. However, the primary auditory area was not involved, suggesting modality differences in the role of primary sensory areas in corresponding memory recall. We also observed the activity of the hippocampus, the parahippocampal cortex, the retrosplenial cortex, and the precuneus. We found their associated temporal dynamics were consistent across sensory modalities during memory recall, which were distinct from that during memory encoding. Overall, our study provided both spatial and temporal accounts of neural activity during the cross-modal memory recall and imagery.

Topic Area: Memory, Spatial Cognition & Skill Learning

Extended Abstract: Full Text PDF