More than three centuries ago, Sir Isaac Newton reflected on the similarities between the sense of hearing and the sense of sight. Newtons speculations were impossible to test scientifically, until now. A novel Brandeis University study confirms the Newtonian idea that sight and sound are indeed parallelat least when it comes to encoding and retrieving short-term memories from the two senses.
Published in this weeks issue of the open-access journal Public Library of Science Biology (PLoS), the study was inspired by Newtons 1706 book, Opticks, and set out to investigate whether sight and hearing behave similarly in encoding short-term memories.
"Obviously, sound and light are physically different, processed by different receptorseyes and earsand furthermore, processed in different neural streams within the brain," explained coauthor Robert Sekuler, a neuroscientist at the Volen National Center for Complex Systems at Brandeis University, and an expert on the neural and cognitive terrain associated with vision. "Previous studies that tried to compare auditory and visual memory did little or nothing to put the stimuli that would be remembered on equal footingcomparing apples to apples between the two senses."
"But in this study we used insights from neuroscience to identify test materials in vision and hearing that the human brain would process and treat in similar ways, and then we used these well-matched stimuli to examine memory for studied lists of either auditory or visual items," said Sekuler.
The study used computer-generated visual images and sounds to test auditory and visual memory mechanisms. Both the sounds and the visual materials were intentionally unfamiliar to test subjects, who also found it difficult to name the test items. The results were based on behavioral measures and a computational model for memory.