Eye Movements and Memory for Objects in Scenes

Eye_Movements_and_Memory 

As we move our eyes from object to object in a scene, what information do we retain from each object we look at? And what effect does the order in which we looked at those objects have on our memory of them? Research on change blindness (when changes made to real world or pictorial scenes are not noticed, even when a person is looking at the scene) has suggested that people remember little of what they see in scenes—otherwise they would surely notice the change! However, our research in collaboration with Gregory Zelinsky of SUNY Stony Brook (Zelinsky & Loschky, 2005) has shown that memory for an object in a scene can last over several intervening fixations on other objects in the scene, suggesting that memory is better than previously suggested in change blindness studies. Nevertheless, our research has also shown that memory for an object rapidly decreases as a person fixates on the first two to three subsequent objects. This recency effect is based on fixation sequence, not simply the decay of memory over time. Thus, the change blindness phenomenon may in part be explained by this gradual loss of memory as one looks from object to object in a scene. However, refixating on a object can serve as a memory rehearsal and help maintain object information; this is believed to improve memory for a target object, make it more likely that the object will be correctly identified later, and counteract the interference caused by looking at other objects (Zelinsky, Loschky, & Dicksinson, 2011). We propose that a prominent theory for explaining memory for objects in scenes, Object File Theory, must be modified to take into account the rich body of theory and research in the classic memory literature. This research should also be applicable to areas in which it is important to know what information a person attends to and remembers during task performance - for example, information displays in airplane cockpits, air traffic control, driving simulators, etc.

In a collaboration with Dr. Donald Varakin of Knox College (Varakin & Loschky, 2010), we have also investigated how memory for objects in scenes is combined (or not) with memory for the specific views of the scenes in which those objects were seen. Previous research has shown that visual long-term memory (VLTM) stores detailed information about object appearance. Our studies investigated whether object appearance information in VLTM is integrated with representations that contain picture-specific viewpoint information. In three experiments using both incidental and intentional encoding instructions, we found that participants were unable to perform above chance level on recognition tests that required recognizing the conjunction of object appearance and viewpoint information. However, we found that performance was better when recognizing object appearance information or picture-specific viewpoint information alone. Thus, our results suggest that object appearance and viewpoint are not episodically integrated in VLTM for scenes.

 

Related Publications

Zelinsky, G.J., Loschky, L.C. & Dickinson, C.A. (2011). Do object refixations during scene viewing indicate rehearsal in visual working memory? Memory & Cognition, 39(4), 600-613.

Varakin, D.A., & Loschky, L.C. (2010). Object appearance and picture-specific viewpoint are not integrated in long-term memory. Quarterly Journal of Experimental Psychology, 63(6), 1181-1200.

Zelinsky, G.J. & Loschky, L.C. (2005).  Eye movements serialize memory for objects in scenes. Perception and Psychophysics, 67(4), 676-690.

Related Conference Presentations

Zelinsky, G.J. & Loschky, L.C. (2009, July). Using eye movements to study working memory rehearsal. Talk presented at the Annual Meeting of the Cognitive Science Society 2009, Amsterdam, Netherlands.

Varakin, D.A. & Loschky, L.C. (2009, May). Object appearance is not integrated with scene viewpoint in long-term memory.  Poster presented at the 9th Annual Meeting of the Vision Sciences Society, Naples, FL.

Varakin, D.A. & Loschky, L.C. (2009, April). From where did I see that?  Talk presented at the Annual Meeting of the Midwestern Psychological Association, Chicago, IL.