Gaze-Contingent Multi-Resolutional Displays

There are many types of single-user computer displays for which people want or need very high image resolution, large fields of view, and fast image updates, for example virtual reality, simulators, video telephones, teleoperation, telemedicine, or remote piloting. Unfortunately, these combined demands often exceed the available processing resources or transmission bandwidth. One way to economize on resources and bandwidth in such applications is to use a gaze-contingent multi-resolutional display—a display in which you put high resolution information only where the user is looking at each moment, and lower resolution everywhere else, by using multi-resolutional images and gaze-tracking. Our research on this topic investigates the effects of varying the spatial and temporal dimensions of gaze-contingent multi-resolutional displays on users?perception and visual task performance. Together with Eyal Reingold and David Stampe at the University of Toronto, and George McConkie at the University of Illinois, we have published a review paper on gaze-contingent multi-resolutional displays synthesizing research across the fields of electrical engineering, computer science, vision science, and psychology, and provided a general framework within which research across these areas can be integrated, evaluated, and guided (Reingold, Loschky, McConkie & Stampe, 2003).

Our research on gaze-contingent multi-resolutional displays has covered several topics:

  1. Matching the Drop-Off of Image Resolution in Gaze-Contingent Multi- Resolutional Displays to That of Human Visual Resolution

  2. The Effects on Perception and Performance When Image Resolution Drops Below the Limits of Visual Resolution

  3. Matching Image Update Rates in Gaze-Contingent Multi-Resolutional Displays to the Temporal Limits of Vision

Related Articles:

Loschky, L.C. & Wolverton, G.S. (2007). How Late Can You Update Gaze-contingent Multi-resolutional Displays Without Detection? ACM Transactions on Multimedia Computing, Communications and Applications, 3(4): 25, 1-10.

Loschky, L.C., McConkie, G.W., Yang, J. & Miller, M.E. (2005). The limits of visual resolution in natural scene viewing. Visual Cognition, 12(6), 1057-1092.

Loschky, L.C., & McConkie, G.W. (2005). How late can you update? Detecting blur and transients in gaze-contingent multi-resolutional displays. Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting-2005. (pp. 1527-1530). Santa Monica, CA: HFES.

Reingold, E.M., Loschky, L.C., McConkie, G.W., & Stampe, D.M. (2003). Gaze-contingent multi-resolutional displays: An integrative review. Human Factors, 45(2), 307-328.

Loschky, L.C., & McConkie, G.W. (2002). Investigating spatial vision and dynamic attentional selection using a gaze-contingent multi-resolutional display. Journal of Experimental Psychology: Applied, 8(2), 99-117.

McConkie, G. W., & Loschky, L. C. (2002). Perception onset time during fixations in free viewing. Behavioral Research Methods, Instruments, and Computers, 34(4), 481-490.

Reingold, E. M., & Loschky, L. C. (2002). Saliency of peripheral targets in gaze-contingent multi-resolutional displays. Behavioral Research Methods, Instruments, and Computers, 34(4), 491-499.

Loschky, L. C., McConkie, G. W., Yang, J., & Miller, M. E. (2002). The effects of eccentricity-dependent image filtering on saccade targeting in natural images [Abstract]. Journal of Vision, 2(7), 170a, http://journalofvision.org/2/7/170/, DOI 10.1167/2.7.170.

McConkie, G.W., Wolverton, G.S. & Loschky, L.C. (2001). An environment for studying gaze-contingent multi-resolutional displays. In M.S. Vassiliou & T.S. Huang (Eds.), Computer-science Handbook for Displays: Summary of Findings from the Army Research Lab's Advanced Displays & Interactive Displays Federated Laboratory, (pp 55-61). Thousand Oaks, CA: Rockwell Scientific Company.

Reingold, E.M. & Loschky, L.C. (2002). Reduced saliency of peripheral targets in gaze-contingent multi-resolutional displays: Blended versus sharp boundary areas of interest. In A. T. Duchowski (Ed.), Proceedings of the Eye Tracking Research & Applications Symposium 2002. (pp. 89-93). New York, NY: ACM.

Loschky, L.C., & McConkie, G.W. (2000). User performance with gaze contingent multiresolutional displays. In A. T. Duchowski (Ed.), Proceedings of the Eye Tracking Research & Applications Symposium 2000 (pp. 97-103). New York, NY: ACM