high-clutter
Figure 9. False alarm rates for the 9 experimental conditions in Experiment 4
34
d'
0 0.5 1 1.5 2 2.5 3
12-icon 24-icon 36-icon
num ber of icons on the display
d' value
none mid-clutter high-clutter
Figure 10. d’ values for the 9 experimental conditions in Experiment 4
35
Beta
0 0.5 1 1.5 2 2.5 3 3.5
12-icon 24-icon 36-icon
Num ber of icons on the display
beta value
none mid-clutter high-clutter
Figure 11. β values for the 9 experimental conditions in Experiment 4
36
False alarm rate
0.0 0.2 0.4 0.6 0.8 1.0
Hit rate
0.0 0.2 0.4 0.6 0.8 1.0
12-icon, none background 12-icon, mid-clutter 12-icon, high-clutter 24-icon, none background 24-icon, mid-clutter 24-icon, high-clutter 36-icon, none background 36-icon, mid-clutter 36-icon, high-clutter
Figure 12. ROC curves for the 9 experimental conditions in Experiment 4.
37
d’ β
Exp 1 (Numeric size) 1.83 1.66
Exp 2 (Color variety) 0.61 1.30
Exp 3 (graphical background)
0.53 1.10
Exp 4 (Numeric size X graphical background)
0.99 1.37
Table 1. Summary of d’ and β values for the four experiments.
38 References
Casti, J. L. (1979). Connectivity, Complexity, and Catastrophe. New York: Wiley.
Cummings, M. L., & Tsonis, C. (2005). Deconstructing complexity in air traffic control.
In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp 25-29). Santa Monica, CA: Human Factors Society.
Drozdz, S., Kwapien, J., Speth, J., & Wojcik, M. (2002). Identifying complexity by means of matrices. Physica A, 314, 355-361.
Edmonds, B. (1999). What is complexity? – The philosophy of complexity per se with application to some examples in evolution. In Heylighen, F. and Aerts, D. (Eds.):
The Evolution of Complexity. (pp. 1-18). Kluwer, Dordrecht.
Grahame, M., Laberge, J., and Scialfa, C. T. (2004). Age difference in search of web pages: the effects of link size, link number, and clutter. Human Factors, 46(3), Halford, G. S., Wilson, W. H., & Phillips, W. (1998). Processing capacity defined by
relational complexity: implications for comparative, developmental and cognitive psychology. Behavioral Brain Sciences, 21, 803-831.
Johnson, W. W., Jordan, K., Liao, M., & Granada, S. (April, 2003). Sensitivity and bias in searches of Cockpit Display of Traffic Information Utilizing
Highlighting/Lowlighting. Proceedings of the 12th International Symposium on Aviation Psychology, Dayton, Ohio, 625-629.
Klinger, A., & Salingaros, N. A. (2000). A pattern measure. Environment and Planning B:
Planning and Design, 27, 537-547.
Liao, M., Johnson, W. W., & Granada, S. (2007). The effects of brightness highlighting on visual search within a cockpit display of traffic information. Chinese Journal of Psychology. 49(3), 271-284.
Macmillan, N. A. & Creelman, C. D. (1991a). Detection Theory: A User’s Guide.
Cambridge: Cambridge University Press.
Mackworth, N. H. (1948). The breakdown of vigilance during prolonged visual search.
Quarterly Journal of Experimental Psychology, 1, 5-61.
Sheu, C-F., Lee, Y-S, & Shih, P-Y. (2008). Analyzing recognition performance with sparse data, Behavior Research Methods, 40(3), 722-727.
Swets, J. A. (1973). The relative operating characteristic in psychology. Science, 182, 990-1000.
39
Swets, J. A. (1986). Form of empirical ROCs in discrimination and diagnostic tasks:
implications for theory and measurement of performance. Psychological Bulletin, 99, 181-198.
Swets, J. A. (Ed.) (1988b). Signal detection and recognition by human observers. New York: Wiley.
Swets, J. A., & Pickett, R. M. (1982). The evaluation of diagnostic system. New York:
Academic Press.
Tullis, T. S. (1985). Designing a menu-based interface to an operating system. In
Proceedings of CHI’85 Conference on Human Factors in Computing Systems. San Francisco, CA.
Tullis, T. S. (1986). Optimizing the usability of alphanumeric displays. In Proceedings of HCI’86 Conference on People and Computers. York, England.
Xing J. (2004) Metrics of information complexity and the implications for automation design. FAA Tech. Report. DOT/FAA/AM-04/17.
Xing J, Manning CA (2005) Complexity and Automation displays: Literature review and analysis. FAA Tech. Report. DOT/FAA/AM-05/4.
Wickens, C. D. & Hollands, J. G. (1999). Engineering Psychology and Human Performance (3rd edition). Prentice Hall.
40
Self-evaluation
Overall the four experiments were conducted successfully in the present project and the data analyses were performed properly. However, the most challenge issue in the present project was the individual difference. It appeared that participants’ performance varied differently depending on their experiences with computers or video/online games.
The individual differences certainly make the analyses more difficult and challenging.
Although the present study adopted an alternative mathematical model to account for the individual differences, there were still some uncertainties and the authors believe that the current data can be further explored with different methods and models to reveal more information about participants’ performance. How to handle individual differences in interface design studies becomes a new challenge for future research.
Despite the difficulties, the present analysis results still provide some useful recommendations for designs of computer-based interfaces. The experimental results have been presented in one conference. The manuscript of the present project is undergoing and will be finished to submit to a journal in a near future.
The research assistant in the project has been making great progress in
understanding the project, running experiments, collecting data, and finally assisting in data analyses through the two years’ appointment. She was very well trained through this project.
Conference presentations:
Liao, M., Sheu, C. F., & Fa, N-H (November, 2010). Impacts of display complexity on target detection performance: A signal detection analysis. Forty-ninth Annual Meeting of the Taiwan Psychological Association, Chai-Yi, Taiwan.
Liao, M., Wu, Y., & Sheu, C. F. (May, 2009). Effects of 3D Display Complexity on Target Acquisition Performance. Association for Psychological Science 21st Annual Convention, San Francisco, California.
Liao, M. & Wu, Y. (November, 2008). Perceptual complexity and older adults’ target acquisition performance. Forty-ninth Annual Meeting of the Psychonomic Society, Chicago, Illinois.
Liao, M., Wu, Y., & Sheu, C. F. (October, 2008). Impacts of perceptual complexity on target acquisition performance within a 3-D perspective. Forty-seventh Annual Meeting of the Taiwan Psychological Association, Taipei, Taiwan.
41 Publications
Liao, M., Johnson, W. W., & Granada, S. (2007). The effects of brightness highlighting on visual search within a cockpit display of traffic information. Chinese Journal of Psychology. 49(3), 271-284.
Liao, M., Wu, Y., & Sheu, C. F. (in preparation) Effects of perceptual complexity on target acquisition performance within a computer display.