Multi-modal user interface system development: The case of emergency triage
Shen Yu Xiang Chen Ying stirrup Zhu original Ka Po- Lun
Health, National Yang-Ming University, Institute of Information and Decision Making
[email protected] [email protected] [email protected] [email protected]
Summary
This study integrates voice and touch technology to the emergency triage, for example, through a combination of voice and touch
technology, provide a suitable system of triage for help nurses identify patients more precise condition, and the need for care. The developed system consists of a large and clear touch interface, hands and eyes free voice input, and use simple rules, through a number of user input data to provide triage triage classification, classification, partition recommended value, can be used as reference for nursing staff category, and thus to reduce manual work and increase the accuracy of patient medical information and real time. More important is to take this opportunity to establish voice and touch technology used in the prototype structure triage.
And requested the 30 acute care colleagues to help test, so as to provide multi-modal user interface into care information system pilot test experience. The research and development environment for Microsoft Visual Basic 6.0, Speech SDK 5.1, wireless headset
microphone Logitech cordless freedom headset and the large size touch screen SONY PCV LX900, the developed system consists of a large and clear touch interface, and hands-free Eye of the speech input, and use simple rules, some through the user input data to provide triage triage classification, classification, area of the proposed value can be used as reference for nursing staff category. The system total of 26 images, voice, vocabulary 338. If evaluation results show that as many mixed model using voice touch interface, higher than the simple voice interface forgiving. Comparison of voice and
touch, while the right touch high, but the average speed of fast speech. Comparison of multi-mode, single mode, and the old system acceptance, nursing staff favorite multi-mode interactive interface developed more than one mode of the emergency triage support system, and the system built in this study averaged 106 seconds to complete a triage operation, at 63 db of noise
environments up to 94% of the voice recognition rate.
Keywords: multi-mode user interface (Multi-Modal Interaction), ED triage (Emergency Triage)
