An Interaction-Centric Wireless Multimodal Fusion Model for Cognitive State Recognition in Computer Interfaces
Wireless human-computer interaction increasingly depends on distributed sensing, yet adaptive computer interfaces are still commonly modelled from isolated evidence streams. This paper presents an interaction-centric wireless multimodal fusion model for recognizing cognitive state during computer-based task execution. The model integrates wearable physiology, ocular behaviour, compact neurophysiological summaries, and direct interaction evidence obtained from the task interface, then adjusts each sensing channel through a reliability term that reflects wireless degradation. The experimental workflow follows a public stress-resilience human-computer interaction protocol involving synchronized task phases and computer interaction logs. The analysis shows that interaction variables such as task error, response latency, and click activity are among the strongest indicators of cognitive state and complement physiological information in a meaningful way. The results support the design of adaptive computer interfaces that respond not only to what the user is doing on the screen, but also to how reliably the supporting wireless sensing infrastructure is functioning.
Volume & Issue
Vol. Volume 11 / Iss. Issue 1