Exploring Eye Expressions for Enhancing EOG-Based Interaction

Joshua Newn, Sophia Quesada, Baosheng James Hou, Anam Ahmad Khan, Florian Weidner, Hans Gellersen

INTERACT 2023: 19th IFIP TC13 International Conference on Human-Computer Interaction

This paper explores the classification of eye expressions for EOG-based interaction using JINS MEME, an off-the-shelf eye-tracking device. Previous studies have demonstrated the potential for using electrooculography (EOG) for hands-free human-computer interaction using eye movements (directional, smooth pursuit) and eye expressions (blinking, winking). We collected a comprehensive set of 14 eye gestures to explore how well both types of eye gestures be classified together in a machine learning model. Using a Random Forest classifier trained on our collected data using 15 engineered features, we obtained an overall classification performance of 0.77 (AUC). Our results show that we can reliably classify eye expressions, enhancing the range of available eye gestures for hands-free interaction. With continued development and refinement in EOG-based technology, our findings have long-term implications for improving the usability of the technology and for individuals who require a richer vocabulary of eye gestures to interact hands-free.

Ludwig Sidenmark, Mathias N. Lystbæk, and Hans Gellersen. 2023. GESimulator: An Open-Source Tool for Simulating Real-Time Errors for HMD-based Eye Trackers. In 2023 Symposium on Eye Tracking Research and Applications (ETRA ’23), May 30–June 02, 2023, Tubingen, Germany. ACM, New York, NY, USA, 6 pages. https://doi.org/10.1145/3588015.3588417.

 

BibTex

@inproceedings{10.1145/3588015.3588417,
	author = {Sidenmark, Ludwig and Lystbæk, Mathias N. and Gellersen, Hans},
	title = {GE-Simulator: An Open-Source Tool for Simulating Real-Time Errors for HMD-based Eye Trackers},
	year = {2023},
	isbn = {9798400701504},
	publisher = {Association for Computing Machinery},
	address = {New York, NY, USA},
	url = {https://doi.org/10.1145/3588015.3588417},
	doi = {10.1145/3588015.3588417},
	booktitle = {ACM Symposium on Eye Tracking Research and Applications},
	numpages = {6},
	location = {Tubingen, Germany},
	series = {ETRA '23}
}