MultiMediate: Multi-modal Group Behaviour Analysis for Artificial Mediation

It’s in Your Eyes - Towards Context-Awareness and Mobile HCI Using Wearable EOG Goggles

Andreas Bulling, Daniel Roggen, Gerhard Tröster

Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), pp. 84-93, 2008.


In this work we describe the design, implementation and evaluation of a novel eye tracker for context-awareness and mobile HCI applications. In contrast to common systems using video cameras, this compact device relies on Electrooculography (EOG). It consists of goggles with dry electrodes integrated into the frame and a small pocket-worn component with a DSP for real-time EOG signal processing. The device is intended for wearable and standalone use: It can store data locally for long-term recordings or stream processed EOG signals to a remote device over Bluetooth. We describe how eye gestures can be efficiently recognised from EOG signals for HCI purposes. In an experiment conducted with 11 subjects playing a computer game we show that 8 eye gestures of varying complexity can be continuously recognised with equal performance to a state-of-the-art video-based system. Physical activity leads to artefacts in the EOG signal. We describe how these artefacts can be removed using an adaptive filtering scheme and characterise this approach on a 5-subject dataset. In addition to explicit eye movements for HCI, we discuss how the analysis of unconscious eye movements may eventually allow to deduce information on user activity and context not available with current sensing modalities.



@inproceedings{bulling08_ubicomp, author = {Bulling, Andreas and Roggen, Daniel and Tr{\"{o}}ster, Gerhard}, keywords = {Context-awareness, Electrooculography (EOG), Eye Gestures, Eye Tracking, Human-Computer Interaction (HCI), Wearable Computing}, title = {It's in {Y}our {E}yes - {T}owards {C}ontext-{A}wareness and {M}obile {HCI} {U}sing {W}earable {EOG} {G}oggles}, booktitle = {Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)}, year = {2008}, pages = {84-93}, doi = {10.1145/1409635.1409647} }