UHCL CSCI 5931 - Using a low cost electroencephalograph for task classification in HCI research

Unformatted text preview:

Using a Low-Cost Electroencephalograph for Task Classification in HCI Research Johnny Chung Lee Carnegie Mellon University 5000 Forbes Ave, Pittsburgh, PA 15213 [email protected] Desney S. Tan Microsoft Research One Microsoft Way, Redmond, WA 98052 [email protected] ABSTRACT Modern brain sensing technologies provide a variety of methods for detecting specific forms of brain activity. In this paper, we present an initial step in exploring how these technologies may be used to perform task classification and applied in a relevant manner to HCI research. We describe two experiments showing successful classification between tasks using a low-cost off-the-shelf electroencephalograph (EEG) system. In the first study, we achieved a mean classi-fication accuracy of 84.0% in subjects performing one of three cognitive tasks - rest, mental arithmetic, and mental rotation - while sitting in a controlled posture. In the second study, conducted in more ecologically valid setting for HCI research, we attained a mean classification accuracy of 92.4% using three tasks that included non-cognitive fea-tures: a relaxation task, playing a PC based game without opponents, and engaging opponents within the game. Throughout the paper, we provide lessons learned and dis-cuss how HCI researchers may utilize these technologies in their work. Categories and Subject Descriptors: H.1.2 [User/Machine Sys-tems]; H.5.2 [User Interfaces]: Input devices and strategies; B.4.2 [Input/Output Devices]: Channels and controllers; J.3 [Life and Medical Sciences]. General Terms: Human Factors, Experimentation. Keywords: Brain-Computer Interface, human cognition, physical artifacts, task classification, Electroencephalogram (EEG). INTRODUCTION For generations, humans have fantasized about the ability to communicate and interact with machines through thought alone or to create devices that can peer into a person’s thoughts. These ideas have captured the imagination of hu-mankind in the form of ancient myths and modern science fiction stories. However, only in recent decades have ad-vances in neuroscience and brain sensing technologies made measurable progress toward achieving that vision. These technologies allow us to monitor the physical proc-esses within the brain that correspond with certain forms of thought. Primarily driven by growing societal recognition for the needs of people with physical disabilities, researchers have used these technologies to build brain-computer interfaces (BCIs), communication systems that do not depend on the brain’s normal output pathways of peripheral nerves and muscles [17]. A conceptual illustration of a BCI system is shown in Figure 1. In these systems, users explicitly ma-nipulate their brain activity instead of using motor move-ments to produce signals that can be used to control com-puters or communication devices. The impact of this work is extremely high, especially to those who suffer from dev-astating neurodegenerative diseases such as amyotrophic lateral sclerosis, which eventually strips an individual of all voluntary muscular activity while leaving cognitive func-tion intact. Although removing the need for motor movements in com-puter interfaces is challenging and rewarding, we believe that the full potential of brain sensing technologies as an input mechanism lies in the extremely rich information it could provide about the state of the user. Having access to this state is valuable to HCI researchers because it may al-low us to derive more direct measures of traditionally elu-Figure 1 – A conceptual illustration of a Brain-Computer Inter-face using EEG signals for task classification. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. UIST’06, October 15–18, 2006, Montreux, Switzerland. Copyright 2006 ACM 1-59593-313-1/06/0010...$5.00. 81sive phenomena such as task engagement, cognitive work-load, surprise, satisfaction, or frustration. These measures could open new avenues for evaluating systems and inter-faces. Additionally, knowing the state of the user as well as the tasks they are performing may provide key information that would allow us to design context sensitive systems that adapt themselves to optimally support the state of the user. The work we present in this paper is an initial step in ex-ploring how BCI technology can be applied to HCI re-search. First, we demonstrate that effective exploration in this field can be accomplished using low-cost sensing equipment and without extensive medical expertise. An experiment we conducted shows that we were able to attain 84.0% mean accuracy classifying three different cognitive tasks using an off-the-shelf electroencephalograph (EEG) costing only USD$1500. Within this experiment, we pre-sent a reusable experimental design adapted from previous BCI work and discuss lessons learned so that other HCI researchers can build upon our experiences to perform their own explorations. Second, we present a novel approach to performing task classification by utilizing both cognitive and non-cognitive artifacts measured by our EEG as fea-tures for our classification algorithm. In a second experi-ment, we attained a mean classification accuracy of 92.4% on three tasks within a more ecologically valid setting, de-termining various user states while playing a PC based game. We close with a discussion of how this approach can be useful in certain areas of HCI research. BACKGROUND AND RELATED WORK Brain Sensing and EEG Primer The human brain is a dense network consisting of approxi-mately 100 billion nerves cells called neurons. Each neuron communicates with thousands of others to regulate physical processes and produce thought. Neurons communicate ei-ther by sending electrical signals to other neurons through physical


View Full Document

UHCL CSCI 5931 - Using a low cost electroencephalograph for task classification in HCI research

Documents in this Course
Load more
Download Using a low cost electroencephalograph for task classification in HCI research
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Using a low cost electroencephalograph for task classification in HCI research and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Using a low cost electroencephalograph for task classification in HCI research 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?