A new study using a B-Alert EEG (electroencephalography) headset is able to predict within 20 seconds and with 80% accuracy when a person will make a mistake on a standardized math exam. It is still far from being the real life version of Minority Report where computers predict crimes before they happen, but Federico Cirett, a doctoral student in the University of Arizona computer science department believes he has found a way to optimize learning methods.
Noticing English language learners were having more difficulty answering problems, Cirett set out on an investigation for his dissertation work.
“There are so many things going on where students may be getting distracted, but it wasn’t clear,” said Cirett, a computer science department student working on his dissertation. “So, I thought to measure brain states of students as they were working on the material.”
Using EEG technology Cirett began studying specific brain wave activity in students taking the math portion of the popular, but challenging, SAT exam.
Measuring the activity, Cirett was able to detect with 80 percent accuracy whether a student – all of them university students – would answer a question incorrectly about 20 seconds after they began the question.
The findings have important implication for students and educators, said Carole Beal, also a professor and Cirett’s adviser and collaborator.
With the findings, Beal and Cirett co-authored “EEG estimates of engagement and cognitive workload predict math problem solving outcomes.” The paper has since been accepted for presentation during the User Modeling, Adaptation and Personalization conference to be held in Montreal, Canada in July.
“He’s done this great project, and his contribution is applying this research to education,” said Beal, who has spent years developing AnimalWatch, a Web-based tutoring system centered on algebra readiness.
But how is this done?
During his work on AnimalWatch, Cirett said he noticed that the English language learners – the majority of them who spoke Spanish as their primary language – seemed to be having a more difficult time answering problems than did their primarily English-speaking peers.
Cirett found that the students performed at comparable levels on the math problems, but the English learners stumbled a bit. “It was the language barrier.” “We want students to be able to solve these problems,” Cirett said, “but we have to make these problems easier for them to read, but we have to give them better opportunities.”
Mexico-born Cirett, who came to the UA to study alongside his wife, spoke with Beal about using the EEG technology, which she had employed in the past.
For his research, which was partially funded by the National Science Foundation, Cirett employs a B-Alert headset developed by the San Diego-based Advanced Brain Monitoring company, which is generally used to monitor high-stress and fatigue in military personnel.
“Some of it is pre-programmed,” Beal said, noting that the technology and algorithms had already been designed.
“But what Federico did was to look at these patters to create a classification,” Beal said. “His algorithm is much better than chance and it’s much better than knowing the number of correct answers people typically get on the exam.”
With its nine sensors, the device records information about individual attention levels and cognitive workload as they completed multiple-choice math questions, some easy; some hard. For instance, the measurements were directly correlated to how engaged students were in their work and how they felt in the process.
During the study, students also reported on feelings of frustration and their perceived difficulty of the math problems. Cirett analyzed the data to try and figure out if the EEG data specific to students’ attention levels and their cognitive workload could predict when they would answer a question with the correct answer.
The end goal of his research, Cirett said, is to optimize learning at the individual level, especially in the area of math, an increasingly important subject.
“There are different ways to solving this problem,” Cirett said. “But if we can detect when they are going to fail, maybe we can change the text or switch the question to give them another one at a different level of difficulty, but also to keep them engaged,” Cirett said. “Brain wave data is the nearest thing we have to really know when the students are having problems.”