Automated Detection of Facial Expressions during Computer-Assisted Instruction in Individuals on the Autism Spectrum


論文アブストラクト:It has been suggested that computer-assisted instruction (CAI) is a promising method for educating students on the autism spectrum. We aimed to determine whether automated recognition of facial expressions aided in predicting CAI engagement and learning performance. Seven youth with autism (mean age = 12.7, SD = 4.2) interacted with a CAI program, TeachTown Basics, for 15 consecutive sessions. Video recordings of the participants' faces were collected during these sessions and facial expressions from these videos were analyzed using CERT, an algorithm that automatically outputs intensity values for each facial action unit (AU). Using these data, we attempted to operationally define two engagement indices: (1) behavioral engagement, the proportion of time a participant had their face oriented to the computer screen; and (2) emotional engagement, the activation of AUs previously associated with CAI. Our results suggest that both indices strongly correlated with one another, but that emotional (not behavioral) engagement predicted test performance. CAI knowledge domain, participant sex, and developmental age also contributed to the prediction.


自閉症の子向けのコンピュータ教材の効果を測定 問題:自閉症の子は表情が変化しづらく教材の効果計測が難しい 手段:コンピュータ教材と,表情を分析するツールを併用 結果:どの表情の変化が効果測定にどう影響するか評価できた