People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges

論文URL:http://dl.acm.org/citation.cfm?doid=3025453.3025899

論文アブストラクト:Blind people often need to identify objects around them, from packages of food to items of clothing. Automatic object recognition continues to provide limited assistance in such tasks because models tend to be trained on images taken by sighted people with different background clutter, scale, viewpoints, occlusion, and image quality than in photos taken by blind users. We explore personal object recognizers, where visually impaired people train a mobile application with a few snapshots of objects of interest and provide custom labels. We adopt transfer learning with a deep learning system for user-defined multi-label k-instance classification. Experiments with blind participants demonstrate the feasibility of our approach, which reaches accuracies over 90% for some participants. We analyze user data and feedback to explore effects of sample size, photo-quality variance, and object shape; and contrast models trained on photos by blind participants to those by sighted participants and generic recognizers.

日本語のまとめ:

視覚障がい者が撮影した写真を分類するための画像分類アルゴリズムを構築した.一般的な画像分類よりも,視覚障がい者が撮影した写真のデータセットを用いた画像分類アルゴリズムの方が精度が高いことが示された.

(99文字)

発表スライド: