Session:「Interaction in the large (environment)」

Deep Thermal Imaging: Proximate Material Type Recognition in the Wild through Deep Learning of Spatial Surface Temperature Patterns

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3173576

論文アブストラクト: We introduce Deep Thermal Imaging, a new approach for close-range automatic recognition of materials to enhance the understanding of people and ubiquitous technologies of their proximal environment. Our approach uses a low-cost mobile thermal camera integrated into a smartphone to capture thermal textures. A deep neural network classifies these textures into material types. This approach works effectively without the need for ambient light sources or direct contact with materials. Furthermore, the use of a deep learning network removes the need to handcraft the set of features for different materials. We evaluated the performance of the system by training it to recognize 32 material types in both indoor and outdoor environments. Our approach produced recognition accuracies above 98% in 14,860 images of 15 indoor materials and above 89% in 26,584 images of 17 outdoor materials. We conclude by discussing its potentials for real-time use in HCI applications and future directions.

日本語のまとめ:

モバイルサーマルカメラを使用し、ディープラーニングベースにした、材料認識システム。32種類の材料画像で室内・室外調査を行い、15種類(14,860枚)では98%以上、17種類(26,584枚)では89%以上の認識精度。

Wall++: Room-Scale Interactive and Context-Aware Sensing

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3173847

論文アブストラクト: Human environments are typified by walls, homes, offices, schools, museums, hospitals and pretty much every indoor context one can imagine has walls. In many cases, they make up a majority of readily accessible indoor surface area, and yet they are static their primary function is to be a wall, separating spaces and hiding infrastructure. We present Wall++, a low-cost sensing approach that allows walls to become a smart infrastructure. Instead of merely separating spaces, walls can now enhance rooms with sensing and interactivity. Our wall treatment and sensing hardware can track users' touch and gestures, as well as estimate body pose if they are close. By capturing airborne electromagnetic noise, we can also detect what appliances are active and where they are located. Through a series of evaluations, we demonstrate Wall++ can enable robust room-scale interactive and context-aware applications.

日本語のまとめ:

壁に電極をはわせることで、ユーザのタッチ・ジェスチャ・ポーズおよび、機器の状況を検知する、低コストの検知手法。相互キャパシタンス/空中EMのセンシングが可。電極/アンテナ実装時に導電率テスト、構築した壁の評価を行っている

ExtVision: Augmentation of Visual Experiences with Generation of Context Images for a Peripheral Vision Using Deep Neural Network

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3174001

論文アブストラクト: We propose a system, called ExtVision, to augment visual experiences by generating and projecting context-images onto the periphery of the television or computer screen. A peripheral projection of the context-image is one of the most effective techniques to enhance visual experiences. However, the projection is not commonly used at present, because of the difficulty in preparing the context-image. In this paper, we propose a deep neural network-based method to generate context-images for peripheral projection. A user study was performed to investigate the manner in which the proposed system augments traditional visual experiences. In addition, we present applications and future prospects of the developed system.

日本語のまとめ:

ディープニューラルネットワーク(DNN)を用いて画像を生成し、TVの周辺に投影することで視覚体験の拡張。2つのメソッド実装、自然に見える画像の生成と方法の限界の発見、30 fpsで高速。ユーザ評価では既存システムと同じ効果

PolarTrack: Optical Outside-In Device Tracking that Exploits Display Polarization

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3174071

論文アブストラクト: PolarTrack is a novel camera-based approach to detecting and tracking mobile devices inside the capture volume. In PolarTrack, a polarization filter continuously rotates in front of an off-the-shelf color camera, which causes the displays of observed devices to periodically blink in the camera feed. The periodic blinking results from the physical characteristics of current displays, which shine polarized light either through an LC overlay to produce images or through a polarizer to reduce light reflections on OLED displays. PolarTrack runs a simple detection algorithm on the camera feed to segment displays and track their locations and orientations, which makes PolarTrack particularly suitable as a tracking system for cross-device interaction with mobile devices. Our evaluation of PolarTrack's tracking quality and comparison with state-of-the-art camera-based multi-device tracking showed a better tracking accuracy and precision with similar tracking reliability. PolarTrack works as standalone multi-device tracking but is also compatible with existing camera-based tracking systems and can complement them to compensate for their limitations.

日本語のまとめ:

偏光ディスプレイの位置のトラッキング手法。RGBカメラの前で偏光フィルタが回転することで表示輝度の周期的変化を検知し、安価なアルゴリズムでセグメント表示とその位置と向きを追跡。既存システムと比較して高いトラッキング品質