Session:「(On-body) Sensing」

Extending Keyboard Shortcuts with Arm and Wrist Rotation Gestures

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3173595

論文アブストラクト: We propose and evaluate a novel interaction technique to enhance physical keyboard shortcuts with arm and wrist rotation gestures, performed during keypresses: rolling the wrist, rotating the arm/wrist, and lifting it. This extends the set of shortcuts from key combinations (e.g. ctrl + v) to combinations of key(s) and gesture (e.g. v + roll left) and enables continuous control. We implement this approach for isolated single keypresses, using inertial sensors of a smartwatch. We investigate key aspects in three studies: 1) rotation flexibility per keystroke finger, 2) rotation control, and 3) user-defined gesture shortcuts. As a use case, we employ our technique in a painting application and assess user experience. Overall, results show that arm and wrist rotations during keystrokes can be used for interaction, yet challenges remain for integration into practical applications. We discuss recommendations for applications and ideas for future research.

日本語のまとめ:

キーボードショートカットをより便利にする方法として「キータッチ+腕、手首のジェスチャ」を考案した。実用に向けて実験、調査を行った。結果、提案手法は新たな入力手法として有効であることがわかったが、実用性には欠ける分がある。

What to Put on the User: Sensing Technologies for Studies and Physiology Aware Systems

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3173719

論文アブストラクト: Fitness trackers not just provide easy means to acquire physiological data in real-world environments due to affordable sensing technologies, they further offer opportunities for physiology-aware applications and studies in HCI; however, their performance is not well understood. In this paper, we report findings on the quality of 3 sensing technologies: PPG-based wrist trackers (Apple Watch, Microsoft Band 2), an ECG-belt (Polar H7) and reference device with stick-on ECG electrodes (Nexus 10). We collected physiological (heart rate, electrodermal activity, skin temperature) and subjective data from 21 participants performing combinations of physical activity and stressful tasks. Our empirical research indicates that wrist devices provide a good sensing performance in stationary settings. However, they lack accuracy when participants are mobile or if tasks require physical activity. Based on our findings, we suggest a textitDesign Space for Wearables in Research Settings and reflected on the appropriateness of the investigated technologies in research contexts.

日本語のまとめ:

フィットネストラッカーは生体情報を用意に取得できるため,HCI分野での利用も増加している.しかし,その機器による性能の違いはあまり知られていない.そこで,各デバイスの適した使用状況をまとめた.

FingerPing: Recognizing Fine-grained Hand Poses using Active Acoustic On-body Sensing

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3174011

論文アブストラクト: FingerPing is a novel sensing technique that can recognize various fine-grained hand poses by analyzing acoustic resonance features. A surface-transducer mounted on a thumb ring injects acoustic chirps (20Hz to 6,000Hz) to the body. Four receivers distributed on the wrist and thumb collect the chirps. Different hand poses of the hand create distinct paths for the acoustic chirps to travel, creating unique frequency responses at the four receivers. We demonstrate how FingerPing can differentiate up to 22 hand poses, including the thumb touching each of the 12 phalanges on the hand as well as 10 American sign language poses. A user study with 16 participants showed that our system can recognize these two sets of poses with an accuracy of 93.77% and 95.64%, respectively. We discuss the opportunities and remaining challenges for the widespread use of this input technique.

日本語のまとめ:

FingerPingは画期的なセンシング技術である.親指に装着した装置から音響信号を人体に発生させ,その伝搬音の違いからジェスチャを認識する.12種の指骨と10種のジェスチャの認識に成功し,高い認識率を誇っている.

GestAKey: Touch Interaction on Individual Keycaps

論文URL: http://dl.acm.org/citation.cfm?doid=3173574.3174170

論文アブストラクト: Conventionally, keys on a physical keyboard have only two states: "released'' and "pressed''. As such, various techniques, such as hotkeys, are designed to enhance the keyboard expressiveness. Realizing that user inevitably perform touch actions during keystrokes, we propose GestAKey, leveraging location and motion of the touch on individual keycaps to augment the functionalities of existing keystrokes. With a log study, we collected touch data for both normal usage (typing and hotkeys) and while performing touch gestures (location and motion), which are analyzed to assess the viability of augmenting keystrokes with simultaneous gestures. A controlled experiment was conducted to compare GestAKey with existing keyboard interaction techniques, in terms of efficiency and learnability. The results show that GestAKey has comparable performance with hotkey. We further discuss the insights of integrating such touch modality into existing keyboard interaction, and demonstrate several usage scenarios.

日本語のまとめ:

ホットキーなどキーボード入力をより便利にする方法があるが,今回はGestAKeyという「キータッチ+指を動かす」という入力方法を検討した.様々な使用場面を想定して既存の入力方法と比較を行い,その実装可能性を議論した.