VoxPL: Programming with the Wisdom of the Crowd

論文URL:http://dl.acm.org/citation.cfm?doid=3025453.3026025

論文アブストラクト:Having a crowd estimate a numeric value is the original inspiration for the notion of "the wisdom of the crowd." Quality control for such estimated values is challenging because prior, consensus-based approaches for quality control in labeling tasks are not applicable in estimation tasks. We present VoxPL, a high-level programming framework that automatically obtains high-quality crowdsourced estimates of values. The VoxPL domain-specific language lets programmers concisely specify complex estimation tasks with a desired level of confidence and budget. VoxPL's runtime system implements a novel quality control algorithm that automatically computes sample sizes and obtains high quality estimates from the crowd at low cost. To evaluate VoxPL, we implement four estimation applications, ranging from facial feature recognition to calorie counting. The resulting programs are concise---under 200 lines of code---and obtain high quality estimates from the crowd quickly and inexpensively.

日本語のまとめ:

群衆の知恵を活用し,統計的に推定値を求めるフレームワークの提案。評価のために画像からのカロリー推定などの4つのアプリケーションを実装。200行以下の短いコードで迅速かつ高品質な推定値が手に入る。

(97文字)

発表スライド: