Human computation games for commonsense data verification

Games With A Purpose (or GWAP) provide an effective way to collect data from web users. As the data grow over time, it becomes increasingly important to verify the data collected. This research explores the design of two games, Top10 and Pirate & Ghost, for verification of sentences in our Common Sense Knowledge Base (CSKB) collected via the Virtual Pets game. Top10 is a single-player game, in which the player attempts to guess the top answers to a given question. The frequency of common answers is used as the verification. Pirate & Ghost is a multi-player role-playing game, in which players cooperate to navigate to a target. The common routes are used to verify relations among concepts in the CSKB. This paper presents the experiments to evaluate the performance of each game, and shows how the games can be coupled to achiever higher efficiency and precision.