Odd Leaf Out: Improving visual recognition with games

Odd Leaf Out provides players with an enjoyable and educational game that serves the purpose of identifying misclassification errors in a large database of labeled leaf images. The game uses a novel mechanism to solicit useful information from players’ incorrect answers. A study of 165 players showed that game data can be used to identify mislabeled leaves much more quickly than would have been possible using a computer vision algorithm alone. Domain novices and experts were equally good at identifying mislabeled images, although domain experts enjoyed the game more. In this paper, authors discuss the successes and challenges of this new game, which can be applied to other domains with labeled image datasets.

Direct link to article: http://hcil.cs.umd.edu/trs/2011-17/2011-17.pdf