In order to provide an additional incentive or even avoid paying clickworkers, the concept of gamification, i.e., the usage of games or game elements in non-game contexts, has been exploited a lot in this domain. This particular form of crowdsourcing is called playsourcing. Playsourcing refers to the usage of games with high numbers of players - such as online and smartphone games - for solving real world problems. Probably the most popular examples for the application of playsourcing to scientific problems so far are the games "FoldIt", "nanocrafter", and "play to cure". Recently, there have been the first attempts to use crowdsourcing also in the area of computer vision and pattern recognition.
In this seminar we will discuss several principles as well as application examples of gamification in the context of crowdsourcing - with a particular focus on computer vision.
Due to three students dropping out we might switch to this schedule which is still tentative. I will inform you about this topic in a separate e-mail.
(1) Luis Von Ahn and Laura Dabbish. Designing games with a purpose. Communications of the ACM 51.8 (2008): 58-67.
(2) Catherine Wah. Crowdsourcing and Its Applications in Computer Vision. technical report (2011).
(3) Gabe Zichermann and Christopher Cunningham. Gamification by design: Implementing game mechanics in web and mobile apps. O'Reilly (2011).
(4) Greg Little, Lydia B. Chilton, Max Goldman, Robert C. Miller. TurKit?: Human Computation Algorithms on Mechanical Turk. Proceedings of the 23nd annual ACM symposium on User interface software and technology (2010).
(5) Richard Souvenir et al. Gamesourcing to acquire labeled human pose estimation data. Computer Vision and Pattern Recognition Workshops (CVPRW), 2012 IEEE Computer Society Conference on , vol., no., pp.1-6, 16-21 June 2012.
(6) Michael Wilber, Sam Kwak, Serge Belongie. Cost-Effective HITs for Relative Similarity Comparisons. Workshop on Computer Vision and Human Computation at CVPR (2014).
(7) Carl Vondrick, Hamed Pirsiavash, Aude Oliva, Antonio Torralba. Acquiring Visual Classfiers from Human Imagination. Workshop on Computer Vision and Human Computation at CVPR (2014).
(8) Crowd Truth Project.
(9) Lafourcade, Mathieu , and Joubert, Alain and Le Brun, Nathalie. Games with a Purpose (Gwaps). Wiley (2015)
(10) Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popović, Foldit players (2010). Predicting protein structures with a multiplayer online game. Nature 446 p. 756-760 (2010).
(11) Ferran Cabezas, Axel Carlier, Amaia Salvador, Xavier Giró-i-Nieto, Vincent Charvillat. Quality Control in Crowdsourced Object Segmentation. Preprint (2015).
(13) Play to cure: Genes in space
(14) Ejaz Ahmed, Subhransu Maji, Gregory Shakhnarovich, Larry Davis. Using Human Knowledge to Judge Part Goodness: Interactive Part Selection. Workshop on Computer Vision and Human Computation at CVPR (2014).
(15) Catherine Wah, Grant Van Horn, Steven Branson, Subhransu Maji, Pietro Perona, Serge Belongie. Similarity Comparisons for Interactive Fine-Grained Categorization. Workshop on Computer Vision and Human Computation at CVPR (2014).
(16) Emmanouil Giannisakis, Henrik Hautop Lund. Combining playware exergaming with a mobile fitness app. Journal of Robotics, Networks and Artificial Life (2015)
(17) Mateusz Malinowski, Marcus Rohrbach, Mario Fritz. Ask Your Neurons: A Neural-based Approach to Answering Questions about Images. ICCV (2015)
(18) Rob Tieben, Janienke Sturm, Tilde Bekker, Ben Schouten. Playful persuasion : designing for ambient playful interactions in public spaces. Journal of Ambient Intelligence and Smart Environments (2014)
(19) Ashwinkumar Badanidiyuru, Robert Kleinberg, Aleksandrs Slivkins. Bandits with Knapsacks: Dynamic procurement for crowdsourcing. The 3rd Workshop on Social Computing and User Generated Content, NIPS (2013)
(20) Tilde Bekker, Ben Schouten, Mark de Graaf. Designing interactive tangible games for diverse forms of play. In M.C. Angelides (Ed.), Handbook of digital games (2014)
(21) Nicole Immorlica, Greg Stoddard, and Vasilis Syrgkanis. Social Status and the Design of Optimal Badges. The 3rd Workshop on Social Computing and User Generated Content, NIPS (2013)
TeachingForm | |
---|---|
Title: | Crowdsourcing and Gamification with Applications to Computer Vision (IN0014, IN2107) |
Professor: | Dr. Maximilian Baust and Dr. Stefanie Demirci |
Tutors: | |
Type: | Hauptseminar |
Information: | |
Term: | 2016SoSe |
Abstract: |