Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Bio-Algorithms and Med-Systems

Editor-in-Chief: Roterman-Konieczna , Irena

CiteScore 2017: 0.43

SCImago Journal Rank (SJR) 2017: 0.160
Source Normalized Impact per Paper (SNIP) 2017: 0.223

See all formats and pricing
More options …

Use of the Free to Play model in games with a purpose: the RoboCorp game case study

Dagmara Dziedzic
  • Corresponding author
  • Department of Logic and Cognitive Science, Adam Mickiewicz University, ul. H. Wieniawskiego 1, Poznań, Poland
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
Published Online: 2016-11-23 | DOI: https://doi.org/10.1515/bams-2016-0020


This article presents the RoboCorp game. RoboCorp is a game with a purpose aimed at facilitating the annotation process of a natural language data. What makes this game unique and novel is the use of various mechanisms known from the popular Free to Play model to provide a fun and attractive gameplay. These mechanisms are presented and described in detail in the context of RoboCorp. The obtained annotation results are discussed and compared to other similar annotation tools available.

Keywords: corpus data annotation; crowdsourcing; Free to Play; game with a purpose; gamification


  • 1.

    Wissler L, Almashraee M, Monett D, Paschkeg A. The gold standard in corpus annotation. In: Proceedings of the 5th IEEE Germany Students Conference, Germany, 2014.Google Scholar

  • 2.

    Law E, von Ahn L. Human Computation. San Rafael, California: Morgan and Claypool Publishers, 2011.Google Scholar

  • 3.

    Snow R, O’Connor B, Jurafsky D, Ng AY. Cheap and fast – but is it good? Evaluating non-expert annotations for natural language tasks. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. Honolulu, 2008: 254–63.Google Scholar

  • 4.

    Zaidan OF, Callison-Burch C. Crowdsourcing translation: professional quality from non-professionals. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, vol. 1, 2011: 1220–8.Google Scholar

  • 5.

    Hong Y, Kwak H, Baek Y, Moon S. Tower of Babel: a crowdsourcing game building sentiment lexicons for resource-scarce languages. In: Proceedings of the 22nd International Conference on World Wide Web Companion, 2013:549–56.Google Scholar

  • 6.

    von Ahn L. Games with a purpose. Computer 2006;39:92–4Google Scholar

  • 7.

    von Ahn L, Dabbish L. Designing games with a purpose. Commun ACM 2008;51:58–67.Google Scholar

  • 8.

    Lee T, Dugan C, Geyer W, Ratchford T, Rasmussen J, Shami N, et al. Experiments on motivational feedback for crowdsourced workers. In: Proceedings of the 7th International AAAI Conference on Weblogs and Social Media, North America, 2013:341–50.Google Scholar

  • 9.

    Poesio M, Chamberlain J, Kruschwitz U, Robaldo L, Ducceschi L. Phrase detectives: utilizing collective intelligence for internet-scale language resource creation. Trans Interact Intelll Syst 2013;3:1–44.Google Scholar

  • 10.

    Venhuizen N, Basile V, Evang K, Bos J. Gamification for word sense labeling. In: Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013), Short Papers, 2013:397–403.Google Scholar

  • 11.

    Jurgens D, Navigli R. It’s all fun and games until someone annotates: video games with a purpose for linguistic annotation. Trans Assoc Comput Linguist 2014;2:445–64.Google Scholar

  • 12.

    Kleka P, Łupkowski P. Gamifying science – the issue of data validation. Homo Ludens 2014;6:45–54.Google Scholar

  • 13.

    Cooper S, Khatib F, Treuille A, Barbero J, Lee J, Beenen M, et al. Predicting protein structures with a multiplayer online game. Nature 2010;466:756–60.Google Scholar

  • 14.

    Bohannon J. Online video game plugs players into remote- controlled biochemistry lab. Science 2014;343:475.Google Scholar

  • 15.

    Mäyrä F. Mobile games. In: Mansell R, Ang PH, editors. International Encyclopedia of Digital Communication and Society. Chichester, UK: John Wiley and Sons, Inc., 2015.Google Scholar

  • 16.

    Luton W. Free2Play. Making money from games you give away. San Francisco, California: New Riders, 2013.Google Scholar

  • 17.

    Waszczuk J, Głowińska K, Savary A, Przepiórkowski A, Lenart M. Annotation tools for syntax and named entities in the National Corpus of Polish. Int J Data Mining Modell Manage 2013;5:103–22.Google Scholar

About the article

Received: 2016-10-06

Accepted: 2016-11-02

Published Online: 2016-11-23

Published in Print: 2016-12-01

Citation Information: Bio-Algorithms and Med-Systems, Volume 12, Issue 4, Pages 187–197, ISSN (Online) 1896-530X, ISSN (Print) 1895-9091, DOI: https://doi.org/10.1515/bams-2016-0020.

Export Citation

©2016 Walter de Gruyter GmbH, Berlin/Boston.Get Permission

Comments (0)

Please log in or register to comment.
Log in