Facilitating Collocated Crowdsourcing on Situated Displays

Simo Hosio, Jorge Goncalves, Niels van Berkel, Simon Klakegg, Shinichi Konomi, Vassilis Kostakos

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Online crowdsourcing enables the distribution of work to a global labor force as small and often repetitive tasks. Recently, situated crowdsourcing has emerged as a complementary enabler to elicit labor in specific locations and from specific crowds. Teamwork in online crowdsourcing has been recently shown to increase the quality of output, but teamwork in situated crowdsourcing remains unexplored. We set out to fill this gap. We present a generic crowdsourcing platform that supports situated teamwork and provide experiences from a laboratory study that focused on comparing traditional online crowdsourcing to situated team-based crowdsourcing. We built a crowdsourcing desk that hosts three networked terminal displays. The displays run our custom team-driven crowdsourcing platform that was used to investigate collocated crowdsourcing in small teams. In addition to analyzing quantitative data, we provide findings based on questionnaires, interviews, and observations. We highlight 1) emerging differences between traditional and collocated crowdsourcing, 2) the collaboration strategies that teams exhibited in collocated crowdsourcing, and 3) that a priori team familiarity does not significantly affect collocated interaction in crowdsourcing. The approach we introduce is a novel multi-display crowdsourcing setup that supports collocated labor teams and along with the reported study makes specific contributions to situated crowdsourcing research.

Original languageEnglish
Pages (from-to)335-371
Number of pages37
JournalHuman-Computer Interaction
Volume33
Issue number5-6
DOIs
Publication statusPublished - Sep 4 2018

Fingerprint

Crowdsourcing
Display devices
Personnel

All Science Journal Classification (ASJC) codes

  • Applied Psychology
  • Human-Computer Interaction

Cite this

Hosio, S., Goncalves, J., van Berkel, N., Klakegg, S., Konomi, S., & Kostakos, V. (2018). Facilitating Collocated Crowdsourcing on Situated Displays. Human-Computer Interaction, 33(5-6), 335-371. https://doi.org/10.1080/07370024.2017.1344126

Facilitating Collocated Crowdsourcing on Situated Displays. / Hosio, Simo; Goncalves, Jorge; van Berkel, Niels; Klakegg, Simon; Konomi, Shinichi; Kostakos, Vassilis.

In: Human-Computer Interaction, Vol. 33, No. 5-6, 04.09.2018, p. 335-371.

Research output: Contribution to journalArticle

Hosio, S, Goncalves, J, van Berkel, N, Klakegg, S, Konomi, S & Kostakos, V 2018, 'Facilitating Collocated Crowdsourcing on Situated Displays', Human-Computer Interaction, vol. 33, no. 5-6, pp. 335-371. https://doi.org/10.1080/07370024.2017.1344126
Hosio, Simo ; Goncalves, Jorge ; van Berkel, Niels ; Klakegg, Simon ; Konomi, Shinichi ; Kostakos, Vassilis. / Facilitating Collocated Crowdsourcing on Situated Displays. In: Human-Computer Interaction. 2018 ; Vol. 33, No. 5-6. pp. 335-371.
@article{5d35ecf63a6042bc919f6513e191223d,
title = "Facilitating Collocated Crowdsourcing on Situated Displays",
abstract = "Online crowdsourcing enables the distribution of work to a global labor force as small and often repetitive tasks. Recently, situated crowdsourcing has emerged as a complementary enabler to elicit labor in specific locations and from specific crowds. Teamwork in online crowdsourcing has been recently shown to increase the quality of output, but teamwork in situated crowdsourcing remains unexplored. We set out to fill this gap. We present a generic crowdsourcing platform that supports situated teamwork and provide experiences from a laboratory study that focused on comparing traditional online crowdsourcing to situated team-based crowdsourcing. We built a crowdsourcing desk that hosts three networked terminal displays. The displays run our custom team-driven crowdsourcing platform that was used to investigate collocated crowdsourcing in small teams. In addition to analyzing quantitative data, we provide findings based on questionnaires, interviews, and observations. We highlight 1) emerging differences between traditional and collocated crowdsourcing, 2) the collaboration strategies that teams exhibited in collocated crowdsourcing, and 3) that a priori team familiarity does not significantly affect collocated interaction in crowdsourcing. The approach we introduce is a novel multi-display crowdsourcing setup that supports collocated labor teams and along with the reported study makes specific contributions to situated crowdsourcing research.",
author = "Simo Hosio and Jorge Goncalves and {van Berkel}, Niels and Simon Klakegg and Shinichi Konomi and Vassilis Kostakos",
year = "2018",
month = "9",
day = "4",
doi = "10.1080/07370024.2017.1344126",
language = "English",
volume = "33",
pages = "335--371",
journal = "Human-Computer Interaction",
issn = "0737-0024",
publisher = "Taylor and Francis Ltd.",
number = "5-6",

}

TY - JOUR

T1 - Facilitating Collocated Crowdsourcing on Situated Displays

AU - Hosio, Simo

AU - Goncalves, Jorge

AU - van Berkel, Niels

AU - Klakegg, Simon

AU - Konomi, Shinichi

AU - Kostakos, Vassilis

PY - 2018/9/4

Y1 - 2018/9/4

N2 - Online crowdsourcing enables the distribution of work to a global labor force as small and often repetitive tasks. Recently, situated crowdsourcing has emerged as a complementary enabler to elicit labor in specific locations and from specific crowds. Teamwork in online crowdsourcing has been recently shown to increase the quality of output, but teamwork in situated crowdsourcing remains unexplored. We set out to fill this gap. We present a generic crowdsourcing platform that supports situated teamwork and provide experiences from a laboratory study that focused on comparing traditional online crowdsourcing to situated team-based crowdsourcing. We built a crowdsourcing desk that hosts three networked terminal displays. The displays run our custom team-driven crowdsourcing platform that was used to investigate collocated crowdsourcing in small teams. In addition to analyzing quantitative data, we provide findings based on questionnaires, interviews, and observations. We highlight 1) emerging differences between traditional and collocated crowdsourcing, 2) the collaboration strategies that teams exhibited in collocated crowdsourcing, and 3) that a priori team familiarity does not significantly affect collocated interaction in crowdsourcing. The approach we introduce is a novel multi-display crowdsourcing setup that supports collocated labor teams and along with the reported study makes specific contributions to situated crowdsourcing research.

AB - Online crowdsourcing enables the distribution of work to a global labor force as small and often repetitive tasks. Recently, situated crowdsourcing has emerged as a complementary enabler to elicit labor in specific locations and from specific crowds. Teamwork in online crowdsourcing has been recently shown to increase the quality of output, but teamwork in situated crowdsourcing remains unexplored. We set out to fill this gap. We present a generic crowdsourcing platform that supports situated teamwork and provide experiences from a laboratory study that focused on comparing traditional online crowdsourcing to situated team-based crowdsourcing. We built a crowdsourcing desk that hosts three networked terminal displays. The displays run our custom team-driven crowdsourcing platform that was used to investigate collocated crowdsourcing in small teams. In addition to analyzing quantitative data, we provide findings based on questionnaires, interviews, and observations. We highlight 1) emerging differences between traditional and collocated crowdsourcing, 2) the collaboration strategies that teams exhibited in collocated crowdsourcing, and 3) that a priori team familiarity does not significantly affect collocated interaction in crowdsourcing. The approach we introduce is a novel multi-display crowdsourcing setup that supports collocated labor teams and along with the reported study makes specific contributions to situated crowdsourcing research.

UR - http://www.scopus.com/inward/record.url?scp=85028859288&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028859288&partnerID=8YFLogxK

U2 - 10.1080/07370024.2017.1344126

DO - 10.1080/07370024.2017.1344126

M3 - Article

AN - SCOPUS:85028859288

VL - 33

SP - 335

EP - 371

JO - Human-Computer Interaction

JF - Human-Computer Interaction

SN - 0737-0024

IS - 5-6

ER -