RMIT University
Browse

Task assignment in microtask crowdsourcing platforms using learning automata

journal contribution
posted on 2024-11-02, 07:49 authored by Alireza Moayedikia, Kok-Leong OngKok-Leong Ong, Yee Ling BooYee Ling Boo, William Yeoh
Conventional microtask crowdsourcing platforms rely on a random task distribution strategy and repeatedly assign tasks to workers. This strategy known as repeated labelling suffers from two shortcomings of high cost and low accuracy as a result of making random distributions. To overcome such shortcomings researchers have introduced task assignment as a substitute strategy. In this strategy, an algorithm selectively chooses suitable tasks for an online worker. Hence, task assignment has gained attentions from researchers to reduce the cost of microtasking whiling increasing its accuracy. However, the existing algorithms on task assignment suffer from four shortcomings as: (i) human intervention, (ii) reliance on a rough estimation of ground truth, (iii) reliance on workers' dynamic capabilities and (iv) lack of ability in dealing with sparsity. To overcome these shortcomings this paper proposes a new task assignment algorithm known as LEarning Automata based Task assignment (LEATask), that works based on the similarities of workers in performance. This algorithm has two stages of exploration and exploitation. In exploration stage, first a number of workers are hired to learn their reliability. Then, LEATask clusters the hired workers using a given clustering algorithm, and for each cluster generates learning automata. Later, the clusters of workers along with their attached learning automata will be used in exploitation stage. Exploitation stage initially assigns a number of tasks to a newly arrived worker to learn the worker's reliability. Then, LEATask identifies the cluster of worker. Based on the cluster that worker resides in and the attached learning automata, the next tasks will be assigned to the new worker. LEATask has been empirically evaluated using several real datasets and compared against the baseline and novel algorithms, in terms of root mean square error. The comparisons indicates LEATask consistently is showing better or comparable performance.

History

Related Materials

  1. 1.
    DOI - Is published in 10.1016/j.engappai.2018.06.008
  2. 2.
    ISSN - Is published in 09521976

Journal

Engineering Applications of Artificial Intelligence

Volume

74

Start page

212

End page

225

Total pages

14

Publisher

Elsevier

Place published

United Kingdom

Language

English

Copyright

© 2018 Elsevier Ltd. All rights reserved.

Former Identifier

2006085429

Esploro creation date

2020-06-22

Fedora creation date

2018-10-25

Usage metrics

    Scholarly Works

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC