An Online-Updating Approach on Task Recommendation in Crowdsourcing Systems
Refereed conference paper presented and published in conference proceedings


Times Cited
Altmetrics Information
.

Other information
AbstractIn crowdsourcing systems, task recommendation can help workers to find their right tasks faster as well as help requesters to receive good quality output quicker. A number of previous works adopted active learning for task recommendation in crowdsourcing systems to achieve certain accuracy with a very low cost. However, the model updating methods in previous works are not suitable for real-world applications. In our paper, we propose a generic online-updating method for learning a factor analysis model, ActivePMF on TaskRec (Probabilistic Matrix Factorization with Active Learning on Task Recommendation Framework), for crowdsourcing systems. The larger the profile of a worker (or task) is, the less important is retraining its profile on each new work done. In case of the worker (or task) having large profile, our algorithm only retrains the whole feature vector of the worker (or task) and keeps all other entries in the matrix fixed. Besides, our algorithm runs batch update to further improve the performance. Experiment results show that our online-updating approach is accurate in approximating to a full retrain while the average runtime of model update for each work done is reduced by more than 90 % (from a few minutes to several seconds).
All Author(s) ListMan-Ching Yuen, Irwin King, Kwong-Sak Leung
Name of ConferenceInternational Conference on Neural Information Processing
Start Date of Conference16/10/2016
End Date of Conference21/10/2016
Place of ConferenceKyoto
Country/Region of ConferenceJapan
Proceedings TitleLecture Notes in Computer Science
Year2016
Month9
Volume Number9947
Pages91 - 101
ISBN978-3-319-46686-6
eISBN978-3-319-46687-3
ISSN0302-9743
LanguagesEnglish-United Kingdom
KeywordsCrowdsourcing, Task recommendation

Last updated on 2020-23-11 at 01:36