Implementasi Sistem Crowdsourced Labelling Berbasis Web dengan Metode Weighted Majority Voting
Crowdsourced Labelling is a large scale data labelling process, solicits a large group of people to label the data, usually via Internet. This paper discusses about design and implementation of Web-based Crowdsourced Labelling. Supervised learning classification methods need labelled training data for its training phase. Unfortunately, in many cases, there aren’t any already available labelled training data. Large scale data labelling is a tedious and time consuming work. This research develops a web-based crowdsourced labelling which able to solicit a large group of people as data labeler to speed up the data labelling process. This system also allows multiple labeler for every data. The final label is calculated using Weighted Majority Voting method. We grabbed and used Facebook comments from the two candidates’ Facebook Page of 2014 Indonesian Presidential Election as testing data. Based on the testing conducted we can conclude that this system is able to handle all the labelling steps well and able to handle collision occurred when multiple labeler labelling a same data in the same time. The system successfully produces final label in CSV format, which can be processed further with many sentiment analysis tools or machine learning tools.
Index Terms - Crowdsources labeling, web-based system, supervised learning, weighted majority voting.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike International License (CC-BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Copyright without Restrictions
The journal allows the author(s) to hold the copyright without restrictions and will retain publishing rights without restrictions.
The submitted papers are assumed to contain no proprietary material unprotected by patent or patent application; responsibility for technical content and for protection of proprietary material rests solely with the author(s) and their organizations and is not the responsibility of the ULTIMA InfoSys or its Editorial Staff. The main (first/corresponding) author is responsible for ensuring that the article has been seen and approved by all the other authors. It is the responsibility of the author to obtain all necessary copyright release permissions for the use of any copyrighted materials in the manuscript prior to the submission.