Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Experimental assessment of aggregation principles in argumentation-enabled collective intelligence

Awad, Edmond, Bonnefon, Jean-Francois, Caminada, Martin and Rahwan, Iyad 2017. Experimental assessment of aggregation principles in argumentation-enabled collective intelligence. ACM Transactions on Internet Technology 17 (3) , 29. 10.1145/3053371

[thumbnail of ACM_TOIT.pdf]
PDF - Accepted Post-Print Version
Download (1MB) | Preview


On the Web, there is always a need to aggregate opinions from the crowd (as in posts, social networks, forums, etc.). Different mechanisms have been implemented to capture these opinions such as Like in Facebook, Favorite in Twitter, thumbsup/ down, flagging, and so on. However, in more contested domains (e.g. Wikipedia, political discussion, and climate change discussion) these mechanisms are not sufficient since they only deal with each issue independently without considering the relationships between different claims.We can view a set of conflicting arguments as a graph in which the nodes represent arguments and the arcs between these nodes represent the defeat relation. A group of people can then collectively evaluate such graphs. To do this, the group must use a rule to aggregate their individual opinions about the entire argument graph. Here, we present the first experimental evaluation of different principles commonly employed by aggregation rules presented in the literature. We use randomized controlled experiments to investigate which principles people consider better at aggregating opinions under different conditions. Our analysis reveals a number of factors, not captured by traditional formal models, that play an important role in determining the efficacy of aggregation. These results help bring formal models of argumentation closer to real-world application.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Uncontrolled Keywords: Argumentation, Voting, Experiment
Publisher: Association for Computing Machinery
ISSN: 1533-5399
Date of First Compliant Deposit: 19 April 2017
Date of Acceptance: 30 January 2017
Last Modified: 02 Aug 2017 11:32

Citation Data

Cited 1 time in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item Edit Item


Downloads per month over past year

View more statistics