Modeling Convention Emergence by Observation with Memorization
Refereed conference paper presented and published in conference proceedings

Times Cited
Altmetrics Information

Other information
AbstractConvention emergence studies how global convention arises from local interactions among agents. Traditionally, the studies on convention emergence are conducted by means of agent-based simulations, whereas very few studies are based on model-based approaches. In this paper, we employ model-based approach to study the convention emergence by observation with memorization in a large population under social learning. In particular, we derive the recurrence equations of the population dynamic, which is the evolution of action distribution over time, under the external majority (EM) strategy. The recurrence equations precisely predict the behaviour of the multi-agent system at any time point, which is verified with the agent-based simulations. Based on the recurrence equations, We prove the converge behavior under various situations and work out the optimal memory length under different number of actions. Finally, we show that the EM strategy outperforms other popular strategies such as Q-learning and Highest Cumulative Reward (HCR) in convergence speed under social learning, even in very large convention space.
All Author(s) ListChin-wing Leung, Shuyue Hu, Ho-fung Leung
Name of ConferenceThe 16th Pacific Rim International Conference on Artificial Intelligence
Start Date of Conference26/08/2019
End Date of Conference30/08/2019
Place of ConferenceCuvu
Country/Region of ConferenceFiji
Proceedings TitleLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume Number11670
Pages733 - 745
LanguagesEnglish-United States

Last updated on 2020-04-08 at 01:02