Details

Autor(en) / Beteiligte

• Tak, Mandy J. W.
• Winands, Mark H. M.
• Bjornsson, Yngvi

Titel

Decaying Simulation Strategies

Ist Teil von

• IEEE transactions on computational intelligence and AI in games., 2014-12, Vol.6 (4), p.395-406

Ort / Verlag

Piscataway: IEEE

Erscheinungsjahr

2014

Link zum Volltext

• IEEE_Xplore

Quelle

IEEE/IET Electronic Library (IEL)

Beschreibungen/Notizen

• The aim of general game playing (GGP) is to create programs capable of playing a wide range of different games at an expert level, given only the rules of the game. The most successful GGP programs currently employ simulation-based Monte Carlo tree search (MCTS). The performance of MCTS depends heavily on the simulation strategy used. In this paper, we investigate the application of a decay factor for two domain-independent simulation strategies: the N-gram selection technique (NST) and the move-average sampling technique (MAST). Three decay factor methods, called move decay, batch decay, and simulation decay, are applied. Furthermore, a combination of move decay and simulation decay is also tested. The decay variants are implemented in the GGP program CadiaPlayer. Four types of games are used: turn taking, simultaneous move, one player, and multiplayer. Except for one-player games, experiments show that decaying can significantly improve the performance of both NST and MAST simulation strategies.