A strategy for converging dynamic action policies

A strategy for converging dynamic action policies

Ribeiro, Richardson and Borges, Andre P. and Koerich, Alessandro L. and Scalabrin, Edson E. and Enembreck, Fabricio

2009 IEEE Symposium on Intelligent Agents, IA 2009 – Proceedings 2009

Abstract : In this paper we propose a novel strategy for converging dynamic policies generated by adaptive agents, which receive and accumulate rewards for their actions. The goal of the proposed strategy is to speed up the convergence of such agents to a good policy in dynamic environments. Since it is difficult to have the good value for a state due to the continuous changing in the environment, previous policies are kept in memory for reuse in future policies, avoiding delays or unexpected speedups in the agent’s learning. Experimental results on dynamic environments with different policies have shown that the proposed strategy is able to speed up the convergence of the agent while achieving good action policies. ©2009 IEEE.