Policy learning using modified learning vector quantization for reinforcement learning problems

Ahmad Afif Mohd Faudzi, Junichi Murata

Research output: Contribution to journalArticle

Abstract

Reinforcement learning (RL) enables an agent tofind an optimal solution to a problem by interacting with the environment. In the previous research, Q-learning, one of the popular learning methods in RL, is used to generate a policy. From it, abstract policy is extracted by LVQ algorithm. In this paper, the aim is to train the agent to learn an optimal policy from scratch as well as to generate the abstract policy in a single operation by LVQ algorithm. When applying LVQ algorithm in a RL frame- work, due to an erroneous teaching signal in LVQ algorithm, the learning sometimes end up with failure or with non-optimal solution. Here, a new LVQ algorithm is proposed to overcome this problem. The new LVQ algorithm introduce, first, a regular reward that is obtained by the agent autonomously based on its behavior and second, a function that convert a regular reward to a new reward so that the learning system does not suffer from an undesirable effect by a small reward. Through these modifications, the agent is expected to find the optimal solution more efficiently.

Original languageEnglish
Pages (from-to)1-6
Number of pages6
JournalResearch Reports on Information Science and Electrical Engineering of Kyushu University
Volume20
Issue number2
Publication statusPublished - Jul 1 2015

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Electrical and Electronic Engineering

Cite this