Natural gradient actor-critic algorithms using random rectangular coarse coding

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Learning performance of natural gradient actor-critic algorithms is outstanding especially in high-dimensional spaces than conventional actor-critic algorithms. However, representation issues of stochastic policies or value functions are remaining because the actor-critic approaches need to design it carefully. The author has proposed random rectangular coarse coding, that is very simple and suited for approximating Q-values in high-dimensional state-action space. This paper shows a quantitative analysis of the random coarse coding comparing with regular-grid approaches, and presents a new approach that combines the natural gradient actor-critic with the random rectangular coarse coding.

Original languageEnglish
Title of host publicationProceedings of SICE Annual Conference 2008 - International Conference on Instrumentation, Control and Information Technology
Pages2027-2034
Number of pages8
DOIs
Publication statusPublished - Dec 1 2008
EventSICE Annual Conference 2008 - International Conference on Instrumentation, Control and Information Technology - Tokyo, Japan
Duration: Aug 20 2008Aug 22 2008

Publication series

NameProceedings of the SICE Annual Conference

Other

OtherSICE Annual Conference 2008 - International Conference on Instrumentation, Control and Information Technology
CountryJapan
CityTokyo
Period8/20/088/22/08

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Natural gradient actor-critic algorithms using random rectangular coarse coding'. Together they form a unique fingerprint.

  • Cite this

    Kimura, H. (2008). Natural gradient actor-critic algorithms using random rectangular coarse coding. In Proceedings of SICE Annual Conference 2008 - International Conference on Instrumentation, Control and Information Technology (pp. 2027-2034). [4654995] (Proceedings of the SICE Annual Conference). https://doi.org/10.1109/SICE.2008.4654995