Emergent synthesis of motion patterns for locomotion robots

M. M. Svinin, K. Yamada, K. Ueda

Research output: Contribution to journalArticlepeer-review

14 Citations (Scopus)

Abstract

Emergence of stable gaits in locomotion robots is studied in this paper. A classifier system, implementing an instance-based reinforcement-learning scheme, is used for the sensory-motor control of an eight-legged mobile robot and for the synthesis of the robot gaits. The robot does not have a priori knowledge of the environment and its own internal model. It is only assumed that the robot can acquire stable gaits by learning how to reach a goal area. During the learning process the control system is self-organized by reinforcement signals. Reaching the goal area defines a global reward. Forward motion gets a local reward, while stepping back and falling down get a local punishment. As learning progresses, the number of the action rules in the classifier systems is stabilized to a certain level, corresponding to the acquired gait patterns. Feasibility of the proposed self-organized system is tested under simulation and experiment. A minimal simulation model that does not require sophisticated computational schemes is constructed and used in simulations. The simulation data, evolved on the minimal model of the robot, is downloaded to the control system of the real robot. Overall, of 10 simulation data seven are successful in running the real robot.

Original languageEnglish
Pages (from-to)353-363
Number of pages11
JournalArtificial Intelligence in Engineering
Volume15
Issue number4
DOIs
Publication statusPublished - Oct 1 2001

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Engineering(all)

Fingerprint Dive into the research topics of 'Emergent synthesis of motion patterns for locomotion robots'. Together they form a unique fingerprint.

Cite this