288 pp. per issue
6 x 9, illustrated
2014 Impact factor:

Neural Computation

Winter 1990, Vol. 2, No. 4, Pages 409-419
(doi: 10.1162/neco.1990.2.4.409)
© 1990 Massachusetts Institute of Technology
Active Perception and Reinforcement Learning
Article PDF (527.87 KB)

This paper considers adaptive control architectures that integrate active sensorimotor systems with decision systems based on reinforcement learning. One unavoidable consequence of active perception is that the agent's internal representation often confounds external world states. We call this phenomenon perceptual aliasing and show that it destabilizes existing reinforcement learning algorithms with respect to the optimal decision policy. A new decision system that overcomes these difficulties is described. The system incorporates a perceptual subcycle within the overall decision cycle and uses a modified learning algorithm to suppress the effects of perceptual aliasing. The result is a control architecture that learns not only how to solve a task but also where to focus its attention in order to collect necessary sensory information.