Monthly
288 pp. per issue
6 x 9, illustrated
ISSN
0899-7667
E-ISSN
1530-888X
2014 Impact factor:
2.21

Neural Computation

September 1, 2005, Vol. 17, No. 9, Pages 2006-2033
(doi: 10.1162/0899766054322982)
© 2005 Massachusetts Institute of Technology
Fluctuation-Dissipation Theorem and Models of Learning
Article PDF (194.55 KB)
Abstract

Advances in statistical learning theory have resulted in a multitude of different designs of learning machines. But which ones are implemented by brains and other biological information processors? We analyze how various abstract Bayesian learners perform on different data and argue that it is difficult to determine which learning-theoretic computation is performed by a particular organism using just its performance in learning a stationary target (learning curve). Based on the fluctuation-dissipation relation in statistical physics, we then discuss a different experimental setup that might be able to solve the problem.