Monthly
288 pp. per issue
6 x 9, illustrated
ISSN
0899-7667
E-ISSN
1530-888X
2014 Impact factor:
2.21

Neural Computation

May 2015, Vol. 27, No. 5, Pages 1102-1119
(doi: 10.1162/NECO_a_00730)
© 2015 Massachusetts Institute of Technology
Input-Anticipating Critical Reservoirs Show Power Law Forgetting of Unexpected Input Events
Article PDF (385.13 KB)
Abstract

Usually reservoir computing shows an exponential memory decay. This letter investigates under which circumstances echo state networks can show a power law forgetting. That means traces of earlier events can be found in the reservoir for very long time spans. Such a setting requires critical connectivity exactly at the limit of what is permissible according to the echo state condition. However, for general matrices, the limit cannot be determined exactly from theory. In addition, the behavior of the network is strongly influenced by the input flow. Results are presented that use certain types of restricted recurrent connectivity and anticipation learning with regard to the input, where power law forgetting can indeed be achieved.