Monthly
288 pp. per issue
6 x 9, illustrated
ISSN
0899-7667
E-ISSN
1530-888X
2014 Impact factor:
2.21

Neural Computation

Winter 1990, Vol. 2, No. 4, Pages 523-535
(doi: 10.1162/neco.1990.2.4.523)
© 1990 Massachusetts Institute of Technology
Phase Transitions in Connectionist Models Having Rapidly Varying Connection Strengths
Article PDF (598.12 KB)
Abstract

A phase transition in a connectionist model refers to a qualitative change in the model's behavior as parameters determining the spread of activation (gain, decay rate, etc.) pass through certain critical values. As connectionist methods have been increasingly adopted to model various problems in neuroscience, artificial intelligence, and cognitive science, there has been an increased need to understand and predict these phase transitions to assure meaningful model behavior. This paper extends previous results on phase transitions to encompass a class of connectionist models having rapidly varying connection strengths (“fast weights”). Phase transitions are predicted theoretically and then verified through a series of computer simulations. These results broaden the range of connectionist models for which phase transitions are identified and lay the foundation for future studies comparing models with rapidly varying and slowly varying connection strengths.