MIT CogNet, The Brain Sciences ConnectionFrom the MIT Press, Link to Online Catalog
SPARC Communities
Subscriber : Stanford University Libraries » LOG IN

space

Powered By Google 
Advanced Search

 

Phase Diagram and Storage Capacity of Sequence Storing Neural Networks

 A. During, A.C.C. Coolen and D. Sherrington
  
 

Abstract:
We solve the dynamics of Hopfield-type neural networks which store sequences of patterns, close to saturation. The asymmetry of the interaction matrix in such models leads to violation of detailed balance, ruling out an equilibrium statistical mechanical analysis. Using generating functional methods we derive exact closed equations for dynamical order parameters, viz. the sequence overlap and correlation and response functions, in the limit of an infinite system size. We calculate the time translation invariant solutions of these equations, describing stationary limit--cycles, which leads to a phase diagram. The effective retarded self-interaction usually appearing in symmetric models is here found to vanish, which causes a significantly enlarged storage capacity of alphac=0.269, compared to alphac=0.139 for Hopfield networks storing static patterns. Our results are tested against extensive computer simulations and excellent agreement is found.

 
 


© 2010 The MIT Press
MIT Logo