Convergence Properties of an Online Learning Algorithm in Neural Network Models of Complex Systems

Abstract

Asymptotic behavior of the online gradient algorithm with a constant step size employed for learning in neural network models of nonlinear systems having hidden layer are studied. The sufficient conditions guaranteeing the convergence of this algorithm in the random environment are established