The theoretical approach to the search for a global extremum in the training of neural networks

• Published in: Trudy Instituta sistemnogo programmirovaniâ Vol. 31; no. 2; pp. 41 - 52
• Main Authors: Vershkov, N.N., Kuchukov, V.A., Kuchukova, N.N.
• Format: Journal Article
• Language: English
• Published: Ivannikov Institute for System Programming of the Russian Academy of Sciences 01-06-2019
• Subjects: искусственные нейронные сети; корреляционная функция; спектральный анализ
• ISSN: 2079-8156; 2220-6426
• DOI: 10.15514/ISPRAS-2019-31(2)-4

The article deals with the search for the global extremum in the training of artificial neural networks using the correlation index. The proposed method is based on a mathematical model of an artificial neural network, represented as an information transmission system. The efficiency of the proposed model is confirmed by its broad application in information transmission systems for analyzing and recovering the useful signal against the background of various interferences: Gaussian, concentrated, pulsed, etc. The analysis of the convergence of training and experimentally obtained sequences based on the correlation index is carried out. The possibility of estimating the convergence of the training and experimentally obtained sequences by the cross-correlation function as a measure of their energy similarity (difference) is confirmed. To evaluate the proposed method, a comparative analysis is carried out with the currently used target indicators. Possible sources of errors of the least squares method and the possibility of the proposed index to overcome them are investigated.