Open Access Open Access  Restricted Access Subscription or Fee Access

Back-Propagation vs Particle Swarm Optimization Algorithm: which Algorithm is better to adjust the Synaptic Weights of a Feed-Forward ANN?

Beatriz A. Garro, Humberto Sossa, Roberto A. Vázquez

Abstract


Bio-inspired algorithms have shown their usefulness in different non-linear opti-mization problems. Due to their efficiency and adaptability, these algorithms have been applied to a wide range of problems. In this paper we compare two ways of training an artificial neural network (ANN): Particle Swarm Optimization (PSO) algorithms against classical training algorithms such as: back-propagation (BP) and Levenberg Marquardt method. The main contribution of this paper is to answer the next question: is PSO really better than classical training algorithms in adjusting the synaptic weights of an ANN? First of all, we explain how the ANN training phase could be seen as an optimization problem. Then, it is explained how PSO could be applied to find the best synaptic weights of the ANN. Finally, we perform a comparison among different classical methods and PSO approach when an ANN is applied to different non-linear problems and to a real object recognition problem.

Keywords


Artificial neural networks, particle swarm intelligence, pattern recognition

Full Text:

PDF


Disclaimer/Regarding indexing issue:

We have provided the online access of all issues and papers to the indexing agencies (as given on journal web site). It’s depend on indexing agencies when, how and what manner they can index or not. Hence, we like to inform that on the basis of earlier indexing, we can’t predict the today or future indexing policy of third party (i.e. indexing agencies) as they have right to discontinue any journal at any time without prior information to the journal. So, please neither sends any question nor expects any answer from us on the behalf of third party i.e. indexing agencies.Hence, we will not issue any certificate or letter for indexing issue. Our role is just to provide the online access to them. So we do properly this and one can visit indexing agencies website to get the authentic information. Also: DOI is paid service which provided by a third party. We never mentioned that we go for this for our any journal. However, journal have no objection if author go directly for this paid DOI service.