Evolving ARTMAP neural networks using multi-objective particle swarm optimization
Evolving ARTMAP neural networks using multi-objective particle swarm optimization
Granger, Eric and Prieur, Donavan and Connolly, Jean François
2010 IEEE World Congress on Computational Intelligence, WCCI 2010 – 2010 IEEE Congress on Evolutionary Computation, CEC 2010 2010
Abstract : In this paper, a supervised learning strategy based on a Multi-Objective Particle Swarm Optimization (MOPSO) is introduced for ARTMAP neural networks. It is based on the concept of neural network evolution in that particles of a MOPSO swarm (i.e., network solutions) seek to determine user-defined parameters and network (weights and architecture) such that generalisation error and network resources are minimized. The performance of this strategy has been assessed with fuzzy ARTMAP using synthetic and real-world data for video-based face classification. Simulation results indicate that when the MOPSO strategy is used to train fuzzy ARTMAP, it produces a significantly lower classification error than when trained using standard hyper-parameter settings. Furthermore, the non-dominated MOPSO solutions represent a better compromise between error and resource allocation than mono-objective PSO-based strategies that minimizes only classification error. Overall, results obtained with the MOPSO strategy reveal the importance of optimizing parameters and network for each problem, where both error and resources are minimized during fitness evaluation. © 2010 IEEE.
