Solution over-fit control in evolutionary multiobjective optimization of pattern classification systems
Solution over-fit control in evolutionary multiobjective optimization of pattern classification systems
Radtke, Paulo V.W. and Wong, Tony and Sabourin, Robert
International Journal of Pattern Recognition and Artificial Intelligence 2009
Abstract : The optimization of many engineering systems is challenged by the solution over-fit to the data set used to evaluate potential solutions during the evolutionary process. The solution over-fit phenomenon is hard to detect and is especially prevalent in problems involving example-based training, such as pattern feature selection and pattern classifier design. For these applications, uncontrolled over-fit can lead to biased features being extracted and degraded classifier generalization abilities. This paper details the performance of a solution over-fit control strategy used in the multiobjective evolutionary optimization of a multileveled classification system. This control, embedded within a solution validation procedure, minimizes the over-fit effects without modifying the dominance relation used in the processing of candidate solutions. Extensive experimental analysis using multiobjective genetic and memetic algorithms demonstrates both the need and the efficiency of the proposed over-fit control for pattern classification systems optimization. © 2009 World Scientific Publishing Company.
