A hybrid training method for B-spline neural networks

Current and past research has brought up new views related to the optimization of neural networks. For a fixed structure, second order methods are seen as the most promising. From previous works we have shown how second order methods are of easy applicability to a neural network. Namely, we have pro...

ver descrição completa

Detalhes bibliográficos
Autor principal: Cabrita, Cristiano Lourenço (author)
Outros Autores: Botzheim, J. (author), Ruano, Antonio (author), Kóczy, László T. (author)
Formato: article
Idioma:por
Publicado em: 2009
Assuntos:
Texto completo:http://hdl.handle.net/10400.1/87
País:Portugal
Oai:oai:sapientia.ualg.pt:10400.1/87
Descrição
Resumo:Current and past research has brought up new views related to the optimization of neural networks. For a fixed structure, second order methods are seen as the most promising. From previous works we have shown how second order methods are of easy applicability to a neural network. Namely, we have proved how the Levenberg-Marquard possesses not only better convergence but how it can assure the convergence to a local minima. However, as any gradient-based method, the results obtained depend on the startup point. In this work, a reformulated Evolutionary algorithm - the Bacterial Programming for Levenberg-Marquardt is proposed, as an heuristic which can be used to determine the most suitable starting points, therefore achieving, in most cases, the global optimum.