An hybrid training method for B-spline neural networks

Current and past research has brought up new views related to the optimization of neural networks. For a fixed structure, second order methods are seen as the most promising. From previous works we have shown how second order methods are of easy applicability to a neural network. Namely, we have pro...

ver descrição completa

Detalhes bibliográficos
Autor principal: Cabrita, Cristiano Lourenço (author)
Outros Autores: Botzheim, J. (author), Ruano, Antonio (author), Kóczy, László T. (author)
Formato: conferenceObject
Idioma:eng
Publicado em: 2013
Assuntos:
Texto completo:http://hdl.handle.net/10400.1/2235
País:Portugal
Oai:oai:sapientia.ualg.pt:10400.1/2235
Descrição
Resumo:Current and past research has brought up new views related to the optimization of neural networks. For a fixed structure, second order methods are seen as the most promising. From previous works we have shown how second order methods are of easy applicability to a neural network. Namely, we have proved how the Levenberg-Marquard possesses not only better convergence but how it can assure the convergence to a local minima. However, as any gradient-based method, the results obtained depend on the startup point. In this work, a reformulated Evolutionary algorithm - the Bacterial Programming for Levenberg-Marquardt is proposed, as an heuristic which can be used to determine the most suitable starting points, therefore achieving, in most cases, the global optimum.