Ensembles of artificial neural networks with heterogeneous topologies

Within the Machine Learning field, the emergence of ensembles, combinations of learning models, has been boosting the performance of several algorithms. Under this context, Artificial Neural Networks (ANNs) make a fruitful arena, once they are inherently stochastic. In this work, ensembles of ANNs a...

ver descrição completa

Detalhes bibliográficos
Autor principal: Rocha, Miguel (author)
Outros Autores: Cortez, Paulo (author), Neves, José (author)
Formato: conferencePaper
Idioma:eng
Publicado em: 2004
Assuntos:
Texto completo:http://hdl.handle.net/1822/425
País:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/425
Descrição
Resumo:Within the Machine Learning field, the emergence of ensembles, combinations of learning models, has been boosting the performance of several algorithms. Under this context, Artificial Neural Networks (ANNs) make a fruitful arena, once they are inherently stochastic. In this work, ensembles of ANNs are approached, being used several output combination methods and two heuristic ensemble construction strategies. These were applied to real world classification and regression tasks. The results reveal some improvements of ensembles over single ANNs, favoring the combination of ANNs with distinct complexity (topologies) and the weighted averaging of the outputs as the combination method. The proposed approach is also able to perform automatic model selection.