Ensembles of artificial neural networks with heterogeneous topologies

Within the Machine Learning field, the emergence of ensembles, combinations of learning models, has been boosting the performance of several algorithms. Under this context, Artificial Neural Networks (ANNs) make a fruitful arena, once they are inherently stochastic. In this work, ensembles of ANNs a...

Full description

Bibliographic Details
Main Author: Rocha, Miguel (author)
Other Authors: Cortez, Paulo (author), Neves, José (author)
Format: conferencePaper
Language:eng
Published: 2004
Subjects:
Online Access:http://hdl.handle.net/1822/425
Country:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/425
Description
Summary:Within the Machine Learning field, the emergence of ensembles, combinations of learning models, has been boosting the performance of several algorithms. Under this context, Artificial Neural Networks (ANNs) make a fruitful arena, once they are inherently stochastic. In this work, ensembles of ANNs are approached, being used several output combination methods and two heuristic ensemble construction strategies. These were applied to real world classification and regression tasks. The results reveal some improvements of ensembles over single ANNs, favoring the combination of ANNs with distinct complexity (topologies) and the weighted averaging of the outputs as the combination method. The proposed approach is also able to perform automatic model selection.