Meta-learning and the new challenges of machine learning

In the last years, organizations and companies in general have found the true potential value of collecting and using data for supporting decision-making. As a consequence, data are being collected at an unprecedented rate. This poses several challenges, including, for example, regarding the storage...

Full description

Bibliographic Details
Main Author: Monteiro, Jose Pedro (author)
Other Authors: Ramos, Diogo (author), Carneiro, Davide (author), Duarte, Francisco J. (author), Fernandes, João M. (author), Novais, Paulo (author)
Format: article
Language:eng
Published: 2021
Subjects:
Online Access:https://hdl.handle.net/1822/78001
Country:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/78001
Description
Summary:In the last years, organizations and companies in general have found the true potential value of collecting and using data for supporting decision-making. As a consequence, data are being collected at an unprecedented rate. This poses several challenges, including, for example, regarding the storage and processing of these data. Machine Learning (ML) is also not an exception, in the sense that algorithms must now deal with novel challenges, such as learn from streaming data or deal with concept drift. ML engineers also have a harder task when it comes to selecting the most appropriate model, given the wealth of algorithms and possible configurations that exist nowadays. At the same time, training time is a stronger restriction as the computational complexity of the training model increases. In this paper we propose a framework for dealing with these challenges, based on meta-learning. Specifically, we tackle two well-defined problems: automatic algorithm selection and continuous algorithm updates that do not require the retraining of the whole algorithm to adapt to new data. Results show that the proposed framework can contribute to ameliorate the identified issues.