Understanding the SNN input parameters and how they affect the clustering results

Huge amounts of data are available for analysis in nowadays organizations, which are facing several challenges when trying to analyze the generated data with the aim of extracting useful information. This analytical capability needs to be enhanced with tools capable of dealing with big data sets wit...

ver descrição completa

Detalhes bibliográficos
Autor principal: Moreira, Guilherme (author)
Outros Autores: Santos, Maribel Yasmina (author), Pires, João Moura (author), Galvão, João Rui Magalhães Velho da Cunha (author)
Formato: article
Idioma:eng
Publicado em: 2015
Assuntos:
Texto completo:http://hdl.handle.net/1822/36795
País:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/36795
Descrição
Resumo:Huge amounts of data are available for analysis in nowadays organizations, which are facing several challenges when trying to analyze the generated data with the aim of extracting useful information. This analytical capability needs to be enhanced with tools capable of dealing with big data sets without making the analytical process an arduous task. Clustering is usually used in the data analysis process, as this technique does not require any prior knowledge about the data. However, clustering algorithms usually require one or more input parameters that influence the clustering process and the results that can be obtained. This work analyses the relation between the three input parameters of the SNN (Shared Nearest Neighbor) clustering algorithm, providing a comprehensive understanding of the relationships that were identified between k, Eps and MinPts, the algorithm’s input parameters. Moreover, this work also proposes specific guidelines for the definition of the appropriate input parameters, optimizing the processing time, as the number of trials needed to achieve appropriate results can be substantial reduced.