Efficient partitioning strategies for distributed web crawling
This paper presents a multi-objective approach toWeb space partitioning, aimed to improve distributed crawling efficiency. The in- vestigation is supported by the construction of two different weighted graphs. The first is used to model the topological communication infras- tructure between crawlers...
Autor principal: | |
---|---|
Outros Autores: | , , , |
Formato: | conferenceObject |
Idioma: | eng |
Publicado em: |
2011
|
Texto completo: | http://hdl.handle.net/10198/4406 |
País: | Portugal |
Oai: | oai:bibliotecadigital.ipb.pt:10198/4406 |