Efficient partitioning strategies for distributed web crawling
This paper presents a multi-objective approach to Web space partitioning, aimed to improve distributed crawling efficiency. The investigation is supported by the construction of two different weighted graphs. The first is used to model the topological communication infrastructure between crawlers an...
| Autor principal: | |
|---|---|
| Outros Autores: | , , , |
| Formato: | conferencePaper |
| Idioma: | eng |
| Publicado em: |
2008
|
| Assuntos: | |
| Texto completo: | http://hdl.handle.net/1822/19420 |
| País: | Portugal |
| Oai: | oai:repositorium.sdum.uminho.pt:1822/19420 |