Efficient partitioning strategies for distributed Web crawling
This paper presents a multi-objective approach to Web space partitioning, aimed to improve distributed crawling efficiency. The in- vestigation is supported by the construction of two different weighted graphs. The first is used to model the topological communication infras- tructure between crawler...
| Autor principal: | |
|---|---|
| Outros Autores: | , , , |
| Formato: | conferencePaper |
| Idioma: | eng |
| Publicado em: |
2007
|
| Assuntos: | |
| Texto completo: | http://hdl.handle.net/1822/6634 |
| País: | Portugal |
| Oai: | oai:repositorium.sdum.uminho.pt:1822/6634 |