Efficient partitioning strategies for distributed web crawling
This paper presents a multi-objective approach toWeb space partitioning, aimed to improve distributed crawling efficiency. The in- vestigation is supported by the construction of two different weighted graphs. The first is used to model the topological communication infras- tructure between crawlers...
| Main Author: | |
|---|---|
| Other Authors: | , , , |
| Format: | conferenceObject |
| Language: | eng |
| Published: |
2011
|
| Online Access: | http://hdl.handle.net/10198/4406 |
| Country: | Portugal |
| Oai: | oai:bibliotecadigital.ipb.pt:10198/4406 |