Efficient partitioning strategies for distributed Web crawling

This paper presents a multi-objective approach to Web space partitioning, aimed to improve distributed crawling efficiency. The in- vestigation is supported by the construction of two different weighted graphs. The first is used to model the topological communication infras- tructure between crawler...

Full description

Bibliographic Details
Main Author: Exposto, José (author)
Other Authors: Macedo, Joaquim (author), Pina, António Manuel Silva (author), Alves, Albano Agostinho Gomes (author), Amaro, José Carlos Rufino (author)
Format: conferencePaper
Language:eng
Published: 2007
Subjects:
Databases
Computer communications and networks
Online Access:http://hdl.handle.net/1822/6634
Country:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/6634

Internet

http://hdl.handle.net/1822/6634

Similar Items