Efficient partitioning strategies for distributed web crawling

This paper presents a multi-objective approach to Web space partitioning, aimed to improve distributed crawling efficiency. The investigation is supported by the construction of two different weighted graphs. The first is used to model the topological communication infrastructure between crawlers an...

Full description

Bibliographic Details
Main Author: Exposto, José (author)
Other Authors: Macedo, Joaquim (author), Pina, António Manuel Silva (author), Alves, Albano Agostinho Gomes (author), Rufino, José (author)
Format: conferencePaper
Language:eng
Published: 2008
Subjects:
Information retrieval
Multi-objective
Crawling
Web space
Online Access:http://hdl.handle.net/1822/19420
Country:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/19420

Internet

http://hdl.handle.net/1822/19420

Similar Items