Geographical partition for distributed web crawling

This paper evaluates scalable distributed crawling by means of the geographical partition of the Web. The approach is based on the existence of multiple distributed crawlers each one responsible for the pages belonging to one or more previously identified geographical zones. The work considers a dis...

Full description

Bibliographic Details
Main Author: Exposto, José (author)
Other Authors: Macedo, Joaquim (author), Pina, António Manuel Silva (author), Alves, Albano Agostinho Gomes (author), Amaro, José Carlos Rufino (author)
Format: conferencePaper
Language:eng
Published: 2005
Subjects:
Online Access:http://hdl.handle.net/1822/6321
Country:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/6321