The Viuva Negra crawler
This report discusses architectural aspects of web crawlers and details the design, implementation and evaluation of the Viuva Negra (VN) crawler. VN has been used for 4 years, feeding a search engine and an archive of the Portuguese web. In our experiments it crawled over 2 million documents per da...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | report |
| Language: | por |
| Published: |
2009
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/10451/14117 |
| Country: | Portugal |
| Oai: | oai:repositorio.ul.pt:10451/14117 |