Catching web crawlers in the act
This paper recommends a new approach to the detection and containment of Web crawler traverses based on clickstream data mining. Timely detection prevents crawler abusive consumption of Web server resources and eventual site contents privacy or copyrights violation. Clickstream data differentiation...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | conferencePaper |
| Language: | eng |
| Published: |
2006
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1822/72111 |
| Country: | Portugal |
| Oai: | oai:repositorium.sdum.uminho.pt:1822/72111 |