References
- Ye , S. , Lu , G. and Li , X. Workload-aware Web crawling and server workload detection . Network Research Workshop, 18th Asian Pacific Advanced Network Meeting . 2004 . July . http://www.csif.cs.ucdavis.edu/∼yeshao/apan04.pdf(Feb. 18, 2006)
- Dikaiakos , M. , Stassopoulous , A. and Papageorgiou , L. 2005 . An investigation of Web crawler behavior: characterization and metrics . Comput Commun , 28 ( 8 ) : 808 – 897 .
- Dikaiakos , M. , Stassopoulous , A. and Papageorgiou , L. 2003 . Characterizing crawler behavior from Web server access logs . Lect Notes Comput Sci , 2738 : 369 – 378 .
- Tan , P. and Kumar , V. 2002 . Discovery of Web robots sessions based on their navigational patterns . Data Min Knowl Discov , 6 ( 1 ) : 9 – 35 .
- Koster , M. 1995 . Robots in the web: threat or treat? , http://www.robotstxt.org/wc/threat-or-treat.html(Feb. 18, 2006)