绿色学院 - Green Institute - 不听人间乐 - 想得到 - 做得到 - Xoops
Apache 日志 分析/研究
by Emerald
绿色学院 - Green Institute
一、
站点访问日志
C:\Program Files\Apache Group\Apache2\logs\access.log 文件
01.
crawl-66-249-66-166.googlebot.com - - [15/Feb/2005:08:32:41 +0800] "GET /uploads/thumbs/1045.jpg HTTP/1.1" 403 286
上面的信息很明显了,是一个 Google bot.
不过这个日志文件记录了图片的访问信息,因为这个是我以前的LOG,
可以在Apache 中配置不记录对图片的请求写入日志文件中,
修改 CustomLog logs/access_log common 为下面的内容:
##############################################################
SetEnvIf Request_URI \.gif image-request
SetEnvIf Request_URI \.jpg image-request
SetEnvIf Request_URI \.png image-request
SetEnvIf Request_URI \.jpeg image-request
CustomLog logs/access_log common env=!image-request
# 避免对图片的请求出现在访问日志中
##############################################################
02.
shawl - E [15/Feb/2005:00:13:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=32&refer=&page=http://gi.2288.org:88/ HTTP/1.1" 200 -
计算机名为 Shawl ，登入服务器站点的用户名为 E ,接着是把用户信息写入一个统计程序。
03.
220.198.201.83 - - [16/Feb/2005:13:59:02 +0800] "GET /modules/wfdownloads/down22-139.htm HTTP/1.1" 200 47724
IP -- 访问时间 - 请求方式为 GET ，访问页面 /modules/wfdownloads/down22-139.htm ，协议为 HTTP/1.1
04.
crawl-66-249-64-13.googlebot.com - - [16/Feb/2005:14:12:30 +0800] "GET /robots.txt HTTP/1.0" 403 274
Googlebot 在读取 robots.txt的信息，以确定访问内容和访问权限。
05.
lj1145.inktomisearch.com - - [16/Feb/2005:14:16:33 +0800] "GET /robots.txt HTTP/1.0" 403 273
一个水货 bot 在访问站点。
lj1342.inktomisearch.com - - [16/Feb/2005:14:16:39 +0800] "GET /modules/myalbum/photo.php?lid=901&cid=34 HTTP/1.0" 200 46331
访问的页面。
06.
一位普通访客的访问信息：
218.15.245.42 - - [16/Feb/2005:14:20:50 +0800] "GET /modules/myalbum/photo1533-30.htm HTTP/1.1" 200 46327
218.15.245.42 - - [16/Feb/2005:14:20:47 +0800] "GET /modules/myalbum/photo1812-23.htm HTTP/1.1" 200 46530
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /xoops.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /images/logo.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/images/arrow-8.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/images/160.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /modules/myalbum/images/folder16.gif HTTP/1.1" 200 341
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /modules/myalbum/images/folder_open.gif HTTP/1.1" 200 233
218.15.245.42 - - [16/Feb/2005:14:21:04 +0800] "GET /xoops.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:03 +0800] "GET /uploads/photos/1812.jpg HTTP/1.1" 200 103135
218.15.245.42 - - [16/Feb/2005:14:21:05 +0800] "GET /images/icons/pm_small.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /images/s_poweredby.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:04 +0800] "GET /modules/myalbum/images/newred.gif HTTP/1.1" 200 376
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=32&refer=http%3A//gi.2288.org%3A88/&page=http://gi.2288.org:88/modules/myalbum/photo1812-23.htm HTTP/1.1" 200 -
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /themes/Emerald-G/images/arrow-l.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /modules/myalbum/<{$xoops_imageurl}>logo.gif HTTP/1.1" 403 312
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /uploads/thumbs/190.jpg HTTP/1.1" 200 9053
07.
Spider 在扒窃中:
60.176.195.255 - - [17/Feb/2005:23:15:42 +0800] "GET / HTTP/1.1" 200 73837
60.176.195.255 - - [17/Feb/2005:23:15:45 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 200 19894
60.176.195.255 - - [17/Feb/2005:23:15:47 +0800] "GET /include/xoops.js HTTP/1.1" 200 17698
60.176.195.255 - - [17/Feb/2005:23:15:50 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/ HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:16:50 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:16:50 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:16:50 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:16:48 +0800] "GET / HTTP/1.1" 200 73837
60.176.195.255 - - [17/Feb/2005:23:16:51 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/ HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:17:10 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:08 +0800] "GET /modules/news/article_472.htm HTTP/1.1" 200 43996
60.176.195.255 - - [17/Feb/2005:23:17:13 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:13 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:14 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/modules/news/article_472.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:17:14 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:12 +0800] "GET /modules/news/article_230.htm HTTP/1.1" 200 46519
60.176.195.255 - - [17/Feb/2005:23:17:15 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:15 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:15 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/modules/news/article_230.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:17:38 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:36 +0800] "GET /modules/news/article_223.htm HTTP/1.1" 200 45204
60.176.195.255 - - [17/Feb/2005:23:17:40 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:40 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:41 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88&page=http://gi.2288.org:88/modules/news/article_223.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:18:05 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:18:05 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:18:05 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:18:03 +0800] "GET /modules/news/article_468.htm HTTP/1.1" 200 44773
60.176.195.255 - - [17/Feb/2005:23:18:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/news/article_223.htm&page=http://gi.2288.org:88/modules/news/article_468.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:20:03 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:20:03 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:20:04 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:20:01 +0800] "GET /modules/AMS/article_67.htm HTTP/1.1" 200 45349
60.176.195.255 - - [17/Feb/2005:23:20:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/news/article_468.htm&page=http://gi.2288.org:88/modules/AMS/article_67.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:21:18 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:21:18 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:21:18 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:21:16 +0800] "GET /modules/AMS/article_65.htm HTTP/1.1" 200 52030
60.176.195.255 - - [17/Feb/2005:23:21:19 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/AMS/article_67.htm&page=http://gi.2288.org:88/modules/AMS/article_65.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:24:27 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:24:27 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:24:28 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:24:26 +0800] "GET /modules/news/article_457.htm HTTP/1.1" 200 44337
60.176.195.255 - - [17/Feb/2005:23:24:28 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/AMS/article_65.htm&page=http://gi.2288.org:88/modules/news/article_457.htm HTTP/1.1" 200 -
二、
站点错误日志
*:\Apache\dummy-gi.2288.org.88-error_log
01. 恶意用户
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 218.15.88.109] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0, referer: http://gi.2288.org:88/
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 221.225.97.15] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0, referer: http://www.blogcn.com/user15/btbtd/index.html
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
IP 为 202.108.1.2 的用户在试图更改一些设置。
02.
搜索引擎在收录页面，
[Fri Feb 04 21:15:30 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/images/logo.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/uploads/thumbs/148.jpg, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-l.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/rate0.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/reviews.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/images/s_poweredby.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-8.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/downloads.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:26:25 2005] [error] [client 68.142.251.165] client denied by server configuration: I:/gi-2288/robots.txt
应该是 Google台湾, 但遭到拒绝访问图片，和访问文本文件。
03.
[Fri Feb 04 21:54:50 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/news/wordpress
[Fri Feb 04 21:54:54 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/news/wordpress
那家伙又来了，但输入的目录是错误目录，地址不存在。
04.
一个正常用户的访问，客户端应该没有启用 Cookies
[Fri Feb 04 21:55:55 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/logo.gif
[Fri Feb 04 21:55:56 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:56 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:57 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:58 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:59 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:59 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:00 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:01 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:01 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:02 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:03 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:03 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:04 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:05 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:05 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:06 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:07 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:07 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/modules/xmline/images/xmline.png
[Fri Feb 04 21:56:08 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:09 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:10 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/thumbs/1278.jpg
[Fri Feb 04 21:56:10 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:11 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:12 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:12 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:13 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:14 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:14 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:15 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:16 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:19 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:20 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/s_poweredby.gif
[Fri Feb 04 21:56:20 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
所以被拒绝访问图片（服务器拒绝图片外部链接）。
05.
[Fri Feb 04 22:03:56 2005] [error] [client 66.196.90.161] client denied by server configuration: I:/gi-2288/robots.txt
[Fri Feb 04 22:10:17 2005] [error] [client 66.196.91.51] File does not exist: I:/gi-2288/modules/myalbum/wordpress
[Fri Feb 04 22:11:21 2005] [error] [client 66.196.91.58] File does not exist: I:/gi-2288/modules/AMS/wordpress
[Fri Feb 04 22:18:16 2005] [error] [client 66.196.90.227] File does not exist: I:/gi-2288/modules/news/wordpress
[Fri Feb 04 22:41:40 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/myalbum/wordpress
[Fri Feb 04 22:42:03 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/myalbum/wordpress
[Fri Feb 04 22:42:25 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/xphpbbi/wordpress
[Fri Feb 04 22:42:52 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/xphpbbi/wordpress
看来问题不小，错误目录。。。
06.
文件不存在，坏链接，事实上页面存在，但是这是一个框架页。
[Sat Feb 05 00:16:27 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:29 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:29 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:29 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:31 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
这就是为什么框架页搜索引擎收录不理想的原因了。
07.
Google 俄罗斯在扒窃页面。
[Sat Feb 05 05:01:41 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/images/logo.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:42 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/downloads.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:43 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:44 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/reviews.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:45 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/rate0.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:45 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-8.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:45 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/uploads/thumbs/148.jpg, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:46 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:48 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/images/s_poweredby.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:50 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-l.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
同样地被拒绝访问图片。
[Sat Feb 05 05:04:54 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip
[Sat Feb 05 05:05:03 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:13 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:19 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:22 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:25 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:31 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
试图下载 .zip文件，但被拒绝。
[client 195.19.252.183] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
被禁止访问了。
08.
bot 访问进程
[Sat Feb 05 05:11:58 2005] [error] [client 66.196.90.161] client denied by server configuration: I:/gi-2288/robots.txt
试图获取 robots.txt文件，但被拒绝。（我都不知道这样是好还是不好，不过还好没什么重要目录，比较重要在Apache加个密码就行）
[Sat Feb 05 06:01:49 2005] [error] [client 66.196.91.36] File does not exist: I:/gi-2288/modules/cdbase
Googlebot 在核对以前的内容。这个目录不存在，这就意味着在不久会被删除链接。
[Sat Feb 05 06:12:10 2005] [error] [client 66.196.90.161] client denied by server configuration: I:/gi-2288/robots.txt
又被拒绝访问 robots.txt。
[Sat Feb 05 06:22:48 2005] [error] [client 66.196.90.241] File does not exist: I:/gi-2288/modules/wordbook/wordpress
[Sat Feb 05 06:24:06 2005] [error] [client 66.196.90.207] File does not exist: I:/gi-2288/modules/newbb/wordpress
[Sat Feb 05 06:26:53 2005] [error] [client 66.196.91.20] File does not exist: I:/gi-2288/modules/cdbase
[Sat Feb 05 06:34:05 2005] [error] [client 66.196.91.19] File does not exist: I:/gi-2288/modules/cdbase
错误目录。
三、其它
01. 如何知道站点什么时候被 Spider扒窃?
这个其实很简单(Apache), 只要为站点建立日志文件就可以知道 搜索引擎是什么时候收录站点的了.
ErrorLog "G:/Apache/dummy-gi.2288.org.88-error_log"
不过我的作法可能有点另类,
因为我把 .txt文件全部都限制了,意思是:只有在本地链接中链过去的 .txt文件才允许被访问,
所以 Spider访问的时候会在站点日志中看到出错提示.
[Tue Feb 15 12:13:44 2005] [error] [client 66.249.64.77] client denied by server configuration: I:/zh-2288-66/robots.txt
这是虚拟主机中的第一个 robots.txt错误提示,也就是这个时候搜索引擎收录了该站点.
限制外部链接的内容:
SetEnvIfNoCase Referer "^http://gi.2288.org:88/" local_ref=1
<FilesMatch ".(gif|jpg|png|jpeg|zip|rar|exe|swf|txt)">
Order Allow,Deny
Allow from env=local_ref
</FilesMatch>
/****************************************************************
*
* author : Emerald<btbtd@yahoo.com.cn>
*
* homepage : http://gi.2288.org:88/
*
* Seo-Gi : http://seo.2288.org:99
*
* sitename : 绿色学院 - Green Institute
*
* date : 2005-01-24
*
\****************************************************************/
