PEAK XOOPS - googlebot and protector in englishin japanese

googlebot and protector

  • You cannot open a new topic into this forum
  • Guests cannot post into this forum
Previous post - Next post | Parent - Children.1 | Posted on 2006/10/16 6:19
3lr0n  ÆóÅùʼ   Posts: 8
Hi GiJ first my congrats for so cool module.

Second i want to ask a question, i had observed many "CRAWLER ATTACKS" on my installed protector module log, i took a look to the ips (all were 62.249.72.x) and realized this is googlebot, dor example the host for 66.249.72.140 is crawl-66-249-72-140.googlebot.com located in Mountain View (California).

I checked the allowed crawlers and have this in my settings /(msnbot|Googlebot|Yahoo! Slurp)/i

My question is.. the caps affect this? i mean its the same Googlebot and googlebot (real host name)? its protector module blocking googlebot crawler?

Ta in advance
Votes:0 Average:0.00
Previous post - Next post | Parent - No child | Posted on 2006/10/20 6:19
GIJOE  ÀèǤ·³Áâ   Posts: 4110
Quote:
3lr0n wrote:
Second i want to ask a question, i had observed many "CRAWLER ATTACKS" on my installed protector module log, i took a look to the ips (all were 62.249.72.x) and realized this is googlebot, dor example the host for 66.249.72.140 is crawl-66-249-72-140.googlebot.com located in Mountain View (California).
Do you have the access log of apache?

Perhaps, the googlebot had accessed without UserAgent contains "Googlebot".
If you know the IP range of googlebot, add them into reliable IP.

eg)
127.0.0.1|66.249.72.

Votes:0 Average:0.00

  Advanced search


Login
Username or e-mail:

Password:

Remember Me

Lost Password?

Register now!