crawler##.googlebot.com

Corporal Joined: Dec 24, 2003 Posts: 61

hey did anyone else get tons of visitors around 12am GMT i noticed them in protector, also noticed a few other sites got the exact same thing, some more than others, i noticed protectors website got tons of them all the bloody same "64.68.xxx.xxx"< crawler##.googlebot.com (## neing a random number)

im not sure if this is somthing i should worry about,

i also got a hack attempt in the same day, thanks hacked@damardan.net who ever you are. i bet you feel realy stupid now dont ya cause you couldnt get my site Very Happy

Posted: Fri Aug 06, 2004 2:02 pm

You have nothing to worry about. Google sometimes sends multiple bots to sites, most likely it was Google trying to update all their indexes all at one time. In fact, I had several yahoobots (10-13) visit my site at one time. What you can do is set Protector to exclude any ip in the googlebot.com range. That way they aren't logged. You can do that by going to maintenance in Protector, and following the instructions to exclude.

Corporal Joined: Dec 24, 2003 Posts: 61

cool thanks if its not alot to worry about i dont think ill bother banning the ip range, i got 9 bots btw, protector hompage had maybe 20 somthin or more

Posted: Fri Aug 06, 2004 4:16 pm

Andy1984 wrote:

cool thanks if its not alot to worry about i dont think ill bother banning the ip range, i got 9 bots btw, protector hompage had maybe 20 somthin or more

What I mentioned is that you can exclude googlebots from being logged. Not the same as banning them. When you exclude it just makes it so they are not logged, or reported depending on how you want to call it. GoogleBots are harmless unless they are visiting parts of your site that are supposed to be denied access in robots.txt.