I got hammered with spiderbots showing up in the ADMIN SECURE tracking log all using the same IP accept for the last numbers....what are they.?
Should I ban it?
what are my options to deal with this?
Evaders99 Site Admin
Joined: Aug 17, 2003
Posts: 12397
Posted:
Sun Nov 14, 2004 1:46 pm
They are automated processes that 'spider' your website. Normally these are such things as search engines. They will look through your website links and index them, so you can find them on search engines such as Google.
Most bots are good. However, some are used by spammers and others to harvest emails and so forth. You can use Admin Secure's configuration to stop all known bots, however search engines will not be able to index your site either.
I agree bots are good - when a web business relies on traffic, been found by the search engines is vital.
There are mods such as googletap which with it's .htaccess allows/restricts certain bots, similarly there is sential - which will keep away unwanted email harvesters.
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
