Help Please Google Tap .htaccess 403 forbidden

Nuke Cops Founder Joined: Nov 14, 2002 Posts: 5939

Yes what you found is called GoogleTap, it rewrites the php links to shorter html links.

Posted: Tue Jul 01, 2003 8:42 pm

No, I mean this sort of stuff:

Quote:

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Alexibot [OR]
RewriteCond %{HTTP_USER_AGENT} ^asterias [OR]
RewriteCond %{HTTP_USER_AGENT} ^BackDoorBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^Black.Hole [OR]
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
RewriteCond %{HTTP_USER_AGENT} ^BlowFish [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^BotALot [OR]
etc.etc.

Nuke Soldier Joined: Jul 01, 2003 Posts: 13

You can download google tap (get latest version) from the downloads section of this site. After unzipping, you will see Nuke 5.x and 6.x versions. Look in the correct folder. The file called htaccess.txt would need to be uploaded to the server and renamed to .htaccess

Look in each of the files for directions about what to do. In my humble opinion, Google Tap is more of a hack than an add-on or module, but you can download it under Downloads, phpnuke addons.

What Google Tap does is put the pages in a format (mostly *.html looking pages) that Google (and other search engines) will index. It's important if you want your site seen, because you are likely to just get your index.php page indexed without it (no forums, articles, etc) if you are using Nuke.

Google doesn't like meta refreshes or redirects, and will reject them as spam. This is a method many companies use to get their dynamically generated pages listed in the engines. It looks like amazon.com and ebay do something similar to get their stuff listed, but I don't know for sure.

Enough rambling, I've been working on this Google Tap install for too long. (even got it to work with some of my custom script.) Thanks nukecops, this script works brilliantly.

Nuke Soldier Joined: Jul 01, 2003 Posts: 13

I have seen some stuff like that on the web reading up on .htaccess, that would allow you to give a search engine another page, a redirect, or ban them if you don't want them indexing your site, but I can't remember exactly where.

The apache site has great information though at:

http://httpd.apache.org/docs/mod/mod_rewrite.html

I saw a ban list that I might employ at a later date (that looks like what you are wanting) at:

http://www.internet-tips.net/Webmaster/htaccess_rewrite.htm

If you are going to try to redirect to give google or others alternate pages, They might be able to cross-check with a different HTTP_USER_AGENT and see that you are cloaking (Is that what it's called?), and put you on some kind of ban list. I don't really know, just guessing.

Hope something above is useful.

Nuke Cops Founder Joined: Nov 14, 2002 Posts: 5939

Ahh, that stuff. That's the bad bot code. Are you searching for the whole list?

Posted: Wed Jul 02, 2003 1:04 pm

Yes, I would like to be able to download the 'bad bot' list with the correct syntax.