Google Tap and Sim Spider makes interesting results. (huh)

Lieutenant Joined: Jan 23, 2003 Posts: 258 Location: USA

CHeck this link out and run your site...

http://www.searchengineworld.com/cgi-bin/sim_spider.cgi

I am confused at the results...

It returns links like... http://article21.html/ and http://forums.html/

I don't understand...

Lieutenant Joined: Jan 23, 2003 Posts: 258 Location: USA

Is the spider not getting the URL when it makes the link?

Major Joined: Jan 13, 2003 Posts: 892

Rewrites don't work with SSL either something folks might want to be aware of before investing a lot of time into this. Imagine there should be some way to work around that just haven't tinkered out how yet...

Major Joined: Jan 13, 2003 Posts: 892

I should add Imago's teqnique (Googlfier) works better on your example spider. Try one of his sites or www.glowoptics.com for example.

Lieutenant Joined: Jan 23, 2003 Posts: 258 Location: USA

Everything works fine if you submit a FULL URL.

NOT LIKE:

Code:

http://www.mywebsite.com

LIKE THIS:

Code:

http://www.mywebsite.com/

Wow, I have to resubmit my site to all those fricken search engines....