Google Tap CVS Rev 1.6 Bugs

Posted: Tue Jul 22, 2003 4:14 am

I installed GT CVS Rev 1.6 last night. It seemed to be working fine.

Bug 1: Tonight, I was playing around with a sub-domain on my site, and I noticed my streaming Real Audio files had quit working. The Real Audio Player wouldn't recognize them as RA files and errored out everytime I tried to play one. Maybe .htaccess was redirecting the Real Audio Player to 'emailsforyou.php' instead of the .RAM file --- Hrm...

Bug 2: Later, I checked the error logs on my site, hoping to get a clue, and holy sh*t!!! MS-Analysis was freaking out. The log was FILLED with the following (repeating) pattern of errors...

Code:

[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier 'r' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '1' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '2' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '3' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '8' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier 'c' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191

This is line 191:

Code:

if( preg_match("/" . $value . "/i", $this->get_user_agent() ) )

This is the entire function:

Code:

/*****************************************************************/
/* */
/* function function chk_crawler() */
/* */
/*****************************************************************/
/* Compare agent string with a list of known web crawlers/robots */
/*****************************************************************/
function chk_crawler()
{
foreach( $this->robots as $value )
if( preg_match("/" . $value . "/i", $this->get_user_agent() ) )
return true;
return false;
}

I edited .htaccess and, if you'll pardon the pun, nuked the whole 'mail bot' section. The MS-Analysis errors have now ceased and the Real Audio files started streaming again.

Anyway, no big deal. I'm not complaining, just reporting. I appreciate all the effort you have put into this project ZX, but I thought I should let you know about these bugs, albeit specific to MS-Analysis and Real Audio...

Nuke Cops Founder Joined: Nov 14, 2002 Posts: 5939

For your subdomain create another .htaccess and disable rewriteengine thereby protecting it. Remember, .htaccess is per directory.

Not sure what to say right now on the mail bot section. That's the first I heard problems about.

Posted: Tue Jul 22, 2003 6:45 pm

Zhen-Xjell wrote:

For your subdomain create another .htaccess and disable rewriteengine thereby protecting it. Remember, .htaccess is per directory...

Yeah, that's what I was going to do, but it was one of those 'one-last-click-before-I-pass-out' things. I was trying to beat it to bed before the sun came up. Ever done that before? Wink

I'll let you know what happens...

Posted: Wed Jul 23, 2003 3:30 am

Zhen-Xjell wrote:

...Not sure what to say right now on the mail bot section. That's the first I heard problems about...

Problem[s] solved! I putzed around with CVS .htaccess 1.6 tonight, in between doing some other things.

The problem with MS-Analysis 1.0 turned out to be a seperate issue. Since it didn't have anything to do with .htaccess 1.6, like I originally thought, I'll spare you the details. Wink

However, the Real Audio errors WERE being caused by .htaccess 1.6. I tried adding another .htaccess file to the sub, but the problem with this is nested .htaccess files are mutually inclusive. That is, whatever applies in the parent directory also applies in each decendant (even if it isn't explicitly stated), unless you start turning things off, like you suggested doing.

Wanting to fix it right, I gave up on that idea and started removing the 'mail bot' directives from .htaccess 1.6, a few at a time and testing it. When I got past the R's the streaming Real Audio started working. This turned out to be the offending code:

Code:

RewriteCond %{HTTP_USER_AGENT} ^RMA [OR]

I reinstated all the code, minus that line, and now everything is working fine.

Posted: Wed Jul 23, 2003 3:48 am

Hrm... I just did a little research and 'RMA' is definitely the UA for RealPlayer. So, that solves the mystery, but begs a question; how the hell did that get in there??? Shocked

Nuke Cops Founder Joined: Nov 14, 2002 Posts: 5939

Nice catch!

Posted: Wed Jul 23, 2003 4:32 pm

Guess we can mark this one [solved] huh?

Private Joined: Sep 25, 2003 Posts: 49

VinDSL wrote:

Bug 2: Later, I checked the error logs on my site, hoping to get a clue, and holy sh*t!!! MS-Analysis was freaking out. The log was FILLED with the following (repeating) pattern of errors...

Code:

[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier 'r' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '1' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '2' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '3' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier '8' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191
[Tue Jul 22 06:25:02 2003] [error] PHP Warning: Unknown modifier 'c' in /home/xxxxxxx/public_html/modules/MS_Analysis/include/class.client.php on line 191

This is line 191:

Code:

if( preg_match("/" . $value . "/i", $this->get_user_agent() ) )

This is the entire function:

Code:

/*****************************************************************/
/* */
/* function function chk_crawler() */
/* */
/*****************************************************************/
/* Compare agent string with a list of known web crawlers/robots */
/*****************************************************************/
function chk_crawler()
{
foreach( $this->robots as $value )
if( preg_match("/" . $value . "/i", $this->get_user_agent() ) )
return true;
return false;
}

I have this problem can you tell us the solution? i am at a complete loss.

Thanks.

Posted: Mon Sep 29, 2003 12:52 am

You need to edit the .htaccess file in your root directory and remove the following line:

Code:

RewriteCond %{HTTP_USER_AGENT} ^RMA [OR]

Private Joined: Sep 25, 2003 Posts: 49

VinDSL wrote:

You need to edit the .htaccess file in your root directory and remove the following line:

Code:

RewriteCond %{HTTP_USER_AGENT} ^RMA [OR]

That solves the Ms Analysis problem? I thought taht was the solution for streaming RealMedia? Im having the same MS Analysis problem you had.

Posted: Mon Sep 29, 2003 3:11 am

Yeah, that solved both problems. 'RMA' is the User Agent that RealPlayer sends out when it tries to connect and listen to a RealAudio file. Due to the above mentioned line of code, Google Tap thinks RealPlayer is a crawler and blocks it. When that happens, it freaks out MS-Analysis and the errors come flooding in.

I dunno. Maybe there is a RealAudio crawler/harvester out there, trying to capture all your RealAudio files, sending out the RMA UA, but I've never heard of such a thing. RealPlayer probably sends that UA out when you use it for other things too. Personally, I don't think that code should be in Google Tap, no matter what, but it's not my call, you know?

Do you have any audio/video files on your site? If not, I don't know why ppl would be using RealPlayer on it...

Private Joined: Sep 25, 2003 Posts: 49

VinDSL wrote:

Yeah, that solved both problems. 'RMA' is the User Agent that RealPlayer sends out when it tries to connect and listen to a RealAudio file. Due to the above mentioned line of code, Google Tap thinks RealPlayer is a crawler and blocks it. When that happens, it freaks out MS-Analysis and the errors come flooding in.

I dunno. Maybe there is a RealAudio crawler/harvester out there, trying to capture all your RealAudio files, sending out the RMA UA, but I've never heard of such a thing. RealPlayer probably sends that UA out when you use it for other things too. Personally, I don't think that code should be in Google Tap, no matter what, but it's not my call, you know?

Do you have any audio/video files on your site? If not, I don't know why ppl would be using RealPlayer on it...

Well I just looked, and Im not blocking ANYTHING based on the http_user_agent , but I am using RewriteCond to prevent image hotlinking... would this ms analysis error appear if someone was trying to hotlink an image off my site, then?

Posted: Mon Sep 29, 2003 4:44 am

Hrm... I dunno. Let's test the theory.

http://download.lenon.com/images/nuke_counter.jpg

This will redirect bandwidth thieves to my homepage. Be right back...

Nope! No errors.

Here are the directives I use:

Code:

RewriteCond %{HTTP_REFERER} !^http://([a-z0-9-]+\.)*lenon.com/ [NC]
RewriteCond %{HTTP_REFERER} !^http://([a-z0-9-]+\.)*66.227.17.133/ [NC]
RewriteRule ^.*$ http://www.lenon.com/ [L,R]

Do yours look similar?

Private Joined: Sep 25, 2003 Posts: 49

VinDSL wrote:

Hrm... I dunno. Let's test the theory.

http://download.lenon.com/images/nuke_counter.jpg

This will redirect bandwidth thieves to my homepage. Be right back...

Nope! No errors.

Here are the directives I use:

Code:

RewriteCond %{HTTP_REFERER} !^http://([a-z0-9-]+\.)*lenon.com/ [NC]
RewriteCond %{HTTP_REFERER} !^http://([a-z0-9-]+\.)*66.227.17.133/ [NC]
RewriteRule ^.*$ http://www.lenon.com/ [L,R]

Do yours look similar?

yep. must be something else then. oh well, thanks for the help i guess I'll just ignore it. Wink

nice looking site btw Smile

Private Joined: Sep 25, 2003 Posts: 49

woops wrong thread