You are missing our premiere tool bar navigation system! Register and use it for FREE!

NukeCops  
•  Home •  Downloads •  Gallery •  Your Account •  Forums • 
Readme First
- Readme First! -

Read and follow the rules, otherwise your posts will be closed
Modules
· Home
· FAQ
· Buy a Theme
· Advertising
· AvantGo
· Bookmarks
· Columbia
· Community
· Donations
· Downloads
· Feedback
· Forums
· PHP-Nuke HOWTO
· Private Messages
· Search
· Statistics
· Stories Archive
· Submit News
· Surveys
· Theme Gallery
· Top
· Topics
· Your Account
Who's Online
There are currently, 42 guest(s) and 1 member(s) that are online.

You are Anonymous user. You can register for free by clicking here
Nuke Cops :: View topic - Ongoing quest for performance... [ ]
 Forum FAQ  •  Search  •   •  Memberlist  •  Usergroups   •  Register  •  Profile •    •  Log in to check your private messages  •  Log in

 
Post new topic  Reply to topicprinter-friendly view
View previous topic Log in to check your private messages View next topic
Author Message
steven111
Lieutenant
Lieutenant


Joined: Dec 30, 2003
Posts: 283


PostPosted: Sat Jun 26, 2004 11:36 am Reply with quoteBack to top

In my ongoing quest for better performance, I solved a major perf. problem on my server.

When I did "top" before, it was showing me huge iowaits, approaching 90% which was dragging the server down. The problem turned out to be related to tables not being optimized.

When large number of rows are deleted from tables, then the index is not properly sorted and the tables include a lot of garbage as well. As a result, performance is seriously degraded.

I have written a cron job to optimize tables nightly.

Note that in mysql, "optimize LOCAL.." LOCAL does not work. I am checking this out, but you can always use it without the LOCAL arg.

As a result of optimizing, my iowait is now down to 10% Very Happy and the server is performing like a champ (he he, no need to get a new server!!).

Don't believe mysql docs that optimization is not necessary.

_________________
ezClassifieds|Forums:Auto,Mac,Job,Win,HW
Find all posts by steven111View user's profileSend private messageVisit poster's website
MrFluffy
Captain
Captain


Joined: Aug 06, 2003
Posts: 411

Location: Berlin

PostPosted: Sat Jun 26, 2004 12:15 pm Reply with quoteBack to top

Hi there,

as you seem to know a lot about speed (or in my case the opposite) stuff, perhaps you could give me some advice.
I'm on a shared server and my php-processing times for my index page range from 0.3 (it's possible, I've seen it, though rarely) to 55 seconds.
I am absolutely clueless about how to track down the reason(s) for this. I too had the idea that it could be related to tables needing to be optimized, had quite a few, optimized them but that didn't help.
My host has no clue. From observing it, the number of visitors is not the key. My second site hosted on the same space, using a seperate database, index page nearly the same, 'loaded' (parsed) in 0.184 seconds while the problematic one took 22... it drives me crazy.
Are there any tools I can use on a shared server to analyze the situation?

P.S.:
Both sites are GT-NExtGEn tapped and I'm using the 'speed freaks' functions in mainfile.php.

Thanks for any help.

_________________
cu, MrFluffy

conrads-berlin.de
nuke-platinum.de
Find all posts by MrFluffyView user's profileSend private messageVisit poster's websiteAIM AddressYahoo MessengerMSN MessengerICQ Number
steven111
Lieutenant
Lieutenant


Joined: Dec 30, 2003
Posts: 283


PostPosted: Sat Jun 26, 2004 12:37 pm Reply with quoteBack to top

MrFluffy, thanks Very Happy

Please do a number of things, and see if it helps:

Build some of the missing indecis: http://nukecops.com/modules.php?name=Forums&file=viewtopic&p=132042#132042

See if mysql query cache is on. To test that, go to phpmyadmin, and run the same query multiple times. If after the 1st run, the response time dramatically improves, you have the cache on. Otherwise, you may have to talk to your host, or move your host. Query cache is almost a MUST.

There may be more to do, but I suggest doing these and seeing what happens. I am 75% sure your problem would be fixed by doing the above.

steve

_________________
ezClassifieds|Forums:Auto,Mac,Job,Win,HW
Find all posts by steven111View user's profileSend private messageVisit poster's website
MrFluffy
Captain
Captain


Joined: Aug 06, 2003
Posts: 411

Location: Berlin

PostPosted: Sat Jun 26, 2004 1:02 pm Reply with quoteBack to top

Thanks for the advice, put indeces to both of the tables, the parsing time was about 6 seconds directly before and after, I had some hopes in this, as I am using forum center blocks. But the time didn't change, well my forums are very small anyway. I'll watch if the times are increasing as ridiculously as before again.
I also tried the mysql cache, which seems to work as the query times on some of the biggest tables nearly cut down to half the second time I ran them.
I'll try and interrogate my host again. Perhaps (I've read somewhere that this could be a cause) some client on the same db-server is causing very high load...

Thanks again for the quick response!

_________________
cu, MrFluffy

conrads-berlin.de
nuke-platinum.de

Last edited by MrFluffy on Sat Jun 26, 2004 1:20 pm; edited 3 times in total
Find all posts by MrFluffyView user's profileSend private messageVisit poster's websiteAIM AddressYahoo MessengerMSN MessengerICQ Number
steven111
Lieutenant
Lieutenant


Joined: Dec 30, 2003
Posts: 283


PostPosted: Sat Jun 26, 2004 1:14 pm Reply with quoteBack to top

MrFluffy,
How does it perform on your own development machine?

Ok, if your forums are small, the indexing would not affect it much, neither would query cache (althogh more than the indexing).

Sorry that it did not work. Let's see if others have any solutions for you.

_________________
ezClassifieds|Forums:Auto,Mac,Job,Win,HW
Find all posts by steven111View user's profileSend private messageVisit poster's website
MrFluffy
Captain
Captain


Joined: Aug 06, 2003
Posts: 411

Location: Berlin

PostPosted: Sat Jun 26, 2004 1:17 pm Reply with quoteBack to top

Shoot me, I'm an idiot (at least have tendencies to be from time to time).
I was again comparing what could be different between my two sites and what could externally influence the loading times.

A RSS-NEWS BLOCK!

Embarassed Embarassed Embarassed

I'm going to get drunk now to forget Wink

_________________
cu, MrFluffy

conrads-berlin.de
nuke-platinum.de
Find all posts by MrFluffyView user's profileSend private messageVisit poster's websiteAIM AddressYahoo MessengerMSN MessengerICQ Number
steven111
Lieutenant
Lieutenant


Joined: Dec 30, 2003
Posts: 283


PostPosted: Sat Jun 26, 2004 3:32 pm Reply with quoteBack to top

RSS! Aggghhhh, major problem!!

You have a couple of solutions if you don't ditch it.

(a): put it in iframe: it would load independent of the main site, so it can take its sweet time -fairly ez

(b) cache it, I think there is a nuke news block that already caches things like this, I remember seeing it.

_________________
ezClassifieds|Forums:Auto,Mac,Job,Win,HW
Find all posts by steven111View user's profileSend private messageVisit poster's website
djmaze
Captain
Captain


Joined: Nov 29, 2003
Posts: 566

Location: Netherlands

PostPosted: Sat Jun 26, 2004 4:13 pm Reply with quoteBack to top

RSS has always been a pain in the ar$$ that's why i never use it.
The problem is, that a server doesn't record the Domain Names properly most of the time.

A faster approach is to use the IP of the server where you want your data from.

Also updating the RSS once in 5 hours and put the data into DB will give better results.

Another RSS issue occures when the server is down.
Your website tries to recieve info from a "non-existing" website which results your website is down as well.

A better solution would be JavaScript/Flash based blocks which connect to the RSS feed, and process the data.

Then about OPTIMIZE:
somewhere on this server are links to an old admin add-on from me which allows you to control a lot of database options thru the admin area.

Tables that need optimization often if module is used often:
_bbposts
_bbposts_text
_bbprivmsgs
_bbprivmsgs_text
_bbsearch_results
_bbsearch_wordlist
_bbsearch_wordmatch
_comments
_counter
_cpg_pictures
_downloads_downloads
_downloads_newdownload
_poll_check
_pollcomments
_stats_date
_stats_hour
_stats_month
_stories
_users
Find all posts by djmazeView user's profileSend private messageVisit poster's website
Display posts from previous:      
Post new topic  Reply to topicprinter-friendly view
View previous topic Log in to check your private messages View next topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2005 phpBB Group

Ported by Nuke Cops © 2003 www.nukecops.com
:: FI Theme :: PHP-Nuke theme by coldblooded (www.nukemods.com) ::
Powered by · TOGETHER TEAM srl ITALY http://www.togetherteam.it · DONDELEO E-COMMERCE http://www.DonDeLeo.com
Web site engine's code is Copyright © 2002 by PHP-Nuke. All Rights Reserved. PHP-Nuke is Free Software released under the GNU/GPL license.
Page Generation: 0.205 Seconds - 184 pages served in past 5 minutes. Nuke Cops Founded by Paul Laudanski (Zhen-Xjell)
:: FI Theme :: PHP-Nuke theme by coldblooded (www.nukemods.com) ::