Well, I made new clean installation of 3.4.1, imported categories and links into the new database. Takes anywhere from 1 to 3 seconds less time to load pages (still up to 6 seconds for some pages), but loads CPU the same way... I don't know what to do. I'm stuck for now.
Fields shouldn't make much difference since there are so many more pre-existing fields than you could possibly add custom fields.
The empty main page loads as fast as 0.72-0.81.
When there's nothing else running on the server at all, that's slow. I get 0.51 seconds on a full page http://links.webmastersite.net/?debug=5 with a whole bunch of things (all my websites, including a forum with 13,000 members as well as all the script sites and this forum) running on the same VPS. Given the slow time on an empty page with nothing else running on the server, it would seem to me like a slow mysql.
Thanks Paul. I was playing with your links.webmastersite.com homepage and sometimes it takes up to 1.79 seconds to load. In most times it is much less then a second. I edited mysql config file yesterday and now the default templates wiht my data loads in 1.25 sec. - the first query loads twice faster than before, but I can't say the whole page loads twice faster, but still - it is faster. At the same the load on the processor still jumps up tp 60% and 70% during the time the page loading. Do you think you could share your my.cnf configuration file with me (and other if any interested out there) - it is mysql config file which supposed to be in /etc/ folder of your VPS.
Well, thanks for all your help, I really appreciate it.
I don't think you've mentioned your mysql version, a few hosts still use MySQL 3 which is much slower than recent MySQL versions due to lack of query caching.
Do you think you could share your my.cnf configuration file with me
I've never edited it so it's just what my host or cpanel/whm or mysql set it as:
I finally moved to liquidWeb and still experienced high CPU load - just terrible. So I cut down on my SQL queries big time - removed all the options under the links and everything that related to members or admins - that really speed everything up for me. Not perfect yet since it still takes up to 3 seconds on some pages, but at least it doesn't slow down the whole server as it was before.
I have a question - should CPU go up to 100% while any pages load? I have about 10K unique visitors a day and my average CPU load is below 1%, but when I refresh a page which might load in 2 or 3 seconds and immediately hit refresh button in the Virtuozzo Resource page - the CPU capacity bar goes up to 100% for a second and then drops back to 0. Sometimes it's tricky to catch the moment since it can be very fast, but I made a screenshot (attached). The problem I see with this is when I have a whole bunch of visitors - then CPU load doesn't drop back to 0 that fast. Is this a usual thing or there is something wrong?
I can't say I normally look at CPU load, but at the moment it's 100%, so I guess it's normal. It's also slower than usual at the moment though (though not awful), I'll turn off my other forum's guest searches.
The load number is more important. It's 3.08 here right now -- higher than normal, but things don't slow to a crawl until you get around 4. At Admin->Settings->System set it to lock out spiders when the load is above 3.5, and also check your logs for any rogue spiders that may need to be IP banned.
Edit: Load is down to 1.7 now, and CPU usage way down. Whether that related to my disabling guest searches on the other forum or not I don't know.
Edit2: I see your screenshot lists a 0.48 load. That's absurdly fast, mine is never that low, and it doesn't seem to fit well with the 100% CPU (though the load number does lag slightly behind in time).
Paul wrote: I see your screenshot lists a 0.48 load. That's absurdly fast, mine is never that low, and it doesn't seem to fit well with the 100% CPU (though the load number does lag slightly behind in time).
That's the problem. My average CPU load never was above 3% on any server, but pages still load up to 4 seconds on average.. sometimes it takes 8 seconds. This drives me nuts. I'll ban all not deeded IPs - that's easy.. gotta optymize my templates css - that needs time...
Thank you Paul for looking this up for me. I appreciate all your help very much! Thanks!
The load number isn't a % if that's what you're suggesting there. Anything over 5 will make pages take 10+ seconds to load, and by the time it gets to 7 you'll probably never load a page. 3 is high enough to create a slowdown (the ideal value for best speed is below 2) but shouldn't be too severe of one.... 4 seconds sounds possible for a load of 3.
0/5
1
2
3
4
5
This thread is closed, so you cannot post a reply.
Comments on high traffic web sites
Forum Regular
Usergroup: Customer
Joined: Oct 30, 2003
Total Topics: 54
Total Comments: 197
Well, I made new clean installation of 3.4.1, imported categories and links into the new database. Takes anywhere from 1 to 3 seconds less time to load pages (still up to 6 seconds for some pages), but loads CPU the same way... I don't know what to do. I'm stuck for now.
developer
Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California
Total Topics: 61
Total Comments: 7868
Fields shouldn't make much difference since there are so many more pre-existing fields than you could possibly add custom fields.
The empty main page loads as fast as 0.72-0.81.
When there's nothing else running on the server at all, that's slow. I get 0.51 seconds on a full page http://links.webmastersite.net/?debug=5 with a whole bunch of things (all my websites, including a forum with 13,000 members as well as all the script sites and this forum) running on the same VPS. Given the slow time on an empty page with nothing else running on the server, it would seem to me like a slow mysql.
Forum Regular
Usergroup: Customer
Joined: Oct 30, 2003
Total Topics: 54
Total Comments: 197
I just installed xdebug on my VPS... not sure if it will help to find the problem.
Forum Regular
Usergroup: Customer
Joined: Oct 30, 2003
Total Topics: 54
Total Comments: 197
Paul, who is your VPS host? If powerpipe.com - I don't see any VPS options on their web site available.
developer
Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California
Total Topics: 61
Total Comments: 7868
Liquid Web is my host (I have the $60 plan). Powerpipe is my domain registrar.
Can't say I know anything about xdebug.
Forum Regular
Usergroup: Customer
Joined: Oct 30, 2003
Total Topics: 54
Total Comments: 197
Thanks Paul. I was playing with your links.webmastersite.com homepage and sometimes it takes up to 1.79 seconds to load. In most times it is much less then a second. I edited mysql config file yesterday and now the default templates wiht my data loads in 1.25 sec. - the first query loads twice faster than before, but I can't say the whole page loads twice faster, but still - it is faster. At the same the load on the processor still jumps up tp 60% and 70% during the time the page loading. Do you think you could share your my.cnf configuration file with me (and other if any interested out there) - it is mysql config file which supposed to be in /etc/ folder of your VPS.
Well, thanks for all your help, I really appreciate it.
developer
Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California
Total Topics: 61
Total Comments: 7868
I don't think you've mentioned your mysql version, a few hosts still use MySQL 3 which is much slower than recent MySQL versions due to lack of query caching.
Do you think you could share your my.cnf configuration file with me
I've never edited it so it's just what my host or cpanel/whm or mysql set it as:
Forum Regular
Usergroup: Customer
Joined: Oct 30, 2003
Total Topics: 54
Total Comments: 197
Yes, it was v.3.x which I upgraded to 4.1.2
Forum Regular
Usergroup: Customer
Joined: Oct 30, 2003
Total Topics: 54
Total Comments: 197
I finally moved to liquidWeb and still experienced high CPU load - just terrible. So I cut down on my SQL queries big time - removed all the options under the links and everything that related to members or admins - that really speed everything up for me. Not perfect yet since it still takes up to 3 seconds on some pages, but at least it doesn't slow down the whole server as it was before.
I have a question - should CPU go up to 100% while any pages load? I have about 10K unique visitors a day and my average CPU load is below 1%, but when I refresh a page which might load in 2 or 3 seconds and immediately hit refresh button in the Virtuozzo Resource page - the CPU capacity bar goes up to 100% for a second and then drops back to 0. Sometimes it's tricky to catch the moment since it can be very fast, but I made a screenshot (attached). The problem I see with this is when I have a whole bunch of visitors - then CPU load doesn't drop back to 0 that fast. Is this a usual thing or there is something wrong?
Attached Files:
developer
Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California
Total Topics: 61
Total Comments: 7868
I can't say I normally look at CPU load, but at the moment it's 100%, so I guess it's normal. It's also slower than usual at the moment though (though not awful), I'll turn off my other forum's guest searches.
The load number is more important. It's 3.08 here right now -- higher than normal, but things don't slow to a crawl until you get around 4. At Admin->Settings->System set it to lock out spiders when the load is above 3.5, and also check your logs for any rogue spiders that may need to be IP banned.
Edit: Load is down to 1.7 now, and CPU usage way down. Whether that related to my disabling guest searches on the other forum or not I don't know.
Edit2: I see your screenshot lists a 0.48 load. That's absurdly fast, mine is never that low, and it doesn't seem to fit well with the 100% CPU (though the load number does lag slightly behind in time).
Forum Regular
Usergroup: Customer
Joined: Oct 30, 2003
Total Topics: 54
Total Comments: 197
I see your screenshot lists a 0.48 load. That's absurdly fast, mine is never that low, and it doesn't seem to fit well with the 100% CPU (though the load number does lag slightly behind in time).
That's the problem. My average CPU load never was above 3% on any server, but pages still load up to 4 seconds on average.. sometimes it takes 8 seconds. This drives me nuts. I'll ban all not deeded IPs - that's easy.. gotta optymize my templates css - that needs time...
Thank you Paul for looking this up for me. I appreciate all your help very much!
Thanks!
developer
Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California
Total Topics: 61
Total Comments: 7868
The load number isn't a % if that's what you're suggesting there. Anything over 5 will make pages take 10+ seconds to load, and by the time it gets to 7 you'll probably never load a page. 3 is high enough to create a slowdown (the ideal value for best speed is below 2) but shouldn't be too severe of one.... 4 seconds sounds possible for a load of 3.