High CPU Load Not Resolved (For Me)
Hello everyone,
I just wanted to ask if everyone is still experiencing high cpu load with GSA. I know this question has been asked and answered already but while evryone keeps saying that the latest GSA updates seemed to have this fixed . In my case it seems everything is the same.
On the earliest versions of the tool my cpu was between 30-50% max while running 2-3 projects.
Now using the latest version 8.25 my cpu is at 97% running ONLY one project. This makes me crazy as i don`t know what the heck is causing this. On the earliest versions i had no issues now i can only run maximum 1 project at a time and even with that the cpu stays at 97-99%.
@Sven could you help me fix this issue ?
P.s My config : AMD Phenom X4 Quad-Core 3.6Ghz 4gb ram
Thanks in advance
I just wanted to ask if everyone is still experiencing high cpu load with GSA. I know this question has been asked and answered already but while evryone keeps saying that the latest GSA updates seemed to have this fixed . In my case it seems everything is the same.
On the earliest versions of the tool my cpu was between 30-50% max while running 2-3 projects.
Now using the latest version 8.25 my cpu is at 97% running ONLY one project. This makes me crazy as i don`t know what the heck is causing this. On the earliest versions i had no issues now i can only run maximum 1 project at a time and even with that the cpu stays at 97-99%.
@Sven could you help me fix this issue ?
P.s My config : AMD Phenom X4 Quad-Core 3.6Ghz 4gb ram
Thanks in advance
Comments
Without any doubt there is a bug which is causing this and all I can hope is for @Sven to identify and fix it. At this point i can only run one project at a time and i still have 97% cpu load.
@Sven -Regarding to the high CPU load i`ve noticed something which i hope will give you an ideea on what the problem might be.
1. When i`m unchecking "Search Engines to use" AND "Use url`s from global site lists" and i`m importing my own lists of sites -this is when the CPU load goes to 97% !
Please note if i uncheck either one of these 2 options and not all 2 of them nothing changes and the cpu is still at 97% load
2. If I don`t import any target list and i also uncheck the global site lists (and i`m only checking a few engine for ser to scrape on it`s own) my cpu stays between 3-5% which is more than good.
Results :
Without importing site lists and unchecking the global site list (and letting ser find it`s own targets) the cpu stays between 3-5%. So the problem is caused when you import list of targets and click on use global site lists. I hope this will give you an insight and will help you solve the issue.
@lemonzer- yes that`s right but if we import a list and we don`t let ser scrape by it`s own the results should be the opposite-much less cpu usage since we provide the targets.Without this bug fixed instead of this we get a high cpu load
Hopefully with this info @Sven will identify and fix the bug.
@Sven -is there a way you can fix this cpu bug ? It drives me crazy especially considering the fact that i can only run one project at a time.
I run 2 copies of GSA:
1 at SolidSEO (Geek)
1 at Powerup hosting
The one on the Geek is choking really bad (running only one project, and the CPU is at 99%).
Surprisingly though, the one running on Powerup is rolling quite nicely. They have the exact same settings.
So, just to jump in and verify the problem here
We switched over my VPS at SolidSEO. No effect.
I tried switching on the allow the use of global lists. Again, no effect.
I then deleted the target url cache, and imported my verified list to all my projects.
BOOM! CPU back to normal, memory normal, and I'm crunching away at 100+ LpM again.
So yeah, I can verify this is most likely a bug in importing external URL lists.
If you have this problem, stay away from importing lists until this is fixed.
Ping @Sven
@Sven said he will have a look on it.
I reinstalled couple of earlier versions: 7.98 and 8.0 to be exact, and I still had the problem of melting CPU's... Just throwing this in here it helps finding the problem.
So I reinstalled the 8.0, shut down all the other projects but one. I disabled all the search engines and the use of global site lists. I then imported some 36k urls I had scraped, and hit start.
And BOOM! Within 2 seconds CPU was at 99%.
How could that happen? I'm very new to using only external lists with SER, so can't really tell... I don't know if this helps at all, just reporting what's happening for me
I've never waited an update this anxiously, LOL!
Let's hope everything will be in order soon