This one project is killing CPU, should I upgrade VPS??

donchino

I'm not sure why this one project is killing the CPU even at 100 threads, but I guess cause it has most data in it, could 40 URLs and over 400 long spun articles be the reason? (there aren't much engines selected)

It also has tier project with over 800 long spun articles. But even running just the first project with a few others, kills the CPU at 100 threads. Without it, the others can be run at 300 threads as well.

I am posting to a 2M list, but even if I used 200k list, didn't matter.

I am using VPS with 4 CPU 3.60GHz and 4GB RAM.

Should I upgrade VPS to more CPU? Or optimize somehow the data in these projects? Thanks!!

Sven

Well the articles if very long, can cause this. Please try using a macro here where the articles get read from a folder. If that helps, send me the original project so I can have a look and maybe optimize things on it.

donchino

@Sven
1. when i have all articles with same title (in my case: %random_title%), then exporting hundreds of articles to a folder will save only one file %random_title%.txt, because it will overwrite and overwrite each file. Can it be changed so that it will save all articles.. for example put a nr in the end to each file (%random_title%1.txt, %random_title%2.txt.. etc)?

2. So I can then add one article to project with title (%random_title%), summary (%first_paragraph-article%), and body (%spinfolder-<folder>%), right??
will the summary macro (%first_paragraph-article%) work with spinfolder macro in the body??

3. How could i use %first_sentence-<varname>% macro for title together with the %spinfolder-<folder>% macro in body, so that it takes the first sentence for title from the same txt file? what should be the <varname> ?? Thanks!!!!

donchino

^^ @Sven do you have any input on this?

Sven

1. next version should create a proper title for that macro.

2. yes

3. %first_sentence-article%

replytodh

Have you tried lowering the number of threads to 50 instead of 100 to test the CPU?

donchino

Ya but i'm used to run at 600 threads, 50 would be out of question one way or another

magically

@donchino

Same problem here - way too high cpu ursage regardless of using 50, 100 or 150 threads

donchino

@magically try the method Sven posted above

magically

Well it can't be the articles, as I deleted all of them and inserted 15 (small) new ones just to test...

Something else is making the cpu go crazy - think it's related to the code that handles proxies.