I am running 6 projects. I got a dedicated server with Xeon E3-1240, 4 cores with 8 threads, and 24G Rams. Also I have 30 private proxies from Buyproxies, and I set 300 threads.I imported around 1 million url list, randomize and split it.
The problem comes out. At the first 1-2 minutes, ser was running very fast and the CPU usage was around 50%, which I think it is normal. but after that, ser was slowing down. The threads kept 300 unchanged, but the CPU usage went down to 3%, 2% and sometimes 0% and I think ser was running and posting one by one. I checked the ser log, very slow.
Then I tried a couple ways to see if the problem could be solved, but the problem remained the same.
1) I removed the duplicate domains from the list.
2) I Skipped to post the subdomain in "option".
@Sven Do you know what happened on my project?
Any suggestions will be appreciated.
Modified: I imported the list to do identification. Then I imported the "identification" folder, now it is getting faster. The CPU usage keeps around 10-15%, sometimes it goes down under 10%. But I am running 300 threads, and I think it is not normal. My dedicated server is not powerful. It should be around 50% usage.