I have a quite powerful server, how many threads can the app handle in check+post mode without causing problems with missing sites or getting hung up ?
Comments
romingson Puchong
One threads is ok
Kaine thebestindexer.com
edited May 2020
It all depends on what you call powerful. Try something like 100/100 and launch a web page to see its loading time. When the loading starts to slow down, you have to lower the threads.
really 1 thread ? to sort through 5 million urls ?
romingson Puchong
edited May 2020
I just use for scrape, check and sent.open 1000 thread scrape ,check and sent No upload list. Because no many operation. Just let this software scrape check and sent only
stevie UK
On one of my VPS I use 1000 threads for checking.
For posting, I use 500 shared proxies and 500 threads.
I've found it depends a lot on the CPU of the VPS.
Thanked by 1EmilHunter
AlanT uk
Mine is a home build Thread ripper with 64 gig of ram . So 500 ? I'll give it whirl let you know thanks
Comments
I am assume your basing this on your IQ ?
really 1 thread ? to sort through 5 million urls ?
For posting, I use 500 shared proxies and 500 threads.
I've found it depends a lot on the CPU of the VPS.
The software is 32-bit, so it won't use more than 4GB of RAM anyway.