Thread count decreases near end of project
Hi there,
I import targets into SER. However, when the list gets towards the end, the thread count decreases dramatically and the program slows down.
For example, in a list, 1083/1137 take only ~3 mins. But the remaining 54/1137 can take anywhere from 10-25 mins.
Although, I have "Continuously try to post to a site even if failed before" checked, I have tried deleting the cache and history with no improvement. Also, my proxies are great (dedicated), CPU usage is low and I have plenty of Memory available.
Any good ideas of how I can speed up the send of the project?
Thanks in advance.
P.S. I can provide multiple logs if needed.
I import targets into SER. However, when the list gets towards the end, the thread count decreases dramatically and the program slows down.
For example, in a list, 1083/1137 take only ~3 mins. But the remaining 54/1137 can take anywhere from 10-25 mins.
Although, I have "Continuously try to post to a site even if failed before" checked, I have tried deleting the cache and history with no improvement. Also, my proxies are great (dedicated), CPU usage is low and I have plenty of Memory available.
Any good ideas of how I can speed up the send of the project?
Thanks in advance.
P.S. I can provide multiple logs if needed.
Comments
Let me explain why this happens: If you use the option to "contentiously try to post...", then SER can not simply through out URLs it has tried to post before. But this also means then it has to watch out to not start two threads with the same URL-domain twice or more.
If it would do this, then eventually it would create duplicate content. Something you do not want.
If you want to speed this up, you have to uncheck that option,or delete duplicate domains fromt he imported target urls.
Since I would uncheck "Continuously try to post.." option, does that mean I should be deleting the Target URLs history? If that is true, where are those stored? This way, I can just delete the file directly.
this history is stored in *.hosts_done and *.urls_done
Deleting those files is the same as clicking "Delete Target URL history".