That means that the SER could not identify the platform as something it could post to. Pretty normal response - We get that on about 50% of what we scrape, and were SUPER targeted in our scrapes.
Bumsie
But I use verified list.
Bumsie
and lpm is 6!
1linklist FREE TRIAL Linklists - VPM of 150+ - http://1linklist.com
Are you using private proxies? If not try that.
Any link/page filters? This is going to seriously contribute to your LPM.
Are you ALSO scraping at the same time? If so, disable that. Going to crawl while also running a ver list slows things down greatly.
Is your max-page size set at 1mb? If so try increasing it to 4-5 MBs.
Is your page-timeout set at 30? If so try increasing it up to 180 or so.
Finally, how many threads are you running. Increasing this always leads to an LPM increase.
Bumsie
Yes private, no any filters, not scraping, I do not know where to set max-page size, timeout - 180, 1000 threads, and 3 projects eat more than 2.5 GB of memory, I feel because a lot of "no engine matches"
Comments
That means that the SER could not identify the platform as something it could post to. Pretty normal response - We get that on about 50% of what we scrape, and were SUPER targeted in our scrapes.
Any link/page filters? This is going to seriously contribute to your LPM.
Are you ALSO scraping at the same time? If so, disable that. Going to crawl while also running a ver list slows things down greatly.
Is your max-page size set at 1mb? If so try increasing it to 4-5 MBs.
Is your page-timeout set at 30? If so try increasing it up to 180 or so.
Finally, how many threads are you running. Increasing this always leads to an LPM increase.