SER "choked"? Bad LPM, no targets to post
hey guys,
i got problem with SER as it not finding any new targets to post. I added new keywords, my global lists are checked (submited and verified). Am running it by couple of months and there is decent list already but it seems like it slacked hard. What can I do about it?
Comments
How many proxies do you have? That is what will slow down your scraping.
I downloaded the demo version of Gscraper 2 days ago.. Using 100 private shared proxies from buyproxies
I loaded 1000 footprints and 25 keywords (i found out that 25k keywords using 1000 results per keyword is just enough to stay under the 100k scrapped URLS per scrap in the demo version).
Each run gets about 80k - 96k targets, after removing dupes i found 75% of remaining urls are all from webcache.googleusercontent.com doamin .. meaning this is a cached version of the actual domain .. when I manually looked up a few of the cached content, I found it was filled with porn, gambling .. talk about the worst of neighborhoods!
The problem is those trigger keywords ( sex, gambling etc) are not included in the domain name only the contents .. is there a way to filter those out? is there a way to prevent GSCRAPPER or SCRAPEBOX from scrapping webcache.googleusercontent.com ???
Thanks