Option specific for automatic proxy scraping
Kaine
thebestindexer.com
Hello Sven and good weekend
I wanted to know how is the automatic scraper scrape proxy.
I guess the priority is to choose the functional google search (if is the engine selected) ?
Is it possible to predefine this automatic research with an option?
For example I scrap imports lists.
That means that any proxy will do since it does not pass through a search engine. (Unless seek proxy enable Cloudflare can be ^^ ).
An option for automatic scraper seeking proxy "Google PR" seems to be the best choice (the tier can not function well without it), but as the members may have different choice, one option would be to select.
May be able to find 2 or more options?
example:
Google PR
Google Search
Or other.
I am currently have to import proxy ready, or scrapper much in advance before restarting my projects.
EDIT
In this regard, if i select "automatically search ... 60mn"
And select the option "only less than 400 ...."
When it comes to less than 400, the search does not start. He seems to exhaust all proxy before.
Tagged:
Comments