Skip to content

Option specific for automatic proxy scraping

KaineKaine thebestindexer.com
edited March 2014 in Feature Requests
Hello Sven and good weekend :) 

I wanted to know how is the automatic scraper scrape proxy. 

I guess the priority is to choose the functional google search (if is the engine selected) ? 

Is it possible to predefine this automatic research with an option? 

For example I scrap imports lists. 

That means that any proxy will do since it does not pass through a search engine. (Unless seek proxy enable Cloudflare can be ^^ ). 

An option for automatic scraper seeking proxy "Google PR" seems to be the best choice (the tier can not function well without it), but as the members may have different choice, one option would be to select. 

May be able to find 2 or more options? 

example: 

Google PR 
Google Search 


Or other.

I am currently have to import proxy ready, or scrapper much in advance before restarting my projects.

EDIT

In this regard, if i select "automatically search ... 60mn" 

And select the option "only less than 400 ...." 

When it comes to less than 400, the search does not start. He seems to exhaust all proxy before.


Comments

  • SvenSven www.GSA-Online.de
    proxies are checked against anonymousy or with the last check you have done.
  • KaineKaine thebestindexer.com
    That answers my question, thank you :)
  • KaineKaine thebestindexer.com
    edited March 2014
    No they are a problem.

    If i selected anonymous in option feature, and i scrape google PR they are not anonymous.

    I must be perform the 2 operation manually. 

    This should be same as in automatic mode, one or the other.

    It must have bad repercussion in projects.
Sign In or Register to comment.