Skip to content

Google, Bing proxies

kajzerkajzer
in GSA Proxy Scraper
Hello,

how i can automaticaly export google and Bing proxies ?

Other question whn i harvest URL's with Scrapebox on Yahoo&Bing when  i import 500 Google/Bing proxies found with PS i have 6000> error on both engines and 80 harvested URL's 

Comments

  • SvenSven www.GSA-Online.de
    export: Just create a template and in settings use the TAG google/bing.
    --
    well what kind of errors? Make sure you only export WEB and Socks proxies as ScrapeBox does not understand CONNECT proxies.
  • kajzerkajzer
    k, i'll try and let you know, thanks
  • antonearnantonearn Earth
    @Sven - Is it OK to export CONNECT proxies with Google TAG, for SB, or must it be WEB + SOCKS + GOOGLE TAG (I scrape Google)? 
  • SvenSven www.GSA-Online.de
    No, ScrapeBox can not handle CONNECT proxies. You have to skip that completely.
  • kajzerkajzer
    How should WEB and Socks proxies be tagged ? 

    Couse when i TAG WEB&Socks it notice me that there is no proxies with that TAG ?

    Best.
  • SvenSven www.GSA-Online.de
    socks is not a tag but a type of a proxy. So you have to enable socks + web export as proxy type and google passed proxies as tag.

    In the end you might want to disable the CONNECT type globally.
  • kajzerkajzer
    OK thanks, could you help me where i can do that ?
  • kajzerkajzer
    I think i found it...

    settings-->Filter-->I checked all "Do not accept this and that proxies", "accept only if Tagged as "Google" and accept only following types WEB+Sokcs4+Socks5, unchecked Connect proxies Automatic export as you said....

    Thanks ;)


  • SvenSven www.GSA-Online.de
    sorry for being late but you figured it out I guess :)
  • kajzerkajzer
    Hi @Sven, with these settings i have much more errors and very little scraped URL's majority of errors are Socket errors so it pointing to bad proxies since i excluded SB and PS in all security softwares  ?


  • SvenSven www.GSA-Online.de
    I guess the errors are usually BING passed proxies?
  • kajzerkajzer
    Yes, most of them for Bing and some of them are for Yahoo...
  • antonearnantonearn Earth
    That may not be proxy scrapers fault. It depends how hard you hammer with SB. Try lower your connections in SB, that helped for me. 
  • SvenSven www.GSA-Online.de
    Also check the FAQ -> Why does this proxy just work for bing.com?
  • kajzerkajzer
    @Sven thanks on the info, i have never used them

    @antonearn i'm using 3 connection regardless on number of loaded proxies

    I'm now using detailed harvester at least scrape lasts longer, couse with custim harvester it finishes scraping for a second lol
Sign In or Register to comment.