Skip to content

Fix Needed: Google Search Tags

AlexRAlexR Cape Town
in GSA Proxy Scraper
Hi

I need to do some Google scraping.

I've tested the tag feature and it's not adding any tags to Google search proxies that pass.

I tested and got 828/4000 proxies passed Google Search but no tags were added. 

Comments

  • SvenSven www.GSA-Online.de
    give me a proxy where you think it should have been tagged
  • AlexRAlexR Cape Town
    edited April 2018
    1) See test before results: https://www.screencast.com/t/Z1SXvUYc0B4K
    2) See results: https://www.screencast.com/t/K4jYdTqg
    3) When I selected export all working it exported all proxies not just working. //removed//
    4) Some that passes success: //removed//
    See explanation: https://www.screencast.com/t/k4t9USZHMMX
  • SvenSven www.GSA-Online.de
    no wait...you do a google test but that test is only performed on anonymous proxies...the rest is skipping this.
  • AlexRAlexR Cape Town
    Hi Sven. I'm not following what you want me to do? Redo the test?
  • SvenSven www.GSA-Online.de
    and even if a proxy on google returns a "you are blocked here" it means it is a working proxy, just not tagged as a google-passed one.
  • AlexRAlexR Cape Town
    Can you give me steps to make sure Google passed proxies get tagged as Google so I can use for scraping Google? I don't know what test to use to check it for Google scraping so it adds correct tag.
  • SvenSven www.GSA-Online.de
    1. you test against google only (maybe use one anonymous test as well if they haven't been tested against that)
    2. you select by tag -> google
    3. export selected/highlighted

    or you simply create yourself an export template that will export only proxies with google-tag.
  • AlexRAlexR Cape Town
    Hi Sven

    That's exactly what I did! I tested all proxies against Google search. 
    1) See test before results: https://www.screencast.com/t/Z1SXvUYc0B4K
    2) See results: https://www.screencast.com/t/K4jYdTqg
    3) When I selected export all working it exported all proxies not just working. //removed//
    4) Some that passes success: //removed//
    See explanation: https://www.screencast.com/t/k4t9USZHMMX

    and it didn't tag any with Google.
  • SvenSven www.GSA-Online.de
    read again...if you test a proxy and google returned that this proxy is blocked on their site it means:

    a) proxy is working as it could connect to the site -> checked/enabled/working
    b) proxy is blocked on google -> not getting the [google] tag

    if you want to export google-passed proxies, you have to select the google taggged once and export highlichted.
  • AlexRAlexR Cape Town
    If that is the case, how come out of 4000 proxies tested that passed it didn't add any Google tags? https://www.screencast.com/t/K4jYdTqg (This was against Google search.) Why did these not get a Google tag?
  • SvenSven www.GSA-Online.de
    there are 5 google passed proxies in the list
  • AlexRAlexR Cape Town
    1) How are you testing to see which 5 passed? (what test did you do in Proxy Scraper. Was it Google Search? or did you add something else to the test.)
  • SvenSven www.GSA-Online.de
    At the status bar on your screenshot you see that there is a 5 on the orange TAG which would mean google-passed.
  • AlexRAlexR Cape Town
    That's exactly what I don't get.
    1) I have it setup so that if it passes Google search it should get tag = Google.
    2) But when I do test against Google search it shows https://www.screencast.com/t/K4jYdTqg. Surely it's the same test so the tag number should equal the passed number?
  • SvenSven www.GSA-Online.de
    no it not equal...because a test against google can return 3 different replies as written before as well:

    1. google performs the search and replies with results
    2. google replies with a "your ip is banned message"
    3. the proxy is dead or google does not even want to reply anything
    The google-TAG is only given in 1st case, While the number of working proxies is 1st and 2nd scenario. And then you have also the skipped proxies who do not even get tested due to the fact that the proxy itself would leak your IP and then that google-test is not performed.
  • AlexRAlexR Cape Town
    Thanks! I understand now! <span>:smile:</span>

    So to use proxies for scraping Google, I'll only use the tag. So out of 4000 proxies only 5 pass Google for scraping. Wow - good to know!
  • SvenSven www.GSA-Online.de
    keep it running...I got over 300 google proxies...just takes time
  • ScrapeMeIfYouCanScrapeMeIfYouCan
    Hello, sorry to reopen that conversation but were running into the same issues. We only harvest and test the Google proxies, with auto-export every 10 mins and auto-search every 10 mins. The test is made on Google Search and Anonymity. But once the export is done and lets say imported in Scrapebox, if we test the proxies in Scrapebox see if they pass the Google test, they just all fail. Is GSA still working and able to collect Google Search proxies? Are we missing a specific setting? Thanks in advance for your help.
  • SvenSven www.GSA-Online.de
    see here:https://docu.gsa-online.de/proxy_scraper/faq#why_am_i_getting_totally_different_results_when_testing_the_found_proxy_with_another_tool
  • ScrapeMeIfYouCanScrapeMeIfYouCan
    Thanks Sven, but we dont use Connect, we only use SOCKS. The GSA Scraper has been running for 4 hours now and I got 365 proxies exported (Public, SSL, Google tags) and SOCKS4 and  only, imported the extract in Scrapebox to scrape G Search, and all proxies return as "Failed" only 4 minutes after auto extract.
    Can you help please? Which exact settings do you use to get G Search proxies?
  • ScrapeMeIfYouCanScrapeMeIfYouCan
    Note: we are using the 5 days free version before buying it... if it works :)
  • SvenSven www.GSA-Online.de
    send me the proxies in a private message so that I can check.
  • ScrapeMeIfYouCanScrapeMeIfYouCan
    I have sent a very small and fresh batch
Sign In or Register to comment.