2.7 mill Proxies not working
Hi there all, any tips would be appreciated...
Did a GSA proxy search on all lists. It came back with 2.78 mill proxies. But when I do a test (have tried Google, Bing and Whatsmyip) and "If" I'm lucky I get about 2-10 of these working and then system burns them out in under 10 minutes.
Please help. Not sure if I should be using a different test setup or if I have settings wrong.
I have tried YT searching for tutorials but can't find anything that is set different to what I have atm.
Any help would be appreciated.
Did a GSA proxy search on all lists. It came back with 2.78 mill proxies. But when I do a test (have tried Google, Bing and Whatsmyip) and "If" I'm lucky I get about 2-10 of these working and then system burns them out in under 10 minutes.
Please help. Not sure if I should be using a different test setup or if I have settings wrong.
I have tried YT searching for tutorials but can't find anything that is set different to what I have atm.
Any help would be appreciated.
Comments
By definition, they are public proxies.
If you are wanting to scrape google with these proxies, you will need to use other types of proxies, such as residential/rotating proxies. Very expensive. The cheap alternative is to scrape other search engines such as google clones and bing/yahoo who do not block ip's as aggressively as google do.
You're also testing at 1000 threads which is very high and will need a very good internet line to support so many connections. I normally run it at 100 threads and a 5 second timeout to ensure only fast proxies are saved. Using a 120 second timeout will also save the slow proxies that pass the test. You don't want to be using slow proxies.