Public Proxies - Best Practice & Suggestions
Hi, as I'm using public proxies on my test machine at the moment I want to show you how to find good sources and tweak the proxy scraper to get good proxies you can use in SER or tools like Scrapebox.
This is a possible setting:
You first have to take a look at what proxy list give you good and fresh proxies every day. Some lists get updated more than once a day, some lists gets only updated once a week or even less. You need to get rid of all providers that don't update their lists daily at least. To do that its best to visit the sites by hand and take a look into their proxy posts. To get the URL of the list click "Add/Edit ProxySites" and copy the URL.
If you got plenty of good lists (~10) activate them and download the proxies. Click "Add Proxy" -> "Find online". Keep an eye on the log and notice which provider gives you new proxies. Many proxies will be duplicates and won't give you any new proxies. Now just use the ProxySites which give you the most "new" proxies and get rid of the rest. The less ProxySites you use, the less threads you waste when searching for new proxies.
Test the proxies now (Test Proxies / don't skip unchecked). In my settings I use 50 threads with Timeout: 2 seconds. You need to figure out what works best for you.
If I reduce the timeout to 1 seconds for instance my router can't take the heat and I lose my connection. Same could happen if you increase the threads.
If you think that you don't get enough working proxies you could increase the timeout a litte bit (~5 seconds) but the more threads you use and the less timout you set, the faster will be your proxy test.
Automatically search for new proxies (could be everything from 30 to 720 minutes). Figure out what works best for you.
You can also re-test flagged "not working" proxies again. Just mark the fastest proxies (up to 2 seconds) -> right mouseclick -> Test selected.
Let the proxy scraper run with your best settings for some days. Then you sort the list by speed and check what sources gave you best results in terms of working proxies, number of proxies and speed. If you see that some ProxySites give you bad results with no/few added proxies or only really crappy ones than you can get rid of them, too.
I for instance use just 3 proxy list providers, but I have my own ones 
But I'm sure you'll find some good ones with the lists of providers that SER has installed. Most proxy lists are duplicating each other anyway.
Tagged:
Comments
great analysis
next version has "Re-test previously working proxies"
You don't need anything really as no IE is used in background or javascript is executed.
But if you use any other SEO tool on the same PC you might want to use AVG or AVAST as many do use IE in background.