I use different proxies for scraping and posting, the right ones and the best ones, as recommended. I face the following problem with GSA WC settings
- I use 10 private proxies for posting (MPP) that allows 100 connections
- I use rotating proxies (Storm) for scraping, 40 threads, that allows max 25%, 10 connections
Where to set the allowed threads for scraping and posting? For scraping, in the Tools and for posting in Options? (But there is a "scraping" part within "Options" also... Which is for scraping and posting? There are numbers in the "Options" section for scraping and submission also. How it differs from the Tools/proxies section?)
Is it the right proportion at all?
(40 threads/10 connections for scraping (rotating proxies) + 10 private proxies / 100 connections for posting?)
I set "Private" for posting for sure. But for scraping I have to set "Public"?
If I set "All" here, will that use my private proxies for scraping as well?
If I manually set my rotating proxies as "public", will those be used for scraping only? (If I set "public only" for scraping in the proxy settings?
Options / Misc - timeouts? (http and proxies)
Its really like a "recipe"! Must know everything correctly, to get it eatable