Add proxy option to choose when accessing sites
If you scrape results with public proxies you get a lot of "download errors". If you set private proxies to harvest results you run the risk of banning them. When you register you can also choose private/public proxies. Is there a possiblity to add a checkbox to access sites via public/private proxy? To separate the scraping from the access and the registering?
Tagged:
Comments