Getting a "download failed" on a live site (Drupal)
I've been using GSA SER for a couple of weeks so far and with OK-success. However I really want to improve the way I feed scraped databases of drupal/joomla/buddypress to it though. I have pretty big lists of sites, but I have very low submission success rate.
I have paid attention to 1) proxies 2) threads 3) site sizes 4) html timeouts. Tweaked them or tried to remove from equation.
So I am running a test right now, 1 thread, my own IP address (no proxies), and I am parsing a Drupal site list. Getting a lot of "download failed" results so I open one of them and it loads just fine and very fast in my browser (so same IP). What coould I have missed?
I have read this thread and know how to use Google I am more or less pleased with autopilot scraping and posting, I want to hear from someone who loads big target lists with success. Thanks!
I have paid attention to 1) proxies 2) threads 3) site sizes 4) html timeouts. Tweaked them or tried to remove from equation.
So I am running a test right now, 1 thread, my own IP address (no proxies), and I am parsing a Drupal site list. Getting a lot of "download failed" results so I open one of them and it loads just fine and very fast in my browser (so same IP). What coould I have missed?
I have read this thread and know how to use Google I am more or less pleased with autopilot scraping and posting, I want to hear from someone who loads big target lists with success. Thanks!
Comments
Thanks for the password length tip!