scraping using built-in footprint
Hi Guys,
I'm using the built-in scraper with a kw list of ~2400 keywords to scrape social bookmark sites to post to, been running now for 24 hours and has found 12k to post to - my question is: are these sites saved as you go? As in, if I hit 'abort' now, will those 12k links be already saved in 'identified' within the global list?
Or do I need to wait until the process has finished to ensure those scraped links are saved?
Hope the question makes sense
I'm using the built-in scraper with a kw list of ~2400 keywords to scrape social bookmark sites to post to, been running now for 24 hours and has found 12k to post to - my question is: are these sites saved as you go? As in, if I hit 'abort' now, will those 12k links be already saved in 'identified' within the global list?
Or do I need to wait until the process has finished to ensure those scraped links are saved?
Hope the question makes sense
Comments