How To Keep Track Of Total Scraped List For Gsa!
I'm sure this question is not real relevant to GSA but maybe someone can help!..
(Important) Is there a way you can only import new urls in GSA when you scrape?
For Instance....
so if you have 100 urls that i scraped and uploaded to gsa last week. I want to scrape again this week and only give gsa the new domains. So lets say I scraped 20 new domains I would have 120 but I need gscraper to pull out those new 20 and leave the master list of 120 to compare my next scrape.
So GSA wont run though duplicate domains wasting resources!
Is there a way I can do that?
(Important) Is there a way you can only import new urls in GSA when you scrape?
For Instance....
so if you have 100 urls that i scraped and uploaded to gsa last week. I want to scrape again this week and only give gsa the new domains. So lets say I scraped 20 new domains I would have 120 but I need gscraper to pull out those new 20 and leave the master list of 120 to compare my next scrape.
So GSA wont run though duplicate domains wasting resources!
Is there a way I can do that?
Tagged:
Comments
It can handle large list.
There are free tools that can do the same also.