I'm sure this question is not real relevant to GSA but maybe someone can help!..
(Important) Is there a way you can only import new urls in GSA when you scrape?
For Instance....
so if you have 100 urls that i scraped
and uploaded to gsa last week. I want to scrape again this week and
only give gsa the new domains. So lets say I scraped 20 new domains I
would have 120 but I need gscraper to pull out those new 20 and leave
the master list of 120 to compare my next scrape.
So GSA wont run though duplicate domains wasting resources!
Is there a way I can do that?
Answers
It can handle large list.
There are free tools that can do the same also.