Check freshly scraped lists for dups against global list?
OK, suppose I am scraping an all new list with SB and testing it with SER. I don't want to test URLs that are already in my global verified or failed list since that would be just a waste of time.
So how would I check a freshly scraped list against the global lists before testing them in a project?
Comments