Skip to content

import url question

googlealchemistgooglealchemist Anywhere I want
in Need Help
If I do a huge scrape of new targets and import them all into a specific project, not globally, to let that gsa project sort thru and test them. Once they are imported, and I go to the global options of dedupping urls, will that delete any urls from my newly imported list that are already found elsewhere globally in gsa identified,submitted,verified,failed folders?

When I have so many million already sorted thru, and have an import list of many million, I don't have a tool that can do a url level compare function at that level in one shot.

Comments

  • krushinemkrushinem
    no it won't
    that function will on deal with failed,verified,identfied, and submitted urls-can't help with the second part
  • googlealchemistgooglealchemist Anywhere I want
    i take it then that it doesnt do any sort of compare function for existing sites to avoid importing duplicates
Sign In or Register to comment.