Skip to content

Answered : Flag to NOT add duplicate domains or uls so no sorting out is needed anymore

edited January 2013 in Feature Requests
if you import sites or for the search results a checkbox would be nice

Comments

  • SvenSven www.GSA-Online.de
    Hmm sorry but what exactly do you mean? The program is checking for duplicated domains/URLs before anything is downloaded...so there is not a big wast of time on this.
  • Ah ok sven .. i thought so .. but how does the list get duplicate urls then ? if it is checked before entry ..
    greets
  • SvenSven www.GSA-Online.de
    You say it has duplicate URLs for your project?
  • When i let the program run .. after a while if i do delete duplicate URLS it always finds some
    because of that i ask as you say it gets pre filtered

  • SvenSven www.GSA-Online.de
    Ahh now I get it, you are talking about the site lists? sorry no dupe checking is done there as it would take to much time.
  • ah i understand thanks for info
Sign In or Register to comment.