Auto-clean duplicate urls from site lists

Crownvic

@Sven, if you don't mind can you add auto-clean of duplicate URLs from global site lists.

I know it can be done via menu, but auto will be handy (remove dups every xx minutes/hours/days).

Sven

No, this is to resource hungry.