GSA SER - Duplicate Target URLs is becoming a real problem

royalmiceroyalmice WEBSITE: ---> | SKYPE:---> asiavirtualsolutions

Recently i have seen a huge spike in duplicate target urls and the speed at which they grow. I have seen some installs where in one week dup target urls has grown by 20 GB

On the moment GSA SER does not auto check for dup target urls.

I understand that doing the checks in real time would really slow down things allot, so please @Sven can you consider then adding a scheduler to remove dup domains \ target urls at set intervals.



Sign In or Register to comment.