Skip to content

GSA SER - Duplicate Target URLs is becoming a real problem

royalmiceroyalmice WEBSITE: ---> https://asiavirtualsolutions.com | SKYPE:---> asiavirtualsolutions
in Feature Requests
@Sven

Recently i have seen a huge spike in duplicate target urls and the speed at which they grow. I have seen some installs where in one week dup target urls has grown by 20 GB

On the moment GSA SER does not auto check for dup target urls.

I understand that doing the checks in real time would really slow down things allot, so please @Sven can you consider then adding a scheduler to remove dup domains \ target urls at set intervals.

Thanks

Comments

  • SvenSven www.GSA-Online.de
    Im not in office for the rest of the week but will have a look on it monday. if possible, send me such a project backup.
  • royalmiceroyalmice WEBSITE: ---> https://asiavirtualsolutions.com | SKYPE:---> asiavirtualsolutions
    @Sven
    Thanks, it is not a project, but rather all projects and on several installs. I am ONLY using the global list.
    22 million dup target domains in less than a week

    I will send you a PM with access to some installs for you to take a look.

  • SvenSven www.GSA-Online.de
    thanks. Unfortunately, I can only access/work on it on Monday. I hope you can wait till then.
  • royalmiceroyalmice WEBSITE: ---> https://asiavirtualsolutions.com | SKYPE:---> asiavirtualsolutions
    @Sven

    Monday is fine thank you, i have send you am PM  with access to a vps and some more info.
    Seems to be a bug because i am seeing it on other installs as well
  • toastermantoasterman
    I'm also seeing this so I reverted back to an older version, the target URL list becomes too big and the submission speed becomes very slow.
  • royalmiceroyalmice WEBSITE: ---> https://asiavirtualsolutions.com | SKYPE:---> asiavirtualsolutions
    @Sven

    Any update on this feature request for scheduled target url cleaning.
    I see you released an update today:

    12.72 - fix: minor issue on growing target url cache
    Was that to address the issue i reported ?


    Thanks
  • MashafeeqiMashafeeqi
    Dude no need u just had to add a macro and loop to run every 12 hour on ur server . Very simple
  • royalmiceroyalmice WEBSITE: ---> https://asiavirtualsolutions.com | SKYPE:---> asiavirtualsolutions
    Mashafeeqi  thanks for your suggestion, but i think it would be best for all if it can be integrated into GSA ser, because not everyone would know how to run macro's 

    As a vps provider it is becoming a pain in the ___ because people complain their drive is full all the time, and most of the time it turns out to be a dup target url issue which is getting out of hand.

  • SvenSven www.GSA-Online.de
    latest update should fix it.
  • royalmiceroyalmice WEBSITE: ---> https://asiavirtualsolutions.com | SKYPE:---> asiavirtualsolutions
    Thank you @Sven
  • MashafeeqiMashafeeqi
    royalmice

    i think the easiest macro recorder is jitbit macro recorder

    simply do this action and add a delay action :

    every 12 - 24 hour it go to gsa ser direcory in temp and zip the folders and send them to ur drive or other provider and create empty new folder for gsa ser to save his urls in
Sign In or Register to comment.