Skip to content

Bug with saving verified URLs

AliTabAliTab https://gsaserlists.com
in Bugs
Hello @Sven

I suspect there is a problem with the way verified URLs are being saved. This might also be occurring with submitted URLs, but I haven't tested that yet. Not all URLs are being recorded in the file.





In a recent experiment, approximately 15 minutes elapsed, but only one URL was written to the file.



Comments

  • SvenSven www.GSA-Online.de
    New URLs are not saved instantly but only if enough of the same type have been collected or time between two save intervals is big enough.
    Thanked by 2Deeeeeeee AliTab
  • AliTabAliTab https://gsaserlists.com
    Sven said:
    New URLs are not saved instantly but only if enough of the same type have been collected or time between two save intervals is big enough.
    Thank you for your response, Sven. While I understand the logic, it still seems that not all URLs are being saved. I've observed that some URLs are properly recorded in their respective files, yet others, even though they were verified earlier, appear to be completely missed by SER. It seems as though some URLs are being lost somewhere in the process.
  • SvenSven www.GSA-Online.de
    URLs are also not saved if SER clearly knows that they where e.g. pulled from the identified site list...so it doesn't have to put them there again. If pulled from submitted, it will not add it to identified + submitted. If pulled from verified, it will not add it anywhere as it assumes it had added them in the other lists before.
  • AliTabAliTab https://gsaserlists.com
    Sven said:
    URLs are also not saved if SER clearly knows that they where e.g. pulled from the identified site list...so it doesn't have to put them there again. If pulled from submitted, it will not add it to identified + submitted. If pulled from verified, it will not add it anywhere as it assumes it had added them in the other lists before.
    Thank you for your response, Sven. I would like to clarify that I am not using any of the site lists in my projects.
  • SvenSven www.GSA-Online.de
    Oh there is another exception...if the site type uses fixed URLs, it is also not adding it to site lists, because the URLs are taken from the script itself anyway.
  • AliTabAliTab https://gsaserlists.com
    Sven said:
    Oh there is another exception...if the site type uses fixed URLs, it is also not adding it to site lists, because the URLs are taken from the script itself anyway.
    Also, that's not the case. I was checking SER default engines
  • SvenSven www.GSA-Online.de
    can you send me a sample so I can debug?
  • AliTabAliTab https://gsaserlists.com
    Sven said:
    can you send me a sample so I can debug?
    Of course, could you please specify the exact data you need? I'll send them to you in a private message.
  • SvenSven www.GSA-Online.de
    well, I could either need a project with such urls (the less the better) included that I run to see why it would not add them
    or
    just the URL itself that you think should get added.
Sign In or Register to comment.