Skip to content

Checking sites with no proper redirect setup? And custom headers?

imjosephimjoseph
in GSA Website Contact
Hi, I wanted to ask if I have a site with only naked domain, do I just import them, or should I add prefix to them? If I should add prefix what prefix should I be adding?


If I just import domain.com into it, which of above version does it automatically check? And what happens if let's say the domain is on www.domain.com, but we checked http://domain.com and he doesn't have proper redirect setup?

Another question is, is it possible to request a feature to add custom headers when checking sites?


Comments

  • SvenSven www.GSA-Online.de
    If no redirecto to "www." or "https/https" is happening, then submission fails, else the site is updated to the proper location
    --
    I really see no use in a custom header feature. Thats no natural behaviour of a browser and we want to look like a natural browser.
  • imjosephimjoseph
    edited March 2023
    Sven said:
    If no redirecto to "www." or "https/https" is happening, then submission fails, else the site is updated to the proper location
    --
    I really see no use in a custom header feature. Thats no natural behaviour of a browser and we want to look like a natural browser.
    Hey thanks for the swift response

    Is there a way we can have more select options than what currently have? For example able to select sites that doesn't redirect, so we can export that, manually add www. into it and run them again to get the most out of our website list.

    Another select option is maybe captcha timeout, for example if I have a huge list over a million, but I want to send it in a short time, I may choose to lower the timeout on my captcha timeout, so that it can skip slow sites and focus on finishing the list, but then later I can select all the timeout site again and re-run them with a longer timeout settings, again, to get the most out of our website list again.

    I understand by default doesn't require custom headers, but in some case I'd like to use it, is it possible to add that options?
  • SvenSven www.GSA-Online.de
    you can select all failed submissions via right click that have just the root domain in it.
    custom header: sorry no...I really see no use in this.
  • imjosephimjoseph
    @Sven Quick question does it matter what is the directory path of the url, cause I made a script to help me scrape and clean the duplicates url, one thing I'm not sure if shoud i leave
    https://www.example.com/whatever-here/sample

    or can i just trim it to root level
    https://www.example.com/

    I did however notice if the URL is a link to file, image, pdf it will not check against common directory it will just says no form
  • SvenSven www.GSA-Online.de
    edited March 2023
    Usually it would make no difference because on any normal html webpage, you would have links to the contact form. Thats of course not the case for PDF/Image or alike. So yes, in that case, it makes sense to trim it to the root.
Sign In or Register to comment.