Where is the option to disable filtering redirects? I could not manage to find it yet.
I often see cases where users enter a http://domain.com website somewhere but when the url is loaded, the server automatically redirects it to the secure https://domain.com version.
When there is a redirect filter, that means that the software will ignore all the URLs that have redirects? If so, that means that it will not even scrape the initial URL, because it won't find the contact form there as it will be instantly redirected to new URL. Is that correct? P.S. I hope what I wrote makes sense.
Comments
I often see cases where users enter a http://domain.com website somewhere but when the url is loaded, the server automatically redirects it to the secure https://domain.com version.
P.S. I hope what I wrote makes sense.