Still problems crawling URLs
Hello,
I still have a problem when crawling my own URLs with proxies enabled.
When I try to crawl URLs from my own site GSA only shows the main URL and then stops (I crawl 10 levels deep), GSA doesn't find any of the hundreds of other pages from my website. This only happens when I use proxies (I use private, veryfied proxies). When I crawl without proxies GSA finds all the pages.
What is wrong, can anybody help please?
I still have a problem when crawling my own URLs with proxies enabled.
When I try to crawl URLs from my own site GSA only shows the main URL and then stops (I crawl 10 levels deep), GSA doesn't find any of the hundreds of other pages from my website. This only happens when I use proxies (I use private, veryfied proxies). When I crawl without proxies GSA finds all the pages.
What is wrong, can anybody help please?
Comments