Skip to content

Links verification

Sven, is it possibly to add to link verification mechanism checking of meta tag meta robots noindex, nofollow and checking of robots.txt file? Because looks like lot of web 20 services limit googlebot from accessing post pages and it hard to find it manually.

Comments

  • SvenSven www.GSA-Online.de
    No, this would take too much time when also parsing robots.txt here for each verification.
Sign In or Register to comment.