Skip to content

parse domain for URLs?

upgiantupgiant
in GSA Email Spider
Is it possible to use GSA Email Spider for parse a domain for URLs?

Comments

  • SvenSven www.GSA-Online.de
    Sorry I don't get what you mean with this?
  • upgiantupgiant
    Let's take domain www.abc.com

    It's a directory with 10,000 pages for 10k businesses

    On each page, there's a link to each businesses home page

    Is there any way to scrape the domain for every URL?
  • SvenSven www.GSA-Online.de
    sure, each link not being of domain abc.com is treated as external link. you can set it up to parse external links up to a certain level.
  • T63T63 Singapore
    Sven arent you sayin ghe can scrape emails from external domains - or he can capture the actual domain list?
  • upgiantupgiant
    T63, I figured out a way to accomplish what I was trying to do.

    There's a feature, "capture extra information". If the extra information is in the same HTML tags on each page, you can parse the entire domain and capture everything that's in that extra information.

    Make sure to select to capture the information even if the email isn't present.
Sign In or Register to comment.