Skip to content

is there an option to scrap internal website links?

Hi,
I'm planning to extract all links from the site have the exact phrase "xxx xx xxx"
or have some words in it's link "xxxsubmit"

so if I search for Google I should type:
site:domain.com/internal1/+"xxx xx xxx"
it gives results in Google search but not in the GSA SERscrapper

also there is another way I'm using now;
is to use imacros to extract urls from a main site page/ or other internal pages

is there any alternative effective way to do that with GSA SER

Thanks in advance ^^

Regards,
B.Shahin

Comments

  • SvenSven www.GSA-Online.de
    You can use this as keyword in your project itself and let it search sites directly and post. You should enable the option to always use keywords but this is also resulting in low results. Also note that using any special search parameter like "site:" "inurl:" or "intitle:" will get G.'s attention and will require a bigger waiting time between search queries, else you get banned very soon.
  • Thanks for support ^^

    just to confirm,
    I add the keywords in the custom project ini file
    also add this: add keyword to search=1

    then I add this to the project options,
    "site:domain.com"

    now I see in the log that it's searching in right way,
    but it's gives 0 results, is this because of "getting banned very soon"

    also is there an option to make some thing like I'm doing with imacros, I just extract the links from the site itself, not searching in Google

    Thanks in advance ^^

    Regards,
    B.Shahin
Sign In or Register to comment.