is there an option to scrap internal website links?
Hi,
I'm planning to extract all links from the site have the exact phrase "xxx xx xxx"
or have some words in it's link "xxxsubmit"
so if I search for Google I should type:
site:domain.com/internal1/+"xxx xx xxx"
it gives results in Google search but not in the GSA SERscrapper
also there is another way I'm using now;
is to use imacros to extract urls from a main site page/ or other internal pages
is there any alternative effective way to do that with GSA SER
Thanks in advance ^^
Regards,
B.Shahin
I'm planning to extract all links from the site have the exact phrase "xxx xx xxx"
or have some words in it's link "xxxsubmit"
so if I search for Google I should type:
site:domain.com/internal1/+"xxx xx xxx"
it gives results in Google search but not in the GSA SERscrapper
also there is another way I'm using now;
is to use imacros to extract urls from a main site page/ or other internal pages
is there any alternative effective way to do that with GSA SER
Thanks in advance ^^
Regards,
B.Shahin
Comments
just to confirm,
I add the keywords in the custom project ini file
also add this: add keyword to search=1
then I add this to the project options,
"site:domain.com"
now I see in the log that it's searching in right way,
but it's gives 0 results, is this because of "getting banned very soon"
also is there an option to make some thing like I'm doing with imacros, I just extract the links from the site itself, not searching in Google
Thanks in advance ^^
Regards,
B.Shahin