Skip to content

Scrape all links from Search Engine

dymek91dymek91
in Need Help
Hello,

How can I force GSA to load all links when scraping from Search Engine? I have my own script to find target links which is  connected to GSA by custom Search Engine function. When script is requested it outputs all links and deletes them so list is unique each time. The issue is GSA is not loading those links all at once so most off them are getting lost unused. 



As on the image above, only 5 links has been loaded. 

Comments

  • SvenSven www.GSA-Online.de
    well on that screenshot you can see 5 of 416 URLs are used. The rest are the links that the software already visited on that project. It would make no sense to do this again.
  • dymek91dymek91
    ahh, so gsa reads all links then check for duplicates and report on ones that will be used. That makes sense, thank you for clarification! 
Sign In or Register to comment.