Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Question on adding your own search engine

Hi Guys,

Just a quick question, i am scraping my own targets and am adding in real time to a database, i am adding the url for example:

http://www.site.com/crawler/api-crawler.php?s=1&page=1

I notice in the logs while running GSA is trying to search for a string like:

19:31:47: [ ] 007/250 [Page END] results on 24/7 Scraper for Joomla K2 with query "Create an account" "Forgot your password?" "Login Form" "Remember Me" "Log in" "Forgot your username?"

is this right enough? or can i turn the search query off?

cheers guys

Graham



Best Answer

  • SvenSven www.GSA-Online.de
    Accepted Answer
    Well of course SER has to search for something in a search engine. However just add a dummy paramater with %search% to your URL and it will get added but what you give back in your search url is your part. SER does not check if the items appear on the page.

Answers

Sign In or Register to comment.