It will search on search engines and save the found URLs to the target url cache of the project. It is not trying to parse the URLs for correct engines or alike.
sonabulghadaryan
Why it is for? For scraping?
Sven www.GSA-Online.de
yes, to let a projects just search for targets and post later.
sonabulghadaryan
and where is cache of the project? what is the name.
Cant it keep the scraped list in identified site list?
Sven www.GSA-Online.de
the file is called *.new_targets.
It will not add that to identified list as that would require it to download each URL and check. Thats useless traffic.
sonabulghadaryan
i could find just targets not new_targets
Sven www.GSA-Online.de
That file exists only if you import URLs (queu them for next processing).
Comments
the file is called *.new_targets.
It will not add that to identified list as that would require it to download each URL and check. Thats useless traffic.