gsa does not write all urls to custom file
i am scraping using gsa on the backend
search online for urls
i have set it to write to "custom file"
i have cheched where it is writing the file to & it is writing to the correct file & the file size (the .txt file) goes up all the time, but it is not putting all the urls on there, the scraper says 11,907 urls identified, but there were only 2900 urls in the .txt file, i have done it a few times & it is still doing the same,
i know gsa does not always write to file straight away, but i have taken account of this as well.
every time it only puts a percentage of the urls in the .txt file
it is putting some of the scraped urls in the file, so it is sending the urls to the correct file, but not all of them.