Question about GSA SEO Indexer
My GSA SER seems to be dumping TONS of url's to the indexer. It wasn't doing it at first, it took a few days, not it won't stop. It's in the high tens of thousands. And each one takes about a minute to do, but it looks like lots of sites are going by for each one. Yet the number of URL's in the queue keeps getting added to. Even not running a project for a few days the indexer was barely able to make a dent in the numbers. I'm not sure how to deal with this. Because it takes up thread power and slows down the main program.
1) You can restrict the urls that get sent to GSA SEO Indexer in the Indexing settings window. Setting a min/max PR (if you use a PR emulator), or submitting dofollow links only, or the 'Send only certain engine types' option should allow you to whittle down the links that get sent (eg it's probably useless sending anything not contextual).
2) Use a 3rd party service for indexing, free up all those resources and never have to think of it again.
I don't currently need a 3rd party indexer but in the past I've had the best results with Speed-Links.