Several Ideas to make SEO Indexer faster

Sven - I will appreciate your personal answer here to my 2 suggestions

Most of the people using the indexer complain that it is slow and that it has a low indexing rate, so here are my ideas/feature requests which I think can make the whole process much much faster and 100% indexing rate:

1. As proxies are not needed for this service and they don't give you anything, I would Disable proxies by default (This small enhancement alone would make it much faster for all of the newbies which don't touch the default settings)

2. Send every link to 100 indexing sites only, then go to an other link, so if there are 3000 links in the queue it will submit them all to 30,000 sites, then it will go back to the first link, check if it is indexed, if not then it will submit it to the next 100 sites - Every link which is checked and is indexed will be removed from the queue as it is already indexed so there is no need to further "index" it !?

So this suggestion includes the following steps:
2A. Index to rounds of 100 sites.
2B. All sites should remain in the indexing loop till they are indexed
2C. Each site which is checked and found indexed should be removed from the loop

So we will gain a huge speed boost as some links will get indexed after the first round, thus no need for the other 4900 sites to index them
We will gain a huge indexing rate as all sites will get indexed (100% indexing rate)


  • SvenSven
    1. As far as I reviewed, it is disabled by default?
    2. The problem with index checking is that you will need proxies, else google bans you very quickly.
  • Thanks Sven.

    About #2:
    So you can use proxies only for index checking  -does it make sense ?

    I really think that this method will gain the SEO Indexer a huge speed boost as well as much larger indexing rate

    What do you say ?
  • SvenSven
    hmm the problem is still the indexing check part. if proxies are used and say index check is not successful still, i guess it might still take longer till google adds it. so the queue will grow even more.
  • Think about the benefit (it can be optional - checking if the link is indexed) - If a site gets indexed after 100 sites, you will save sending it to 4900 additional sites - it is huge!
  • Another example: If a user has created thousands of blog comments, which are automatically sent to the indexer.

    The indexer could now check them out on the spot and after seeing that they are already indexed, it will tag them as indexed and remove them from the queue.
Sign In or Register to comment.