I purchased a couple of lists the other day and have noticed an issue with the left Target URLs but not sure if its causing issues with the project.
Basically I have turned off the search engines so the project is not scraping at all, just feeding from two separate lists. When I was setting up the project to start with the lists I did clear the URL cache and target URL history (but didn't delete the accounts). At the time the Left Target URLs was somewhere around 33 million which I thought was unusual.
Since clearing it though and running with the two lists, its been just over a day and checking on it this morning after noticing it running quite slow I saw the left Target URLs is now at 46 million.
This is my kitchen sink project but I noticed a Blog Comment project showing something similar (around 26million) the other day too.
So how does the list get so large in just a couple of days? The lists had a combined total under 200,000 URLs
And is this causing an issue with the projects? Surely such a large number of URLs will cause it to slow down
Anyone else getting a similar problem?