Newly added URLs top or bottom?
I have gone from mixed scraping and posting to just getting URL lists and posting direct, which has taken my LPM from 4 / min to 62/min on my 17MB home broadband connection. Fantastic.
Question on my mind, if I have 1,000,000 URLs on my site lists from potentially old links, then I do an import of a new list, do the new URLs go to the top or the bottom of the stack?
Comments
1) Existing targets list (any urls you have already imported/scraped)
2) Imported targets list
3) Verified site urls (if this option is selected)
Hope that helps.