Skip to content

I load 50k sites, 14k gets loaded

edited October 2012 in Bugs
i have deduped [by domain] list of 50k sites.
i load em to new project. priject saya 14k loaded.

whats up?


  • SvenSven
    Thats normal. The program is not loading all of the URLs at once, just a couple of them and starts to load some more when all are done. You see it when it loads them the first time. The reason behind this is to not wast memory while loading a massive URL list into memory while it can only proceed a number of them anyway at a time.
Sign In or Register to comment.