I load 50k sites, 14k gets loaded

Molotov

i have deduped [by domain] list of 50k sites.
i load em to new project. priject saya 14k loaded.

whats up?

Sven

Thats normal. The program is not loading all of the URLs at once, just a couple of them and starts to load some more when all are done. You see it when it loads them the first time. The reason behind this is to not wast memory while loading a massive URL list into memory while it can only proceed a number of them anyway at a time.