Import URL Questions
I have two questions when it comes to importing URL's...
1) Sometimes I'll Import URL's (New Project no URLS in cache etc) and it will say 500k URLS imported.... I will then goto Show URLS > and it will only show say 30k. What gives?
2) Lets say your running a project off your verified list but you exhaust it - You then scrape more targets and build your list some more - Does SER Automatically find the targets and build links for the originall project?
1) Sometimes I'll Import URL's (New Project no URLS in cache etc) and it will say 500k URLS imported.... I will then goto Show URLS > and it will only show say 30k. What gives?
2) Lets say your running a project off your verified list but you exhaust it - You then scrape more targets and build your list some more - Does SER Automatically find the targets and build links for the originall project?
Comments
1) Usually because the URLs are duplicates.
2) Yes, but of course it is faster if you import the URLs directly to the project.
2) Awesome
I've scraped a list of URL's using Scrapebox.
It comes out to say, 500k URLS. I remove Dupes.
I right click project > Import URLS > Import from File (or Clipboard doesnt matter) and it says "SER Has Imported 500k URLS"
I then goto Show URLS > URLS Remaining and it only shows say 10k (or some number less than what was imported)
I've tried changing the encoding of the files and it does the same thing.
I'll give that a try, one minute.
Show URLS > Showed 330 URLS.
I started projoect.
It jumped to 17k
Some URL's had EOF characters which were messing up the count.