how big is your keyword list for scraping targets?

PeterParker

I had been using a 3k wordlist i just got from the ent on a quick search.

i remebered i have a huge 6 million list i used to use for hrefer, took me like 4 motnsh to get thru that with hrefer.

would that be too big to use for gsa?

dimitribanks

Yes it is . Split the list to smaller files 1k itch and spintax them then use makro %spinfolder% i use 400k kwds

JudderMan

As above, 10MB is SER's limit for txt files for keywords, which equates to 500k. But, do as @dimitribanks suggested which is even better :P

gooner

yea that method works really well.

You can split the files and add spintax with this tool: https://forum.gsa-online.de/discussion/5712/free-sertools-v1-0-list-editing-tool/p1

RayBan

@dmitribanks, @gooner - why do you use spintax for kw list ? Doesn't SER just use each kw after another ? 

Pratik

@RayBan I think no.

gooner

@rayban - It randomly picks a keyword, that's why spintax

RayBan

@gooner that would be a solution when using SB with furry kyles list. Wil give it a try. 

gooner

@rayban - Yea i have that list in there, works great

RayBan

@gooner - did you upgrade to pro version ? When i try to spin the file, it asks me to upgrade to spintax the file. 

gooner

@rayban - no i didn't upgrade, maybe you missed something there?

I don't have the software installed any more so i can't test it right now, but if you can't figure it out give me a shout and i will install again.