Hard time getting Gscraper to work to its full potential. Anyone experiencing diffculties with it?
get it to work to its full potential. Never used it before so maybe I am doing
something wrong. Hopefully someone of you out there most experienced with it
can help.
Have been searching for solution everywhere and there is no info about that anywhere
that’s why I have been forced to post here.
I am using decent SolidSEOVps with 50 private proxies
Using the promised 1 month unlimited proxies from Gscrpaer
in Gscraper.
I set the Gscraper up
with gsa footprints several days ago and ended up with around 500,000 urls.
Now, I hit check pr on a domain level and had to wait like 5h or so more in
order to finish that task. After it was finished I loaded the remaining 150,000
or so remaining in gsa and started the project. After few hours it ran out of
targets. and thatwsit...so what, do I have to wait 5 days more to scrape
another 500,000 urls in order to start the project again? That’s just for 1
project, what about the other I have it will take ages.
Tried to run another project, and result you can only have 1
instance running and NO MORE. That’s what the support email said when I sent
one for help.
slow. For 1h has checked only 0.01% and it freezes. So I cant use these either.
Now today its not even letting me to use the proxies from the
gscraper server it shows message "Operation failed, cannot connect to
Gscraper server or your additional service has expired"
Shot another email to the developer maybe they can tell me
something also
Hoping someone can enlighten me what have I done or what had
gone wrong.
Will appreciate if you point me to some good tutorials out
there. Also which scraper is best in your opinion. I am willing to change if necessary
Thank you in advance
Comments
Thats my personal experience. I harvest alot and process alot (identified stats from 1 server). Note - im talking here about drupals not other engines. Some engines are easy. You have 10k identified unique domains and you will get 1-5k verified from this. Other engines (like for example drupal, wordpress) are harder - you will harvest alot domains but you wont get alot links.
>:P
It would be also very helpful for all of us if more people give their experience and opinion about those tools
So if anyone have a better experience it would be great to throw more light on the subject
As I said earlier i am frustrated and dont understand how can I kkep up feeding all my projects in GSA with the scraped links using Gscraper if fter I scraped for 5 days for just 1 project then filtered 150,000 pr domains I loaded in gsa and started the project. After few hours it ran out of
targets. and thats it...so what, do I have to wait 5 days more to scrape
another 500,000 urls in order to start the project again? That’s just for 1
project, what about the other I have it will take ages.
Then I tried to run another project, and result you can only have 1 instance running and NO MORE.
How do you use them exactly to always keep feeding with good scraped URLs all your projects?