@BanditIM am I able to download what I have scraped at the moment with the update that rolled out yesterday? I see that you have introduced the pause button, but I can't see a download button.
It is still in the process of Pausing I think 'Paused - Pausing...' I can only think that a 'Download' button will appear once the campaign has paused succesfully?
@filescape - Yes, it's on the todo list, just not a high priority compared to the other things right now unfortunately.
@Flembot - We currently do not throttle as it is in beta, but if we see too much abuse and we can't keep up with demand we will be forced to charge extra for those two particular footprints that cause us the most trouble.
Our speeds vary as the day progresses due to proxies going up and down. Let's just say it's much faster than any one person could scrape by themselves
We charge for total URLs as that is what GScraper/Scrapebox base their links per second/minute off of. We are competing with that number, so that's what we have to charge for.
@Tim89 - I think there's a bug with your campaign since it was started before we pushed that big update. Results will be downloadable anytime one of the following happens:
1. Daily limit is reached for that campaign 2. Link credits run out 3. You press Pause
The "Pausing..." means that it is waiting for all the currently queued keywords in the queue to finish and return. If there's a lot of them, then this Status could stay like that for a while until the keywords finish.
----
Sorry everybody, beta testing is over, we are getting too backed up by giving too many free credits out. New sign ups will receive a handful of free links to test with when we go live sometime today or tomorrow.
@sing99 - This means if your footprints, such as: powered by Wordpress , aren't already in quotes then you can use this checkbox and ALL footprints will be enclosed in their own quotes. So that footprint for Wordpress would then look like this: "powered by Wordpress". Yes, you will definitely get different results. If ANY of your footprints are already enclosed in footprints, I would not use this function otherwise it will quad-quote it like so: ""powered by Wordpress""
Everyone: Our FAQ has been updated, please check it out
Been playing around with ScrapeBandit for about a day and have to say I like the clean interface and speed...1 click and about an hour later I had links waiting for me in Dropbox. No proxies needed! Can't wait to see the upgrades...
For some reason service became extremely slow recently, i have started a smaller campaign this morning and i have paused it 2-3 hours ago, now it just says Creating file,
Yesterday campaign took a while to complete as well,
@dariobl - We've been pushing out a lot of updates lately, and due to the amount of beta testers we've let in it's caused more than we ever expect to have in a live environment. What was the name of your campaign, I'll take a look.
Edit - My dev informed me the file builder got locked up. It's working now.
@sing99 - It all comes down to the footprints and keywords you use. Footprints can be a combination of the ones listed in GSA's engine files, which will return more accurate results.
Another 90k unique domain after 14 hours of scraping. I don't have a thick-skin but now I can't stop scraping because it was a big opportunity. I scraped over 14 millions linksin 20 hours...
@phuongminhduy - We are going live tomorrow and all new sign ups will receive free test credits to test the system with.
@Idontknow - Glad to hear you like it, thanks for the review! 14 million is rather low in 20 hours, we had a lot of bugs today that caused some backlogs, but we're running full speed again and you should see much faster results
Was running a big scrape last night and it ran out of credit. I've bought some credits but can't get the project to restart (it says "creating files") nor can I get the results from the part of the scrape that did run last night.
What should I do to restart my project ? - (there's no pause/play button visible nor a download button)
@filescape - Sorry about this. We pushed out a LOT of updates late last night (as you can see by the new killer dashboard) and there must have been something that slipped past our bug testing.
We will fix your campaign up and have it start running immediately within the next few hours once my dev wakes up and has time to fix it.
If you previously have an account with us with admin.banditim.com, then you only need to login and confirm your email address. If you do not have an account with us, you may register there (there's a button to click to register on that page - there is no need to register at admin.banditim.com).
If you have any questions feel free to post them here or PM me.
@phuongminhduy - It's pretty straightforward as you can tell from the reviews. If you get lost just contact me, but I would suggest looking at the FAQ first
In your Options, set it to use the Identified Global Site list and point that to your Dropbox file. Then, in your projects on GSA make sure to tick the box to "Use URLs from site list Identified" (says something like that)
We will be going officially live tomorrow. Sometime this week the PRICE WILL INCREASE, so I suggest everyone stock pile credits now if you plan on using the system in the future. Thank you for the continued support!
Comments
Are you able to use site: inurl: footprints in this scraper (including combinations of them both)?
If you can does it throttle them in anyway?
How many footprint/keyword searches will it do in an hour?
Also, what are you charged for? Total URL's or unique URL's found?
Thanks
Beta Tester Waiting ..
B-)
It is still in the process of Pausing I think 'Paused - Pausing...' I can only think that a 'Download' button will appear once the campaign has paused succesfully?
@filescape - Yes, it's on the todo list, just not a high priority compared to the other things right now unfortunately.
@Flembot - We currently do not throttle as it is in beta, but if we see too much abuse and we can't keep up with demand we will be forced to charge extra for those two particular footprints that cause us the most trouble.
Our speeds vary as the day progresses due to proxies going up and down. Let's just say it's much faster than any one person could scrape by themselves
We charge for total URLs as that is what GScraper/Scrapebox base their links per second/minute off of. We are competing with that number, so that's what we have to charge for.
@Tim89 - I think there's a bug with your campaign since it was started before we pushed that big update. Results will be downloadable anytime one of the following happens:
1. Daily limit is reached for that campaign
2. Link credits run out
3. You press Pause
The "Pausing..." means that it is waiting for all the currently queued keywords in the queue to finish and return. If there's a lot of them, then this Status could stay like that for a while until the keywords finish.
----
Sorry everybody, beta testing is over, we are getting too backed up by giving too many free credits out. New sign ups will receive a handful of free links to test with when we go live sometime today or tomorrow.
I think you may be correct, my campaign may be bugged as I don't have a download button for my current scrape yet.
2191854 unique links found
449449 unique domains found
Everyone: Our FAQ has been updated, please check it out
Edit - My dev informed me the file builder got locked up. It's working now.
I don't have a thick-skin but now I can't stop scraping because it was a big opportunity.
I scraped over 14 millions links in 20 hours...
Thank you BanditIM!
@Idontknow - Glad to hear you like it, thanks for the review! 14 million is rather low in 20 hours, we had a lot of bugs today that caused some backlogs, but we're running full speed again and you should see much faster results
Was running a big scrape last night and it ran out of credit. I've bought some credits but can't get the project to restart (it says "creating files") nor can I get the results from the part of the scrape that did run last night.
What should I do to restart my project ? - (there's no pause/play button visible nor a download button)
We will fix your campaign up and have it start running immediately within the next few hours once my dev wakes up and has time to fix it.
Thanks for your patience with us
For any of you that happen to come across this post, you may use the system openly.
New sign ups receive 100,000 FREE link credits (this gets a minimum of 100 search terms to test our system with)
Early Bird pricing is set at $3 = 10 million scraped links. THIS PRICE WILL INCREASE once we get some customers and our sales copy up.
To sign up simply go to this link: http://bit.ly/scraperbandit
If you previously have an account with us with admin.banditim.com, then you only need to login and confirm your email address. If you do not have an account with us, you may register there (there's a button to click to register on that page - there is no need to register at admin.banditim.com).
If you have any questions feel free to post them here or PM me.
Thank you!
How can I setup on GSA auto update the list of your service?
thanx