Verifications Extremely Low - Help to Resolve
I realize that verification issues can be due to a whole myriad of different items, however last time I had reported these issues (a few months back), there was actually a legit issue with the software and the bug was fixed. I am also experienced enough to look for and test out the basic culprits (proxies, emails, etc). With that being said, here is my problem.....
About 2 weeks ago, I started using more SEs (English and non English speaking) with SER (92 total) and also "finally" switched over to catchall emails (yes, they are working and receiving all verification emails). I also started a completely new project (new keywords, new spun articles, etc). On the initial run, I noticed that verifications were very low compared to what I was use to receiving (20-30%). I stopped, made a few adjustments, and still received low verifications (5-10%). I wasn't able to test much, because I had to leave for a 2 week holiday vacation. Now that I'm back.....here are the tests I have conducted.
- With private proxies (80 threads with 30 sec timeout) - 437/29 verified. 6.6% verification percentage.
- Without proxies (100 threds with 30 sec timeout) - 362/29 verified. 8% verification. Percentage would have been lower if I let it run longer.
- New Hotmail acct (switched over from catchall. Left on overnight) - 834/28 verified. 3.3% verification.
Sources I am using (pretty broad, but I got great verifications with them in the past) - Articles, Forum, Microblog, Guestbook, Images, Blog comment, SB, SN, Web 2.0.
Now I have kept all settings consistent over a long period of time, other than my 2 latest adjustments mentioned above (catchall/more SEs). At this point, there are only 2 conclusions I can come up with, at this time, for the extremely low verifications.
1. Addition of more SEs, including other countries that are not native English speaking.
2. Bug(s) within SER that need to be smoothed out.
NOTE: If anyone else has been experiencing this as well. Please post here as this may help eliminate 1 of the 2 factors mentioned.
About 2 weeks ago, I started using more SEs (English and non English speaking) with SER (92 total) and also "finally" switched over to catchall emails (yes, they are working and receiving all verification emails). I also started a completely new project (new keywords, new spun articles, etc). On the initial run, I noticed that verifications were very low compared to what I was use to receiving (20-30%). I stopped, made a few adjustments, and still received low verifications (5-10%). I wasn't able to test much, because I had to leave for a 2 week holiday vacation. Now that I'm back.....here are the tests I have conducted.
- With private proxies (80 threads with 30 sec timeout) - 437/29 verified. 6.6% verification percentage.
- Without proxies (100 threds with 30 sec timeout) - 362/29 verified. 8% verification. Percentage would have been lower if I let it run longer.
- New Hotmail acct (switched over from catchall. Left on overnight) - 834/28 verified. 3.3% verification.
Sources I am using (pretty broad, but I got great verifications with them in the past) - Articles, Forum, Microblog, Guestbook, Images, Blog comment, SB, SN, Web 2.0.
Now I have kept all settings consistent over a long period of time, other than my 2 latest adjustments mentioned above (catchall/more SEs). At this point, there are only 2 conclusions I can come up with, at this time, for the extremely low verifications.
1. Addition of more SEs, including other countries that are not native English speaking.
2. Bug(s) within SER that need to be smoothed out.
NOTE: If anyone else has been experiencing this as well. Please post here as this may help eliminate 1 of the 2 factors mentioned.
Tagged:
Comments
Your html timeout is set to low, max it, then work down to your sweet spot.
Depending on speed of private proxies, its normally about the 130 > 140 area
I know my settings are more than adequate for US SEs, HOWEVER, this is a great point for those who are using SEs (like myself) outside the US. Will put it to the test. Thanks!
What is so inaccurate about the submitted/verification results? The calculation is accurate, however I do realize that I could split up each "source" and test out the rate of each. I'm not ready to go divide everything up like that yet (time consuming), but if needed, I might. You have to realize I am testing against a "constant subject" (combined sources). I have used the above mentioned sources (forum, SB, SN, etc) with other projects and received admirable verification rates. I don't want to start splitting things up and then re-testing as that really won't point me to the true issue. You have to always test against a stable constant in order to start deducing the problem.
I totally agree with you on the verification ratio GUI. That would be a VERY nice feature. I'm not sure why Sven wouldn't implement this, as it's not doing anything but simple math for us. I would think this would be fairly simple to implement.
Filters? I don't think you mean the "filters" option under the MAIN options button. I assume you are speaking of the "Project Criteria" options. No I haven't changed these as well. I am fairly sure this is not the issue. If it was, it wouldn't effect the verification rate, only the amount of submissions that SER would be able to submit.
Based on your example: SER will find more pages with an OBL of 1000 compared to an OBL of 10 which equals more submissions not verifications. Now you could make the argument that sites with OBL of 1000 will have more auto approves, thus leading to more verifications, however this is not the case. My OBL is 125 and has been tested around the 100-150 marker, all leading to the same verifications. Again, this is a "constant" marker as well in my tests.
I could break the constant down to a per platform basis, but that defeats the purpose at this particular moment. ;-) Understand that the only reason why I have a constant is because I have used this setting for a long time and I know what to expect from it on daily use with verifications. I already realize that verifications have dropped with my constant (settings being the same throughout), now I have to find out why. The only variables changed are the SEs used and the use of catchall emails. I've tested out all other variables, and at the moment it seems as if selecting more SE's from other non english speaking countries will pull in results with lower verifications.
Additionally, I have many projects to run and don't intend on splitting up each project into 3-6 separate "micro projects".......maybe 2 at most. I can also view which sources have been producing more verifications by simple looking at the Show Diagram Chart figures. Seems as if Forums are the winner by a landslide followed by guestbook and social networks. Also note.....I have been running GSA at least 8+ hours a day for 3-4 days (this includes stoppages to change settings). At only 208 verifications, that's pretty pathetic.
TEST RESULTS
As for test results....here is what I came up with over the last few days.
- 60 threads/120 custom timeout - 740/77 - 10.4% verifications (better)
- 80 threads/140 custom timeout - 196/25 - 12.7% verifications (better, but too small sample rate to jump to any conclusions)
- 80 threads/140 custom timeout WITH 120 HTML Timeout - 457/17 - 3.7% verifications (this was run for 10+ hours. Not only did I receive much less submitted, which was to be expected, but the verifications are horrible.) Conclusion - going back to default 30-40 sec HTML timeouts.
I'd still like to hear from others to see what their percentages have been over the last few weeks. I am merely trying to accomplish 20% or higher verifications with the sources I have. I remember a day, a few months ago, when I was receiving 40%+ verification rates on average, according to my settings and standards of use.
The last variable to be tested will be the # of SEs used, which I will save for last. It was my hope that I could broaden the scope of SEs and receive more results, but it may be working against me instead of for me!! :-(
3. Who knows if they overlap. That is something you will never be able to view or test.
How would a catchall get blacklisted if your using variations of emails on every single submission? The only part that may be blacklisted is the domain, which I'm not sure how to check. CheckForumSpam doesn't allow you to check domains, just email addresses. I highly doubt this is the case since I just started using this domain.
You could really help me out Global by giving me the latest verification rates you are receiving with SER on your particular campaigns. If your verifications have been adequate, let me know what settings you are using (like # of threads, proxies, custom timeout, and types of SEs selected).
So far I'm running SER with a low thread count and high custom timeout and it seems to be doing well so far.......however it just started. 34/17 is the current stat.
I'll check out the other links you gave me tomorrow. Thanks for your input Global!
BTW, I'm going to request a "submissions" tracking feature for the Show/Diagram Chart. I always enjoyed looking over my verification stats on that chart, but it would be soooo much better if it had the submission stats as well.
This way we can view the verification rates of each source, according to a set criteria of dates. We can then determine which sources are offering better verifications without splitting up the projects into so many separate "micro projects" for each source.
Here is the link: https://forum.gsa-online.de/discussion/1450/show-diagramchart-submissions ....I'd appreciate a +1 on the post, if you agree with the feature. ;-)
Proxies - 40 threads w 20 private proxies/ 120 custom timeout - 200/70 = 35% verification rate :-) I think I hit that sweetspot.
Yeah....custom timeout = your proxy timeout under proxy configure > options. I would set this to 30-40 seconds (some recommend 5-10 seconds). I would use HTML timeout of 120. I can't say whether your thread count is right because again, I don't know how many proxies your using. Also, uncheck the "custom wait time between search engines".
1421/40 is a very low at 2.8% verification rate. You should be aiming for around 20%+
@hyde - That's an abnormally high verification rate. Most tend to be at 15% - 20% - but that's for just about all platforms together. Are you focusing on just a few platforms? Or are you importing lists? Because both of those can skew the verification rate upwards.
@Ozz - That's not entirely high, even though I have read about users utilizing 5-10 seconds. I was under the impression that this is the timeout for page load with the proxies and not the time it takes for a proxy to be recognized. The least amount I would set this to is 5-10 secs if the timeout is truly corresponding to proxy recognition.
I don't understand >>"how
do you manage that option with private proxies anyway? Do you have it
set like this and parse your private proxies every time from a txt-file?"
I've been told by specifically by Sven (posed the exact question in another thread) that the threads posted under proxies are the # of threads used by the proxies. The main thread under General Options is for # of threads without proxies. They are controlled separately. The timeout under proxies I am still unsure about, as mentioned above. Either timeout for page loads or proxy recognition.
I'm going to dig for the "exact" question I sent Sven about this and his response now.......
Note: "proxies have there own threads handling. It's independent."
:-?