FYI: Hotmail better than rediff
For the past couple of days I ran a test on a tier 3 all-in-one project. The setup of the test projects was exactly the same bit for bit, except for the email settings which in one case were a batch of 10 hotmail accounts and in the other a set of 10 rediff emails.
The hotmail accounts outperformed the rediff ones by about 10 pp (percentage points, so e.g. 50%+10pp = 60%, but 50%+20% = 60%) (i.e. roughly the same amount of submissions, hotmail gave me +10 pp verifieds). The result based on the sample size had a 98% confidence level (i.e. there is a 98% chance the hotmail accounts will perform much better than the rediff ones).
Interested in a batch of 20 yahoo emails for testing purposes now - if you have them, just pm me.
The hotmail accounts outperformed the rediff ones by about 10 pp (percentage points, so e.g. 50%+10pp = 60%, but 50%+20% = 60%) (i.e. roughly the same amount of submissions, hotmail gave me +10 pp verifieds). The result based on the sample size had a 98% confidence level (i.e. there is a 98% chance the hotmail accounts will perform much better than the rediff ones).
Interested in a batch of 20 yahoo emails for testing purposes now - if you have them, just pm me.
Comments
We tested using proxies and 900 sec delay too.
We'll be publishing results soon. Here's a preview of results:
We'll explain what each project was in more detail when we publish the test.
How big was the list you imported?
What kind of distribution did you use? chi-square?
We just let SER run as it normally would, brand new projects and the same list imported into each project.
Why do you think auto-verification will skew the results?
Retesting with a completely different list now - will make a blast, wait a few hours, verify and see what comes out of it.
Or maybe we could run this test 10 times and have 10 different results lol
Had another go:
blue list, not randomized, different project, different mails
hotmail - 2459 submissions, 446 verified links
rediff - 2398 submissions, 453 verified links
the outcome were only blog / image comment and directory links, so guess I got the wrong part of the list again. Now for the best part - the result is inconclusive, as I would need 21677 submissions more to reach at least 95% certainty of the result (I would need 21677 more submissions to tell if hotmail or rediff is better). But at least I can say that for comments and directory links it doesn't seem to make much of a difference difference if you use hotmail or rediff (because I need such a large number of submissions the difference must be very small to exactly pinpoint), so I will exclude them from the next test.
1. XpressEngine
2. Drupal – Blog
3. Wordpress Article
4. BuddyPress
5. Zendesk
6. Moodle
7. Article Script
8. vBulletin – Blog