Get my 5-day email funnel that generated $400,000 from a single launch

Want an email sales funnel that's already proven to work? Get the entire word-for-word email funnel that generated $400,000 from a single launch and apply it to your own business.

Yes! Send me the funnel now
Start Here: “The Ultimate Guide to Habits”

Inside test results from IWT “Labs”

8 Comments- Get free updates of new posts here


What do you guys do for fun? Go out to bars? See a movie?

What about run carefully designed, iterative multi-variate tests to study human behavior?

What? Is that weird?

Check out this test data from I Will Teach You To Be Rich Labs, where we’re running dozens of tactical and theoretical tests at any given time.

I wanted to try a really simple test — two completely different designs to see which would produce more email subscriptions. So we designed two totally different pages for a recent contest I ran:

Contest A

Contest B

With over 20,000 data points and statistical confidence, which do you think worked better?

Data Table

Yes, this is a table of data. Yes, this will remind you of college when you didn’t understand the data there, either.

ANSWER: No change!

Despite being totally different designs, the results were basically identical.

One of the surprising secrets of testing is that MOST tests produce no change. Online marketers don’t tell you this because it’s not sexy and kind of depressing. It’s like guys going out to bars, predator style, then the next morning, telling their friends last night was “CRAZY”…but neglecting to mention the fact that they didn’t really meet any girls.

In my experience running tests, once in awhile, you’ll find a small change (3%), and once in a blue moon, you’ll get a huge huge win — a total twist that changes everything. To put things in perspective, I find about 2 HUGE WINS every year….out of hundreds of tests. But they are big enough to pay for me running IWT Labs and giving you dirty jokes every couple days on my email list.

Btw, people who follow me on will know of one that I recently wrote about that transformed my business. If you’re not following me there, and you want to see me make fun of some of the really dumb comments I get, check it out.

Anyway, back to you. I could spend all day talking about testing theory, but we both know you don’t care. Most people are like ZOMG RAMIT GIMME THE GOOD TESTS PLS~!~##

Tests That Produced Big Results
I know you’d rather hear about the Big Win tests, so I figured I’d share a few good ones with you.

  • My friend Noah Kagan, founder of AppSumo, ran one simple price test that skyrocketed his conversions and revenue while simultaneously lowering his returns. (Can you guess what the test was?)
  • Dating expert Nicholas Kho used testing to discover the one text message that will get 90% of VIPs (and women) to respond to you.
  • Primal nutrition expert Mark Sisson used testing to change his body composition with just one 20-minute workout a week.

If you’re curious about the exact test results, I created a new ebook that includes 15 little life experiments you can use today.


It’s totally free. No upsells, no nothing. Get your copy today, my treat:


Related Articles

standard post picture

How to not hate live events

I recently spoke at a conference in the Bay Area where the speaker introduced me as saying, “AND WE GOT ...

Read More

The diffusion of responsibility: Why you need to stop CC’ing people

I receive 1,000+ emails every day. And while I read every one of them, most emails get ignored. That’...

Read More



Leave a Reply

8 Comments on "Inside test results from IWT “Labs”"

Notify of

Sort by:   newest | oldest
Jorn Trommelen
3 years 11 months ago

So true. Marketers not talking about null-results seems similair to the reporting bias in science.

But they simply give people what they want to hear. Just compare the buzz about your positive results test to the response of this null-results test.

Well played Ramit, you succesfully tested that talking about null-results sucks.

3 years 11 months ago

I think Im subscribed to the wrong mailing list because I rarely ever get dirty jokes from you.

3 years 11 months ago

I don’t get dirty jokes from the e-mail list I’m on, either. Hmmmm…must be a multi-variate test to see if females are offended by dirty jokes. Guess what? Some of us aren’t.

Chris Johnson
3 years 11 months ago

One of the ways to find your wins – and we use this- is to find a plausible failure. Meaning: you might try to find a variant that reduces conversion/lift. we have had better luck finding variance…this way.

Lewis LaLanne
3 years 11 months ago
Love your truth telling Ramit! Most people that make a living investing in the stock market are NOT winners. Of the people who are winners – the top 5-15% – they make all of their money on only a few of their trades. So out of a 100 trades they made for that year, the majority of their money will have come from 5-10 trades they made where they hit it out of the park. Most of their other trades will have lost them money. Same thing holds true for poker – most of your winnings will have come from… Read more »
Sunil @ The CPA Profession
3 years 11 months ago
in my experience I have noticed that although change does make an impact (thus testing works), it works short term mainly because of the variation (readers are not used to seeing a different look and feel). what many marketers will not reveal however is the post test results as they tend to normalize. thus, few months/years later, another test is necessary to shake things up, only to see results go back to the norm again. I feel it’s similar to the whole night club/bar concept. the venue doesn’t change, but the name changes every so often. one club shuts down… Read more »
Lance Jones
3 years 11 months ago
“Despite being totally different designs, the results were basically identical.” Ramit, I respectfully submit (as someone who has overseen more than 1,000 tests and driven the optimization programs for Adobe and Intuit) that there are no *meaningful* differences between these two pages. Visual differences, sure, but in the *minds* of the 20,000 visitors who saw these, what impact did you expect these changes to have? What was your original hypothesis? The only hypothesis that I can reverse engineer is that the funny image of the dog would get more people to take the next step — and if that was… Read more »