In this article you will find out:

  • What is A/B testing
  • Why you should learn A/B testing in your email activities

There are several reasons why you use email marketing.

Firstly, email is the best digital marketing channel in terms of ROI.

Secondly, you send emails to someone who already showed some interest in your product and left you their email address to receive more information.

And finally, in many instances it is better and more effective to try to convert more people that are already in contact with you than raise the traffic.

But, of course, you want more and you want your email marketing perform at its best.

A/B testing can help you with that as it is an ultimate tool to learn preferences of your own subscription base first hand.

What is A/B testing?

A/B testing is an experiment where you test a hypothesis on your users’ preferences with two variants A and B. These variants are control (usually, the variant you used before) and variation (a new variant usually containing one changed element).

The goal of A/B testing is to identify which variant performs better. In case of email marketing the usual measure of performance is open and click-through rates, as well as conversions.

For instance, the simplified version A/B testing can look like this. You have a weekly newsletter and you usually use the subject line “Summary of the week”. You want to check what will happen if you change the subject line (the body of the letter remains the same). Thus you randomly divide your subscription list in half and send one of the letters to one half and the other letter to the second half. Then you measure the results.

splash-dwb-images-full4

Source: Ripen Ecommerce

However, in reality to get statistically significant results you have to consider some factors like sample size, timing, segment inside you email list, the number of changes you make in variation, the number of test you run etc.

What can you A/B test in emails?

The most common elements of email A/B testing are:

  1. Sender email address
  2. Subject line
  3. From name
  4. Pre-header text
  5. Personalization
  6. Email body
  7. Calls to action
  8. Layout of your email
  9. Images
  10. Special offers (what kind of offer is more attractive for your customers)

What to test depends on success of your current email campaigns. If you have high open rate, but very low click through rate you could experiment with email content: calls to action, images, or offers. And when you have low open rate, try to test subject line.

SitePoint-AB-test-email

Source: Campaign Monitor

Why should you use email A/B testing?

1. Email A/B lets you know your audience better

You studied your target audience; you know how it looks like. You even created personas and segmented your mail list based on this information. You approximately know what pains, fears, uncertainties and doubts they have, but you are still not really sure.

In other words, you have a hypothesis, but you don’t know if it is true. A/B testing allows you to confirm or discard your hypothesis.

2. Email A/B testing lets you to figure out what works the best for your specific audience

Probably, you have read a lot of articles on best practices in email marketing and tried to apply them to your case. But these best practices are not a sure thing. You can try them, but they might not work.

A/B testing helps you to figure out what works the best for your audience: images on the right or on the left, simple minimalist design or HTML-heavy look, red or green color etc.

ab-testing-email-marketing-campaigns

Source: Tribes

3. Email A/B testing is a science-backed method

Often things in marketing are based on your gut feeling or experience. A/B testing is a scientific way to prove that your gut feeling is right. So, your marketing efforts stop being a guessing game and are backed up by real data.

4. Email A/B testing brings you valuable data

Properly created tests bring you really valuable data that no market research gives you, because it is data on your own customers rather than on abstract market.

5. Email A/B testing is a great tool to increase conversions

The ultimate goal of your marketing efforts is conversions. The type of conversion depends on the type of your website. For instance, for ecommerce it is a purchase while for blog it is a subscription.

As was mentioned before, email A/B testing is a great tool to understand your audience and give them what they want.

6. Email A/B testing helps you to be competitive and follow trends

A/B testing is not one-time practice; it should be done continuously over a period of time to bring you brilliant results. Regular email testing keeps you ahead of your competitors, because you constantly measure how the tastes of your audience change.

7. Email A/B testing is easy and cheap

Email automation made email marketing dirt cheap. Most ESPs offer A/B testing as a part of their package deal, so it doesn’t cost you extra money. And modern user-friendly interfaces have made it really easy to set up your first test.

Key points of this article:

  1. There are several good reasons to make email marketing one of your digital marketing channels.
  2. You can make email marketing even better by constantly using A/B testing of your email campaigns.
  3. *Being cheap and easy, email A/B testing lets you to gather valuable data on your audience’s preferences, understand your audience better and increase conversions. *
Author
Roland Pokornyik

Roland Pokornyik

CEO / Co-founder @ Chamaileon.io & EDMdesigner.com

  • Visual Email Testing with Developer Tools, Litmus and Email on Acid Visual Email Testing with Developer Tools, Litmus and Email on Acid

    Have you ever struggled with email testing before? The browser developer tools, Litmus and Email on Acid can help you. See how to use them together.

    Read more
  • How to Use JavaScript for Creating HTML Email Layouts How to Use JavaScript for Creating HTML Email Layouts

    Does it take you 1+ hour to code an HTML email template? Maybe it's time to reconsider your workflow. Learn how to create email layouts with scripts.

    Read more
  • How to Use Sublime Text for HTML Email Development How to Use Sublime Text for HTML Email Development

    Do you want to cut the development time of your next HTML email template in half? Streamline coding productivity with Sublime Text's greatest features.

    Read more