A/B testing is a powerful tool to make the most out of your campaigns. Below are the top best practices for marketers to follow for optimal results.
A/B testing in Mapp's Whiteboard is also available for Push Messages!
One thing at a time | For meaningful results, only test one variable at a time. For example, test different subject lines or different content layout. Don't try to test multiple variables in one sendout. | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Make a testing plan | Example:
| |||||||||||||||
Prioritize your tests | It’s not much use testing different call-to-action buttons if your open rates are low. Test the subject line first in this case! | |||||||||||||||
Sample size | Ensure that the size of your test samples is sufficient. The more data points you get, the more reliable they are.
| |||||||||||||||
Leverage existing data | Use existing statistics on Opens or Clicks to determine how many days should elapse before the main sendout. Make sure that enough time is allowed for the system to properly learn about recipient reactions. | |||||||||||||||
Document what you do | Keep track of your tests, you won't remember all results! | |||||||||||||||
Keep revisiting | What worked 12 months ago, may not work today, so challenge your sendouts and keep them fresh! |