Menu

Search for:

10 Email Testing Pitfalls + 15 Pro Tips

Email is a numbers game, and we have all kinds of numbers we can measure. But when it comes right down to what really matters, money is the most important metric. And the more of it you earn, the better your ROI, right? The challenge is, knowing how to make more of it. And that’s why we test.

However, testing is kind of like flossing your teeth. You know you should do it, but you oftentimes only do a poor job or skip it altogether…until your semi-annual trip to the dentist looms large on your calendar. Then you’re flossing daily, but you can’t really undo all the neglect from the days, weeks or months you skipped.

The takeaway here is that flossing should be a regular habit—and testing should too. And like flossing, testing should be done to maximize results. Unlike flossing, there isn’t one set way to test to get one predetermined result. We’ve performed thousands of tests in our 18 years in this business. We still don’t know what will work, because it all varies greatly depending user-base and company, and best practices are only temporary at best.

However, we have gleaned quite a list of testing do’s and don’ts over the years, and we present them here, both the common pitfalls to avoid and tips for better testing.

Above all, remember that testing only seems hard. It’s not.

10 common email testing pitfalls

Below are the mistakes we commonly see marketers making—marketers who are well intentioned and want to test, but who are also getting in their own way when they do so. We highly recommend you avoid these:

Waiting for IT or others to help make the testing happen. This is the slow death of a successful promotional email.

Using unequal data sets. Be they quantity or records and time periods.

Focusing in inconsequential details, otherwise known as not seeing the forest for the trees. When marketers test for logos, footer text, and little things like that, they are losing the opportunity to test for what really matters, like offers.

Testing the wrong thing. Like opens rather than conversions. Opens are easy but unreliable, even dangerous.

Investing too many resources into a single test. This only leads to wasted time and effort, and time is critical in email.

Lack of segmentation: These are the marketers testing for the lowest common denominator. These tests won’t take you far.

Not validating the results. Take into account difference times and regularly monitor gain.

15 Ways to Take Email Testing to the Next Level

These aren’t best practices, per se, rather ways to do testing better.

Create a culture of testing: Be relentless. In this case, fast and steady wins the race.

Be agile and streamline processes. Find ways to be fast and use fewer resources.

Align goals with effort: What are your goals? Lifetime value? Quarterly revenue? Customer loyalty? Be clear on the goals of your program and be clear on the goals of individual emails and campaigns too.

Focus on If those are unavailable, then the open-to-click ratio. If that’s not possible, look at opens and clicks.

A/B test one element every X days. Then move to test next most important element.

Name things appropriately, with the goal in mind, because it makes a difference in how you approach the testing and what you look for in results. For example, your Welcome email should perhaps be renamed your Upsell email.