What We Know Already: Sept 2016

Every month we update what we know about how all sorts of UI changes affect conversions in the form of observations and sort them by highest certainty first. Here is a first such post for the month of September, 2016. Each month we update this list as we look at more tests and make new observations while updating older ones. Eventually we’ll become more certain, one a/b test at a time.

Here Is The Current State Of What We Know Converts (And Doesn’t)

How To Read & Use The Above

The Higher The Certainty, The Better

The higher the certainty count, the more strong tests we identified to support the observation. Here is how we calculate it.

General Ideas Vs. Specific Observations

The list contains certainty counts for both general GoodUI ideas (often containing more tests), and more specific observations (with greater test similarity).

Median Effects

We share median effects from the grouped tests to get a sense / possibly predict the impact of that change (these will become more accurate with more tests / higher certainty counts).