A behavioural science approach for evaluating communications about climate related risks and uncertainties

A research team led by Wandi Bruine de Bruin received funding for a project entitled “A behavioural science approach for evaluating communications about climate-related risks and uncertainties” from the Models To Decisions Network sponsored by ESRC, EPSRC, NERC, and AHRC (see http://blogs.exeter.ac.uk/models2decisions/).

In the UK, the greatest threats from climate change include heavy rainfall and flooding. According to the UK Climate Change Risk Assessment 2017, flood damage to UK businesses and communities cost as much as £1 billion per year. Stakeholders from industry and government therefore face important decisions about preparing for future climate change, even if they may not have a background in climate science. Communications and visualisations about climate projections that are designed to inform decisions about climate change adaptation, may be too complex for non-expert audiences (Lorenz et al., 2015; Taylor et al., 2015).

We conducted interviews in which end users viewed commonly used climate data visualisations. End users were individuals working at water companies, local councils, environmental charities, media outlets and as infrastructure consultants. Most were professionally responsible for making decisions about climate change and adaptation, and did not necessarily have a background in climate science. We identified variations in interpretations and potential misunderstandings of the presented visualisations. We then sought recommendations from the graph design and risk communication literature that could be implemented to address these potential misunderstandings.

Here (and also as a PDF), we present these recommendations, which should be useful for improving communications about climate projections to general non-expert audiences. The PDF also contains a reference list.

Recommendation 1: Avoid expert terminology and acronyms

Our interviewees were confused by terms such as “business as usual” when reading about emissions scenarios, and acronyms for climate models. Similarly, some lacked understanding of statistical terms, like “probabilistic estimates”, “PDF” and “boxplots”.

Example quote: “I don’t understand what the RCP8.5 means. I can only assume that it means it’s one of the projections that they’re using, perhaps this business as usual scenario, but it’s confusing and over complicated maybe.”

Recommendation 2: Explain statistical terms

When presented with communications about probabilistic modelling data, interviewees wanted to know more about the meaning of terms such as “probabilistic estimate” or “percentile”.

Example quote: “And then the – all the language around, in the next sentence, the projections are probabilistic, the 50th percentile is a central estimate, that makes sense, then it talks about values are very unlikely to be greater than 90th percentile and less than 10th percentile. I’m not sure sort of – unless you’re saying that the 90th percentile and the 10th percentile are definitions of very unlikely, then I’m not sure where – why that language is included.”

Recommendation 3: Use consistent time periods with clear justifications

In climate projections, future change is often communicated through comparisons to past time periods. Our interviewees thought that it was not always clear why past time periods were chosen as a comparison period, or which future time period was projected. They found it especially confusing when past and future time periods differed in length (e.g. 30 years versus 20 years).

Example quote: “So the first thing is that it’s against a long-term average, which is from 1981 to 2010. So I’m thinking, what’s the difference between this and actually pre-industrial?”

Recommendation 4: For communicating change in rainfall, display absolute change in millimetres rather than relative change in percentages, and provide baseline values

Interviewees indicated that projections of relative percent change in rainfall were confusing, and did not always understand concepts of ‘positive’ or ‘negative’ change. It was unclear how much one percent actually represented in millimetres, because they lacked information about baseline values.

Example quote: “… what does it actually mean in terms of how much dryer or how much wetter it is? It feel like it’s – for a specialist audience this will mean something because they already know the background and they already know how much rainfall there is and they would know how much 20% would really matter to various things … what does this actually mean in amount of rainfall rather than the difference?”

Recommendation 5: Match visualisations with associated text

Interviewees requested a better match between visualisations and associated text. Terms that appear in the visualisation should be explicitly referred to and explained in the text. Captions, headers, and main text should use consistent wording. They will also be easier to understand if they are presented closer together.

Example quote: “it says that the map shows annual percentage difference from the long term, 1981 to 2010 average and the average between – so if you’re saying that’s also looking at post-2061. Those years aren’t written on the maps at all.”

Recommendation 6: Make relevant features most salient

Our interviewees were often unable to identify the features of the visualisations that were most relevant for understanding the main message. Visualisations about climate projections should be designed such that the most relevant features draw the most attention, by increasing their sizes and selecting salient colours.

Example quote: “I find that the plot details box thing on top is quite prominent. I think that would be better placed elsewhere, maybe to help the reader concentrate on the actual data instead of the computer output, really.”

Recommendation 7: Communicate one simple message per visualisation

Interviewees noted that visualisations about climate projections tended to contain too much information, for example about different seasons, multiple emissions scenarios, or multiple probabilistic thresholds. Understanding will be improved by presenting one visualisation for each key message, and removing distracting ‘visual clutter’ that does not pertain to the main message. If there is more than one key message, perhaps more than one visualisation is needed.

Example quote: “I think there is an awful lot of information on these that is presented in a way that I’m not used to seeing. So I’m trying to understand actually what the graph is framed about and I think the track of observed rainfall helps you to put that into context …”

Recommendation 8: Test communication materials

Before disseminating communication materials, we recommend conducting think-aloud interviews with intended audience members so as to assess whether they find the visualisations understandable and useful. Such interviews may also identify confusion and misunderstandings, as well as design strategies for avoiding those. If time and funding permits, additional survey-based experiments with larger samples can be used to systematically test whether new visualisation designs are better than old ones.

Contact

Astrid Kause
Centre for Decision Research and Sustainability Research Institute
Leeds University Business School
The University of LeedsA.kause@leeds.ac.uk; phone: +44 (0) 113 343 2685