Now open

Nominations for the Maddox Prize for Standing up for Science

Learn more

The anti-lobbying clause

Here's a plan to do better

Learn more

'The Ugly Truth'

by Tracey Brown, director of Sense About Science

Learn more

Measuring government transparency

New framework rates use of evidence

Learn more

Uncertainty

Think uncertainty is a bad thing? It’s actually a mark of sound science.

Making Sense of UncertaintyIn the Making Sense of Uncertainty guide scientists and research institutes challenge the idea that uncertainty in research is a reason for people to worry about the reliability of findings.

Researchers in climate science, disease modelling, epidemiology, weather forecasting and natural hazard prediction say that we should be relieved when scientists describe the uncertainties in their work. It doesn’t necessarily mean that we cannot make decisions – we might well have ‘operational knowledge’ – but it does mean that there is greater confidence about what is known and unknown.

If policy makers and the public are discouraged by the existence of uncertainty, we miss out on important discussions about the development of new drugs, taking action to mitigate the impact of natural hazards, how to respond to the changing climate and to pandemic threats.

Interrogated with the question ‘But are you certain?’, researchers say, they have ended up sounding defensive or as though their results are not meaningful. Instead we need to embrace uncertainty, especially when trying to understand more about complex systems, and ask about operational knowledge: ‘What do we need to know to make a decision? And do we know it?’ In Making Sense of Uncertainty they review the current discussion and explore:

• The way scientists use uncertainty to express how confident they are about results.

• That uncertainty can be abused to undermine evidence or to suggest anything could be true: from alternative cancer treatments to anthropogenic CO2 not changing the atmosphere.

• Why uncertainty is not a barrier to taking action – decision makers usually look for a higher level of certainty for an operational decision (such as introducing body scanners in airports) than for a decision based on broader ideology or politics (such as reducing crime rates).

Coverage

BBC Radio 4 Material World, 27th June 2013 (from 12.17)

Read more...

The Carbon Brief Lost in translation: Scientific uncertainty and belief in climate change

EQUIP (End-to-end quantification of uncertainty for impacts prediction) Embracing uncertainty in science: What do we need to know to make decisions, and do we know it?

The Institution of Environmental Science Think uncertainty is a bad thing? It’s actually a mark of sound science

London School of Economics and Political Science Communicating the uncertainty in science is necessary to improve public confidence and decision-making of non-specialists.

NERC Planet Earth blog, Making Sense of Uncertainty

Pacific Standard A Guide For These Uncertain Times

University of Reading What does ‘uncertainty’ in science really mean? New guide explains all

University of ManchesteMaking Sense of Uncertainty

Wiley Think uncertainty is a bad thing? It's actually a mark of sound science


See a Storify of the Twitter discussion surrounding the Making Sense of Uncertainty launch

 

Comments

Tracey Brown, Managing Director, Sense About Science: “Scientific research doesn’t just produce information – about earthquake frequency or the causes of cancer - it estimates how much of the picture we have by trying to measure the uncertainty in that information. However, this does not mean that we are waiting for the day of certainty to arrive! It is especially important to recognise that in discussions where we have decisions to make, about whether to spend more on buildings that withstand earthquakes and whether to stockpile a vaccine. Instead, ‘do we have operational knowledge?’ is one of the most useful questions anyone can ask.”

David Stainforth, Senior Research Fellow, Grantham Research Institute, London School of Economics: “Uncertainty is simply part of our understanding. Sometimes the details matters, sometimes they don’t, but uncertainty is not a barrier to taking good decisions. Nor is it unfamiliar. We all take decisions under uncertainty every day.”

Angela Mclean, Professor of Mathematical Biology, University of Oxford: “If you can quantify the uncertainty around a statement then you have gone a long way towards understanding what is going on.”

Professor David Spiegelhalter, Winton Professor of the Public Understanding of Risk, University of Cambridge: “Policy-makers should be able to be open and honest about scientific uncertainty, while still being confident about the appropriate actions to be taken."

Ian Stewart FRS, Emeritus Professor of Mathematics, University of Warwick: “I prefer the honest uncertainties of science to the hollow certainties of people who ignore any evidence that does not fit their beliefs.”

Douglas Kell, Chief Executive of the Biotechnology and Biological Sciences Research Council: “As this new guide, Making Sense of Uncertainty makes clear, uncertainty is part of science and a part of life. Our world-leading scientists are capable of realising the limitations of uncertainty when providing evidence, informing decision making, and predicting outcomes. The aim of this guide is to bring about advanced discussions in society about what we know and how. We must consider uncertainty carefully but not be halted by it.”

Kathy Maskell, Communications Manager at the Walker Institute for Climate System Research, University of Reading: “Any prediction of future climate is uncertain and this can cause confusion for those making decisions about how to adapt to a changing climate – amongst the public, policymakers and business alike. This excellent guide to uncertainty from Sense about Science is highly pertinent and I would recommend it to anyone grappling with the issue of uncertainty in science.”