Nature journal recognizes that there's a problem. A few weeks ago (June 16, 2016) they published a brief comment on Nature distilled.

They begin by describing the problem ...

Any journal that tries to publish the most important results that it is sent, in all fields of science, will run into the same problem. Every bit of our output, we hope, is useful and interesting to somebody somewhere. But even the most optimistic of our editors would concede that the pool of readership for each of these specific advances is only a small subsection of our audience, professional researchers included. To the outside world, science is science. To those who read Nature, science is a multiplicity of specialisms — and specialists.

We know that most of you are specialists, and that you don’t read most of what we present to you. You’re busy people. It is hard enough to follow the literature that you need to read. Even the titles of research papers in an unfamiliar field can look incomprehensible. But if you’re anything like us, one reason you got into science in the first place was curiosity about the world — and not just the tiny piece of it that you now focus on. Wouldn’t it be useful and interesting to keep better track of the rest? Or at least, the rest that is published in Nature, and therefore already judged to be important?

Let's make one thing clear. It's not just the complexity of a paper that's the problem and it's not just that the science isn't explained in easy to understand sentences. There's also the more serious problem of content. Sometimes the papers are hard to understand because the significance of the results is exaggerated and its importance is not placed in proper context.

The ENCODE papers are good examples of this problem. It wasn't easy to understand that they did but, more importantly, it wasn't easy to understand the significance of their results because the authors didn't explain their results very well. They made unsubstantiated claims.

Here's how Nature hopes to fix the problems they identified.

We think so, and this week we begin an experiment to see how many of you agree. We have revisited 15 recently published Nature papers and asked the authors to produce two-page summaries of each. The summaries remain technical — these are not articles suitable for the popular press — but they try to communicate both the research advance and why it matters. The authors of these papers have been enthusiastic — they want the broadest possible readership — and we thank them for their cooperation. Now we want to know what you think. The first three summaries are published online this week (see go.nature.com/1uhcy3x). The rest will be released in the coming weeks. Please take a look. Be brave — pick a topic that you expect to struggle with — and then fill in the online survey to let us know what you think. The rest will be released in the coming weeks. Please take a look. Be brave — pick a topic that you expect to struggle with — and then fill in the online survey to let us know what you think.

I looked at two papers that were about biology and I didn't think the summaries added anything to my understanding. That's partly because the papers weren't that hard to understand in the first place if you were just satisfied with knowing what they did.

If the scientific literature is difficult to understand, and it is, then there's a problem with the authors. They aren't able to explain what they did in a reasonable manner and they aren't able to place their work in a proper context so we can evaluate the significance of the result. Asking them to try again (and doubling their citations) is probably not going to help.

No comments
:

Post a Comment

Laurence A. Moran

Larry Moran is a Professor in the Department of Biochemistry at the University of Toronto. You can contact him by looking up his email address on the University of Toronto website.

Sandwalk

The Sandwalk is the path behind the home of Charles Darwin where he used to walk every day, thinking about science. You can see the path in the woods in the upper left-hand corner of this image.

Disclaimer

Some readers of this blog may be under the impression that my personal opinions represent the official position of Canada, the Province of Ontario, the City of Toronto, the University of Toronto, the Faculty of Medicine, or the Department of Biochemistry. All of these institutions, plus every single one of my colleagues, students, friends, and relatives, want you to know that I do not speak for them. You should also know that they don't speak for me.

Subscribe to Sandwalk

Quotations

The old argument of design in nature, as given by Paley, which formerly seemed to me to be so conclusive, fails, now that the law of natural selection has been discovered. We can no longer argue that, for instance, the beautiful hinge of a bivalve shell must have been made by an intelligent being, like the hinge of a door by man. There seems to be no more design in the variability of organic beings and in the action of natural selection, than in the course which the wind blows.Charles Darwin (c1880)Although I am fully convinced of the truth of the views given in this volume, I by no means expect to convince experienced naturalists whose minds are stocked with a multitude of facts all viewed, during a long course of years, from a point of view directly opposite to mine. It is so easy to hide our ignorance under such expressions as "plan of creation," "unity of design," etc., and to think that we give an explanation when we only restate a fact. Any one whose disposition leads him to attach more weight to unexplained difficulties than to the explanation of a certain number of facts will certainly reject the theory.

Charles Darwin (1859)Science reveals where religion conceals. Where religion purports to explain, it actually resorts to tautology. To assert that "God did it" is no more than an admission of ignorance dressed deceitfully as an explanation...

Quotations

The world is not inhabited exclusively by fools, and when a subject arouses intense interest, as this one has, something other than semantics is usually at stake.
Stephen Jay Gould (1982)
I have championed contingency, and will continue to do so, because its large realm and legitimate claims have been so poorly attended by evolutionary scientists who cannot discern the beat of this different drummer while their brains and ears remain tuned to only the sounds of general theory.
Stephen Jay Gould (2002) p.1339
The essence of Darwinism lies in its claim that natural selection creates the fit. Variation is ubiquitous and random in direction. It supplies raw material only. Natural selection directs the course of evolutionary change.
Stephen Jay Gould (1977)
Rudyard Kipling asked how the leopard got its spots, the rhino its wrinkled skin. He called his answers "just-so stories." When evolutionists try to explain form and behavior, they also tell just-so stories—and the agent is natural selection. Virtuosity in invention replaces testability as the criterion for acceptance.
Stephen Jay Gould (1980)
Since 'change of gene frequencies in populations' is the 'official' definition of evolution, randomness has transgressed Darwin's border and asserted itself as an agent of evolutionary change.
Stephen Jay Gould (1983) p.335
The first commandment for all versions of NOMA might be summarized by stating: "Thou shalt not mix the magisteria by claiming that God directly ordains important events in the history of nature by special interference knowable only through revelation and not accessible to science." In common parlance, we refer to such special interference as "miracle"—operationally defined as a unique and temporary suspension of natural law to reorder the facts of nature by divine fiat.
Stephen Jay Gould (1999) p.84

Quotations

My own view is that conclusions about the evolution of human behavior should be based on research at least as rigorous as that used in studying nonhuman animals. And if you read the animal behavior journals, you'll see that this requirement sets the bar pretty high, so that many assertions about evolutionary psychology sink without a trace.

Jerry Coyne
Why Evolution Is TrueI once made the remark that two things disappeared in 1990: one was communism, the other was biochemistry and that only one of them should be allowed to come back.

Sydney Brenner
TIBS Dec. 2000
It is naïve to think that if a species' environment changes the species must adapt or else become extinct.... Just as a changed environment need not set in motion selection for new adaptations, new adaptations may evolve in an unchanging environment if new mutations arise that are superior to any pre-existing variations

Douglas Futuyma
One of the most frightening things in the Western world, and in this country in particular, is the number of people who believe in things that are scientifically false. If someone tells me that the earth is less than 10,000 years old, in my opinion he should see a psychiatrist.

Francis Crick
There will be no difficulty in computers being adapted to biology. There will be luddites. But they will be buried.

Sydney Brenner
An atheist before Darwin could have said, following Hume: 'I have no explanation for complex biological design. All I know is that God isn't a good explanation, so we must wait and hope that somebody comes up with a better one.' I can't help feeling that such a position, though logically sound, would have left one feeling pretty unsatisfied, and that although atheism might have been logically tenable before Darwin, Darwin made it possible to be an intellectually fulfilled atheist

Richard Dawkins
Another curious aspect of the theory of evolution is that everybody thinks he understand it. I mean philosophers, social scientists, and so on. While in fact very few people understand it, actually as it stands, even as it stood when Darwin expressed it, and even less as we now may be able to understand it in biology.

Jacques Monod
The false view of evolution as a process of global optimizing has been applied literally by engineers who, taken in by a mistaken metaphor, have attempted to find globally optimal solutions to design problems by writing programs that model evolution by natural selection.