Posted
by
timothyon Tuesday January 24, 2012 @11:56AM
from the and-that's-what-science-is-and-does dept.

An anonymous reader writes "A team of researchers reports they can't reproduce the most important claim from 2010's controversial 'arsenic bacteria' paper — they find no arsenic in the bug's DNA. Meanwhile, other scientists are looking at different aspects of the bug and at arsenic in biology in general."

I don't know who are and what these "people" did. But it is your job as a scientist to scrutinize everything, specially when someone do something that has a flawed procedure. We can't just accept something said by someone, we have to reproduce it, we have to investigate it ourselves and confirm the results.
Now unfortunately many times during history many results were refuted by other scientist simply because it didn't agree with the current dogma, look at Mendel it took many years before his results were accepted by the people in that field. So attacking someone's work is valid, but there is a correct way to do it and not attack it for the sake of bashing.

The big problem with the original researchers was two fold - first, it was very preliminary. They had an unusual hypothesis (the bug, sorry, the bacterium) used arsenic in place of phosphate for the DNA 'backbone'. That's so unusual that it falls into the 'extraordinary evidence' category.

But they didn't do that - they performed some basic microbiology and some even more basic biochemistry. There were hundreds of other potential experiments that they just ignored, even though they were pretty mainstream and could likely have gotten some grad student to at least to the preliminary ones. Pretty much anyone who has done DNA chemistry would look at the paper and ask why the team didn't bother to do any one of a number of other experiments to tie the arsenic into the DNA. (The original paper basically suggested that since there was arsenic in the bug and the bugs grew where others could not because of the high arsenic and low phosphate levels, the arsenic was being structurally incorporated into the DNA).

THEN they hyped it to no end - made it sound like the Second Coming of DNA. That was their big error (hubris). It was weird enough in itself to get other people to look at it. That's always a problem with 'new' ideas since most labs are busy doing things they think they're supposed to be doing and don't necessarily have the time (or money) to go chase down other little issues.

It seems like some PR idiot at NASA got wind of the research and tried to fly with it but it was really a stupid thing to do.

The third problem: they refused to engage their critics. They simply stonewalled their peers. That's not how science is done. Compare it to the OPERA neutrino study, which was an equally hyped and unlikely claim, but the authors openly solicited rebuttals.

True, but you do that at your peril. Even scientists can be passive aggressive. The bug they found is now being called GFAJ-1 (Give Felisa A Job, Felisa Simon-Wolfe being one the scientists in the original article who has been less than open about the controversy). That's going to be tough to live down. Biologists love to have critters named after themselves, but not quite in this fashion.

Please, you people are a complete fail when it comes to science discussion. People like you are the reason there is so much disconnect between actual science and the public.

I am so tired of people like you either just making shit up based on some headline or something they heard 'somewhere' and not bothering to actually read up.You don't deserve the benefits of a science.

You are incorrect. Evidence can have varying levels of quality. You get weak evidence, you get strong evidence, and you can also get extraordinary evidence.

If any hypothesis is well-supported by established theory, it is only necessary for there to be mediocre evidence for it. In the absence of any reasonable alternative, it can then be accepted as correct, because it is backed not only by that weak evidence but also by all the strong evidence that supports the established theory.

I never understood how some people were so incredibly aggressively against the team that made the claim. This is how science works!

Its sounds like a classic theorist vs experimentalist battle. The experimentalists are trying to think up all kinds of fun ways to disprove her new theory, because its a pretty wide ranging theory so there is an extremely wide front to attack.

You see a theorist "makes points" by coming up with interesting theories, which she has certainly done. But an experimentalist "makes points" by coming up with interesting experiments, and there sure are a lot of interesting possible experiments to perform in this very wide ranging theory...

They were pretty mean spirited because it was clear from the outset that it was almost certainly a technical error. Scientists don't get anything out of cleaing up someone elses mistakes. These people could have spent their time doing real work if the original researcher had washed her samples properly.

It may have been a technical error, but if true, would have made an enormous dent in DNA science. Like Nobel Prize type dents. It was plausible although not likely. It piqued other researchers interest (what it should have done) and some researchers are tracking this down.

So, science worked exactly as it supposed to. Ego got shot down a bit. People got their mental landscapes moved around a bit. Some scientists at NASA might be starting to think out how you would test for the possibility of a non stan

No it didn't. Neither the approach nor the magazine (Science). This shouldn't have gone that far at all. This should have been shot down by the reviewers or actually outright rejected. The actual finding is really cool though: a bacteria that can survive high concentrations of arsenic - really cool stuff. Why not stick with that? Why claim arsenate in DNA when you provide no conclusive evidence for it?

As a result a lot of people had to spend time 'proving' their claims as complete bull-shit. This could have

It probably had something to do with their media whoring and science by press conference approach.

If they'd done as you're supposed to and submitted a paper for peer review FIRST, it would have been quietly shredded by the reviewers and they would have been able to either a) do better experiments, b) tone down their claims or c) give up.

If they'd done as you're supposed to and submitted a paper for peer review FIRST, it would have been quietly shredded by the reviewers

In (partial) defense of the NASA folks, they had indeed submitted the paper for peer review, and it had been accepted to Science magazine - it appeared online the same day (or close to it) as their hand-waving press conference. That it didn't get shredded by peer reviewers is testament to either the laziness of peer reviewers, or the ease with which high-profile journals can be duped into publishing weak but exciting claims. (This happens frequently, I'm afraid.) They should have done much more thorough experiments, but the journals are supposed to filter out hypotheses that haven't been sufficiently proven.

The problem with the press conference was that they made much more grandiose claims about the importance of their work than the evidence merited. If they'd stuck to publishing the paper and a diplomatically-worded press release, it still would have been very controversial, but it would not have elicited such a passionate response.

If you had bothered to look into this issue before spouting off like an ass, you would have noted it HAD BEEN SUBMITTED FOR PEER REVIEW.

The conference was out on the same day of publication. Something the is normal. the Media went ape shit over it, leaving an inexperienced researcher in a position to defend her work in the media, using common language and not scientific terms.

Something that is incredibly hard to do and takes experience.the media took this: "that will impact the search for evidence of

Submitted hey? Well that's fantastic. You can submit a kermit the frog soliloquy for peer review if you want to. I admit, it's an arduous process, usually requiring twenty or thirty mouse clicks on a web page.

The proper way to do it is to wait until the paper is accepted, PUBLISHED, and the scientific community has had a look at it. The FTL neutrino guys did that (IIRC their paper wasn't peer reviewed first, but they published it as is normal in the physics community, for review by that community), used

How am I supposed to take a summary seriously when it refers to bacteria as a "bug"?

While this is seen as probably an oversimplification of describing bacteria, viruses, etc. there are probably a lot of dictionary entries backing this up like the fifth one in Wiktionary [wiktionary.org]: "A contagious illness; a bacterium or virus causing it." You also had media in the late nineties using this virtually everywhere. See this BBC article [bbc.co.uk] for an example. The fact that researchers themselves have used phrases like Super Bug [wikipedia.org] to describe resistant bacteria to lay people probably doesn't help. English is visc

The term 'bug' is used in the main article by Ronald S. Oremland (coauthor of the controversial Science paper and Wolfe-Simon’s postdoctoral adviser at the time), “Even if we are dead wrong with this arsenic-DNA business, with a bit more work this bug could shed light on the limits of what microbes can and can’t do.”
Maybe you should be less flippantly critical of the wording.

BugFrom Wikipedia, the free encyclopediaJump to: navigation, search Look up bug in Wiktionary, the free dictionary.Contents [hide]1 Biology2 Geography3 Technology4 Art and media4.1 In characters4.2 In films and television4.3 In gaming4.4 In literature and publications4.5 In music4.6 Other uses5 In acronyms6 Other7 See also

Bug may refer to:

[edit] BiologyInformally, an insect, spider or other small pest other than a rodent; including most arthropods, except marine crustaceans, including individuals or

Actually there's a lot of leeway in the chemical definition of DNA. It's heavily chemically modified by deliberate and accidental processes. If I wanted to be pedantic I would observe that it's still a nucleic acid based on a deoxyribose sugar and therefore has as much claim to being DNA as the canonical nucleotides.

I think money plays a huge part in some of this. Think of the falsified research on the health benefits of Resveratrol and how those studies helped form a legitimacy around diet fad drugs that account for a billion dollar industry. It is an extremely lucrative industry and some of that money may end up funding future studies.

The same thing can be said about the corrupting influence of corporate money in funding climate change denial studies. If as a scientist, my research is being funded by oil companies who clearly want the studies to find a certain conclusion, you would be driving a stake in the heart of your career if you come to any other conclusion than climate change being unclear.

Other times there is enormous competition in research and a successful groundbreaking study will sometimes launch a lucrative career. The temptation can be great to make grandoise claims to jumpstart a career because by the time peer review trashes it, you may have already secured a cushy grant.

It seems we are seeing a lot more of these extraordinary claims and studies become challenged recently ranging from cancer research to climate change denialists skirting the peer review process:

Only because the general media has hit on this as 'newsworthy'. While it certainly is more interesting that the Newt's latest philosophical, historical and / or moral transgression, being wrong is is one of the occupational hazards of science and as science is conducted by humans, it tends to have all of the other warts and problems inherent human endeavors.

The same thing can be said about the corrupting influence of corporate money in funding climate change denial studies. If as a scientist, my research is being funded by oil companies who clearly want the studies to find a certain conclusion, you would be driving a stake in the heart of your career if you come to any other conclusion than climate change being unclear.

Can't you say the same thing about being funded by a government bureaucracy that clearly wants your studies to find a certain conclusion, like a study funded by the DEA to study dangers of marijuana, or by the FDA to show that GMO foods are safe? Wouldn't the EPA have a vested interest in funding studies that can show they need more funding and authority?

Its rather amazing to see the glaring headline "Retraction" in the letters section of these distinguished journals on a regular basis now. A dozen major scientists have written Science asking to retract the arsenic life paper. The policy is for authors to request retraction unless its a really extreme case like the XMRV retraction a few weeks ago (principal investigator in jail and authors suing each other). Most authors are honest and sometimes realize they've rushed to print without reproducible results. Then they'll retract.

I dont think there is anything horribly wrong with this process. Labs do rush to print for fame and priority. Readers want to see the newest results. There are many more papers now than decades ago. Reviewers dont have time to replicate the results during the review span of time and have to use their best judgment. Mistakes happen and are corrected. This is merely how good science works.