Peer Review, Anyone? - Atheist Nexus2018-02-22T05:14:09Zhttp://atheistnexus.org/forum/topics/peer-review-anyone?groupUrl=atheistswholovescience&commentId=2182797%3AComment%3A545153&xg_source=activity&groupId=2182797%3AGroup%3A25044&feed=yes&xn_auth=noThere are ID people here too.tag:atheistnexus.org,2009-10-15:2182797:Comment:5540972009-10-15T09:34:55.775ZJohn Secular Smithhttp://atheistnexus.org/profile/JohnSecularSmith
There are ID people here too.
There are ID people here too. fair enough and good point. I…tag:atheistnexus.org,2009-10-13:2182797:Comment:5505432009-10-13T12:59:33.384ZMike Heinhttp://atheistnexus.org/profile/MikeHein
fair enough and good point. I was being a bit limited in my thinking on journals.<br />
<br />
Pssst....you're pretty f'n smart.<br />
<br />
Cheers,
fair enough and good point. I was being a bit limited in my thinking on journals.<br />
<br />
Pssst....you're pretty f'n smart.<br />
<br />
Cheers, I guess that there should be…tag:atheistnexus.org,2009-10-13:2182797:Comment:5498872009-10-13T02:17:11.147ZHotMesshttp://atheistnexus.org/profile/Cowpunk6245
I guess that there should be some publicly posted and universal definitions for "quality of data" and the general public should be able to access the requirements that make a research project viable or not. I understand that, within the research community, these concepts are clearly defined and understood, but when someone is unhappy with their evaluation after the peer review process and they take their case to they laypeople, they can say whatever they want. If a paper is rejected, the…
I guess that there should be some publicly posted and universal definitions for "quality of data" and the general public should be able to access the requirements that make a research project viable or not. I understand that, within the research community, these concepts are clearly defined and understood, but when someone is unhappy with their evaluation after the peer review process and they take their case to they laypeople, they can say whatever they want. If a paper is rejected, the reasons ahould be clearly stated and easy for the public to access.<br />
This is where the fringe element always jumps in with their qualifiers and complaints. Great info, Adriana. Your exp…tag:atheistnexus.org,2009-10-12:2182797:Comment:5489712009-10-12T16:31:45.601ZMike Heinhttp://atheistnexus.org/profile/MikeHein
Great info, Adriana. Your experience mirrors my (much less extensive) history when working on a JAMA article, long ago.<br />
<br />
What your notes point out is that these editors have enormous power. Just the ability to choose the reviewers will influence what papers see the light of day. The amount of editing demanding by the reviewers can materially change the "conclusions" or "findings" section of research paper. It is like democracy, "the worst possible system except for all the others."<br />
<br />
Regards,
Great info, Adriana. Your experience mirrors my (much less extensive) history when working on a JAMA article, long ago.<br />
<br />
What your notes point out is that these editors have enormous power. Just the ability to choose the reviewers will influence what papers see the light of day. The amount of editing demanding by the reviewers can materially change the "conclusions" or "findings" section of research paper. It is like democracy, "the worst possible system except for all the others."<br />
<br />
Regards, Odd how the process works for…tag:atheistnexus.org,2009-10-10:2182797:Comment:5453682009-10-10T03:31:26.996ZJohn Secular Smithhttp://atheistnexus.org/profile/JohnSecularSmith
Odd how the process works for everything else given time to work it out.
Odd how the process works for everything else given time to work it out. ... and this is where the pee…tag:atheistnexus.org,2009-10-10:2182797:Comment:5452892009-10-10T02:22:29.567ZHotMesshttp://atheistnexus.org/profile/Cowpunk6245
... and this is where the peer review process falls short. The whole anti-vax movement started with him and has just grown and grown. Many people still feel that he is justified and correct and are protesting his censure. And every time you try to explain that a particular anti-vax researcher in not creditable because s/he failed the peer review process, they fault the process and not the researcher.<br />
People need to know more about just who is qualified to issue a judgement during the review…
... and this is where the peer review process falls short. The whole anti-vax movement started with him and has just grown and grown. Many people still feel that he is justified and correct and are protesting his censure. And every time you try to explain that a particular anti-vax researcher in not creditable because s/he failed the peer review process, they fault the process and not the researcher.<br />
People need to know more about just who is qualified to issue a judgement during the review process and what factors are considered when evaluating a paper. And even if a paper gets pub…tag:atheistnexus.org,2009-10-10:2182797:Comment:5451562009-10-10T00:34:20.307ZGwenhttp://atheistnexus.org/profile/Gwen
<i><br />
And even if a paper gets published, if it is crap it will never be cited and fall into oblivion.</i> Some are so wrong, they are cited for the wrong reason, such as Andrew Wakefield's papers. The middling ones are ignored and fall into oblivion.
<i><br />
And even if a paper gets published, if it is crap it will never be cited and fall into oblivion.</i> Some are so wrong, they are cited for the wrong reason, such as Andrew Wakefield's papers. The middling ones are ignored and fall into oblivion. Journal X sends that paper o…tag:atheistnexus.org,2009-10-10:2182797:Comment:5451532009-10-10T00:32:32.370ZGwenhttp://atheistnexus.org/profile/Gwen
<i><br />
Journal X sends that paper out to 3 or 5 or some number of people they consider experts in the field due to their previous publications on the topic or a related topic.</i> Ideally, these people would have also published research that has gone through the peer review process as well.
<i><br />
Journal X sends that paper out to 3 or 5 or some number of people they consider experts in the field due to their previous publications on the topic or a related topic.</i> Ideally, these people would have also published research that has gone through the peer review process as well. I'm not a working scientist,…tag:atheistnexus.org,2009-10-09:2182797:Comment:5448452009-10-09T21:18:28.219ZMax Polunhttp://atheistnexus.org/profile/MaxPolun
I'm not a working scientist, and I've never tried to get a peer reviewed paper published, so I'm not an expert, but my understanding is that the reviewers are checking the methodology and experimental design/etc. There probably is some bias against unconventional ideas in peer review, but if these ideas have merit, they eventually find an audience in the scientific world. The fact that ideas that were originally laughed at (like say, continental drift) are now the consensus proves that it's…
I'm not a working scientist, and I've never tried to get a peer reviewed paper published, so I'm not an expert, but my understanding is that the reviewers are checking the methodology and experimental design/etc. There probably is some bias against unconventional ideas in peer review, but if these ideas have merit, they eventually find an audience in the scientific world. The fact that ideas that were originally laughed at (like say, continental drift) are now the consensus proves that it's possible.<br />
<br />
The reason anti-vax research doesn't get into peer reviewed journals is because it's crap, you don't need bias to explain that. Basically:
You submit a pape…tag:atheistnexus.org,2009-10-09:2182797:Comment:5448342009-10-09T21:11:41.815ZJohn Secular Smithhttp://atheistnexus.org/profile/JohnSecularSmith
Basically:<br />
<br />
You submit a paper for publication to Journal X.<br />
<br />
Journal X sends that paper out to 3 or 5 or some number of people they consider experts in the field due to their previous publications on the topic or a related topic.<br />
<br />
These experts look over your paper and determine if it meets scientific rigor for publication. A paper can be publishable even if the expert doesn't agree with the findings.<br />
<br />
The experts give suggestions, if necessary, about things that could be changed to make it…
Basically:<br />
<br />
You submit a paper for publication to Journal X.<br />
<br />
Journal X sends that paper out to 3 or 5 or some number of people they consider experts in the field due to their previous publications on the topic or a related topic.<br />
<br />
These experts look over your paper and determine if it meets scientific rigor for publication. A paper can be publishable even if the expert doesn't agree with the findings.<br />
<br />
The experts give suggestions, if necessary, about things that could be changed to make it better.<br />
<br />
Paper is edited and sent back.<br />
<br />
Repeat previous stuff. If paper is considered good by panel, then the paper gets published.<br />
<br />
That's a simplified process. Maybe some of our published members can further enlighten us.<br />
<br />
Basically though, Journal X only becomes known as a good journal if they pick appropriate peer reviewers that ensure they get good papers. If the paper is scientifically invalid and they publish it, they look like idiots. If they reject a good paper, a more fair journal can pick it up and publish it and make themselves look better.<br />
<br />
And even if a paper gets published, if it is crap it will never be cited and fall into oblivion.