In early February, a number of bloggers brought to your attention a peculiar paper on mitochondrial proteomics, a paper which was obviously odd on even casual inspection, containing grandiose claims of a theoretical revolution that were entirely unsupported and ludicrous assertions of evidence for God in the genome. Deeper examination revealed that much of the paper had also been plagiarized from various sources. To the credit of the journal, the paper was quickly retracted one month ago today; however, the retraction was entirely based on the plagiarism, and none of the other failings of the paper were addressed, nor were any of the patent errors in the review process at the journal Proteomics discussed. This is strange, especially in light of the fact that the Warda/Han paper was the most accessed article in the journal. This is not an issue that should be swept under the rug!
Today, several of us — Steven Salzberg, Lars Juhl Jensen, and Attila Csordas — are repeating our call for an explanation of the events that led to the leakage of such an egregiously ridiculous paper into print. Bad papers are a dime-a-dozen, and we aren't so much concerned with the detailed discussion of the flaws in this one paper as we are with seeing the integrity of the peer-review process maintained, or better, improved. The Warda/Han paper had obvious red flags that marked it as potentially problematic in the title, the abstract, and scattered throughout the body, and it's hard to imagine how any reviewer or editor could have let them simply slip by without comment, yet that is exactly what seems to have happened.
We want to know how this paper slipped through the cracks, because we want to know how large the cracks in the peer review process at Proteomics are. It's a journal with a good reputation, and we are not presuming that there was any wrong-doing or systematic failure of peer review there, but we do think that a lack of transparency is of concern: there is no assumption of a crime, but the ongoing cover-up is grounds for suspicion. Let's see some self-criticism from the journal editor, and an open discussion of steps being taken to prevent such errors from occurring again.
Alternatively, if the journal wants to outsource its quality control to a mob of bloggers, that works, too … but we tend to be less formal and much more brutally and publicly critical than an in-house process might be, and we're also going to be less well-informed than the actual principals in the review process. Better explanations are in order. Let's see representatives of the journal provide them.
52 Comments
Dale Husband · 12 March 2008
harold · 12 March 2008
There is an innocent possibility here.
Obviously the paper got in due to either careless or biased editorial performance. Either someone was bored with it and skimmed too fast to pick up the crazy parts, or a closet creationist let it in despite the incoherence.
I don't know how many editors per paper that journal uses, but let's say it's one or a few, at least for review papers, and one or more of those editors are no longer serving as editors, due to this incident.
That would fix the problem. There is no ethical obligation for the journal to reveal such a step.
A careful reading of the lists of editors for various issues might reveal a name that ceases to appear, of course.
However, for a variety of valid reasons, Proteomics might choose to keep the dismissal of individuals from its list of potential editors private. The problem is fixed. If bloggers choose to closely follow the journal, that's more or less a plus, not a minus.
Of course the reputation of Proteomics could be even further repaired by openly stating how the problem was dealt with, but the net benefits of making public a dismissal may be outweighed by the legitimate problems with doing so, especially when the only issue is that a bad paper was let into the journal.
PZ Myers · 12 March 2008
Dale: No, that's not a more credible abstract, and I'd reject it as well. It doesn't say anything other than to propose a test (one that has already been done, many times), it's far too basic, and the creationist take on the issue is so far off base and so simply refuted that it doesn't even merit mention in a science paper.
Harold: I suspect that the most likely explanation is error rather than malice, and sure, there is no ethical obligation to reveal in-house measures taken. There is a practical obligation, however -- it would correct the perception that the journal has something to hide.
R Ward · 12 March 2008
I just read the paper. Who the heck reviewed that trash? How did any editor let it by? Either the editor and the reviewers failed to read the thing or they agreed with the authors' message.
Plagiarism? That's the least of the problems.
Flint · 12 March 2008
I think what's disturbing about this is that it smells so very creationist. Just like the Sternberg case, or the Leonard PhD committee case, or key 1-vote majority on state school board cases, creationists are masters at engineering PR wins. They typically do this by getting a very few key people into key positions at critical times to execute a one-time ambush. Yeah, they know someone will notice after the fact and try to blow the whistle, but meantime they have managed something valuable, such as a martyr (like Gonzalez or Sternberg) or a "peer reviewed" paper, which they can then spread across thousands of websites and cite endlessly in support of their agenda. Doesn't take many ambushes.
The stonewalling is also quintessentially creationist. A responsible journal would immediately and publicly investigate, identify what happened, and take immediate (and again, public) steps to rectify whatever went wrong. Just as happened in the case of the Korean stem cell fraud. I very strongly suspect that if it were possible to track down the individual whose actions could break this logjam and start the ball rolling but who is carefully not doing so, we'd find ourselves a creationist. It's how they operate.
Bobby · 12 March 2008
Scott Fanetti · 12 March 2008
I am a computer scientist and I don't really know which journals are reputable as far as proteomics and genomics research goes. Is this journal widely accepted as authoritative? If so, I don't think using a broad brush and painting the journal as a mouthpiece for ID is appropriate. Obviously this paper was not vetted by someone who was interested in presenting an actual scientific paper -- or possibly the reviewer did not grasp the level of lunacy delivered by the weird side statements ( which seems plausible if the reviewer was cogniscient of the science but might not be a very good English speaker ).
Don't blacklist the journal unfairly because of an obvious black eye on their part ( unless they claim the paper WAS properly vetted and they claim it was science - then toss em out. )
Bobby · 12 March 2008
William Wallace · 12 March 2008
emily · 12 March 2008
I think the failure to have any effective review process is the number one reason to blacklist a journal. After all, selecting papers with merit is their primary purpose. Not only multiple reviewers but a highly placed editor and multiple staff members *should* have read this paper in detail. The fact that they either didn't, or thought it was high quality, is not a minor issue. A paper is not one of thousands of widgets going down a conveyer belt, where a few will obviously slip by--it is a painting hanging on the wall of the gallery. Any decent gallery should know what they are hanging and take, and be seen to be taking, steps if they end up with a fake.
PvM · 12 March 2008
William Wallace · 12 March 2008
And PvM is a contributor to PT? The mind boggles.
PvM · 12 March 2008
PvM · 12 March 2008
PvM · 12 March 2008
William Wallace · 12 March 2008
PvM · 12 March 2008
William Wallace · 12 March 2008
PvM · 12 March 2008
PZ Myers · 12 March 2008
Yes, it is one early step in the process. But it should at least weed out the obvious garbage, and this paper was obvious garbage. Unless you're advocating that there should be no assessment at all before accepting a paper for publication, in which case, please, don't push for that. There's too much to read as it is.
There is also plenty of controversy and difficulty within science that can be productively discussed in the pages of a journal. We "devout evolutionists" (whatever that might be; the phrase says more about your biases than ours) are opposed to seeing publication of ID because it is also obvious garbage. Do you have a reason for wanting a decrease in the signal-to-noise ratio in scientific publications?
William Wallace · 12 March 2008
PvM · 12 March 2008
William Wallace · 12 March 2008
Daniel Gaston · 12 March 2008
Dale Husband:
There are a few points you may want to consider:
1)Gene trees are not species trees. Of course ideally good multi-gene phylogenies should overcome this.
2)Organelle sequences are routinely, and have been used, to reconstruct phylogenies of the host organism
3)Phylogenies of mitochondria and bacteria place mitochondria as been most closely related to the alpha-proteobacteria
4)Similarly chloroplasts bear strong similarity to cyanobacteria
Stanton · 12 March 2008
PvM · 12 March 2008
Edward jackson · 12 March 2008
Yeah "they help get the message across". Too well if you ask me!
Do you think people have not guessed WW is a
http://en.wikipedia.org/wiki/Internet_sock_puppet#Strawman_sockpuppet
???
Owned!
James F · 12 March 2008
To build upon what PZ said, in the case of a research paper the point of peer review is to ensure that the statements and conclusions of the manuscript are supported by the results and that all relevant literature is cited properly. For literature reviews, which present no new data (which was the case both for Warda and Han and for Meyer in the Sternberg case), the statements and conclusions should be based on the literature cited. Using a review to invoke nonscientific concepts instead of making a commentary within the bounds of science is completely inappropriate. If people wish to make philosophical or theological arguments, other media are available for that; keep it out of scientific journals.
Of course, the Warda and Han case was also marked by rampant plagiarism (see http://udel.edu/~mcdonald/wandahan.pdf). They are also guilty of plagiarism in another paper they published in the Glycoconjugate Journal, (Warda et al., "Is human placenta proteoglycan remodeling involved in pre-eclampsia?" Dec 27, 2007) spotted by Sarah W. on Pharyngula:
From Warda et al.:
"Detailed characterizations indicate the placental basement membrane tissue predominantly contains HS PGs, whereas CS/DS PGs are mainly located in the intervillous space of the ECM"
From Chen, C.-P. et al., Placenta 28:97-106 (2007):
"Detailed characterizations indicate the placental basement membrane tissue predominantly contains heparan sulfate proteoglycan (HSPG), whereas chondroitin sulfate and/or dermatan sulfate proteoglycans (CS/DS PGs) are mainly located in the intervillous space of the ECM"
From Warda et al.:
"HS, the constituent of up to 50% of the total expressed GAG in endothelial cells, is unique among GAGs in the ability to bind a large number of different proteins with complex role in the extracellular matrix, regulating a wide variety of biological process, including hemostasis, inflammation, angiogenesis, growth factors, cell adhesion..."
From Tersariol, I.L.S. et al., Brazilian Journal of Medical and Biological Research 35:135-144 (2002):
"Heparan sulfate and heparin are particularly important among glycosaminoglycans in their ability to bind a large number of different proteins. Heparin-like glycosaminoglycans play a complex role in the extracellular matrix, regulating a wide variety of biological processes, including hemostasis, inflammation, angiogenesis, growth factors, cell adhesion, and others."
I notified the EIC, Prof. J.F.G. Vliegenthart, on February 24 - still no response.
gabriel · 12 March 2008
On the theme of plagiarism, I came across another example just today, where this article
http://www.ncbi.nlm.nih.gov/pubmed/15897313?ordinalpos=2&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_RVDocSum
rips off several complete, word-for-word paragraphs of this one
http://www.ncbi.nlm.nih.gov/pubmed/11857059?ordinalpos=1&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DiscoveryPanel.Pubmed_Discovery_RA
I have already contacted the author of the 2002 paper and the editors of the journal that published the plagiarized version. If anyone's feeling bored, feel free to dig through the Koizumi paper for other plagiarized bits.
The irony is that I caught it because one of my students plagiarized the same sections as the the second paper - and my sleuthing pulled up BOTH published sources.
How the h*ll am I supposed to require academic integrity of my students when the very papers they review as part of their coursework are ripped off?
James F · 12 March 2008
gabriel,
It's scientific misconduct, pure and simple, and must be dealt with by the journal editors. Granted, it's impossible to guarantee that a manuscript is free of plagiarism; no reviewer can know every single sentence of every relevant piece of published literature. As a researcher and reviewer, I take the default position that what I'm reading is the authors' own work (although I would like to learn more about the online searches used by those who rooted out the Warda and Han plagiarism, I might start using that on every paper I review). When random events bring plagiarism to light, an example must be made and a strong message relayed that it is not acceptable behavior. You did the right thing by altering the editor and the authors whose work was stolen.
harold · 12 March 2008
William Wallace · 12 March 2008
-
WW.1
- PZ's response to WW.1
- WW.2 (replace done with down, energy with power but I am sure PZ gets the point)
But if not, here it is in (hopefully) plainer English: Plagiarism was sufficient. The bellyaching about poor peer review seems to be motivated not over legitimate concern over junk science but about suppressing dissent from the T.o.E. and a desire for another internet execution a la Sternberg. While I am not arguing that peer reviewed journals should become the free for all we have on the internet, increasing the noise can result in increased signal, too. So which is more important: increasing the signal, or maintaining a signal to noise ratio? I think it is an interesting question, the desire for blood not withstanding. Gabriel, have you seen Butler University's Understanding plagiarism ? You could require your students to read it.William Wallace · 12 March 2008
PvM · 12 March 2008
Ichthyic · 12 March 2008
And PvM is a contributor to PT? The mind boggles.
should we remember you said that the next time you project "ad-hominem" on the rest of us?
Ichthyic · 12 March 2008
What Wallace, and other idiots like him, keep failing to grasp is the difference between "revelation", and what appears to be revolutionary science, but is still based on pre-existing observation.
they want to compare creationist arguments like intelligent design, to revolutionary theories in science, but they keep missing the fact that no matter what "revolutionary" hypothesis you examine, the reason it was accepted within the scientific community is because it was still based on PREVIOUS observations, and ended up doing a better job of explaining previously observed data, as well as making more accurate predictions for future observations.
ID goes farther back than Paley, but let's say it didn't. that still gave it essentially equal time with Darwin's theory to "revolutionize" science by having more explanatory and predictive power.
However, since it has NONE of either, it's no surprise we rightly reject it as nonsense at best.
there simply is no comparison.
you morons can cry "victim" all you want, but anyone with any sense can quickly see there is no basis for your whining... other than you are just a bunch of fearful jagoffs; afraid your ignorance will no longer be tolerated by society at large. It's time for society to put to the torch the concept that because you call your ignorance "religion", it deserves some kind of free pass in the world of ideas.
However, know that the louder you scream your ignorant protestations, the more gas you throw on the fire.
Bobby · 12 March 2008
Bobby · 12 March 2008
PvM · 12 March 2008
What I find ironic is how in both cases there appeared to be reuse of existing articles, the difference is that in this case the authors had not written the original articles.
Fascinating design inference however...
PvM · 12 March 2008
Dale Husband · 13 March 2008
Ichthyic · 13 March 2008
Well, I learned something new tonight! Most science journals seem to be way out of my league!
you could polish that into an editorial piece, though.
Kevin B · 13 March 2008
Stuart Weinstein · 13 March 2008
WW said:
"A couple of points. Peer review publication is not the end of peer review and not a good house keeping stamp of bona fide science. It is a first step in the process."
True, to the extent that publication simply means it is of at least casual interest to the scientific community.
"There are at least two schools of thought. Do you want to set up a peer review firewall that does not allow the publication of ideas others cannot yet understand (think Einstein working as a patent clerk while the world ever so slowly recognized the genius of his paper),"
What is it with kooks and Einstein?
A number of people understood S.R. I'm not sure what you mean by ever so slowly; in 2-3 years, S.R. was widely accepted. Journals didn't travel as far and wide, and as quickly they do now. You attempt to project an air of erudition you don't possess.
"or do you want to allow the occasional “bad” paper through with the hope that a good paper won’t be censored? Devout evolutionists are in general against the later, since it could lead to, gasp, the publication of an intelligent design paper."
Intelligent design is not even wrong.
"The second point is: Maybe the journal doesn’t want to disclose its failures exactly because the PT-mafia will work a mob of bloggers into a feeding frenzy; the sharks have detected the fragrant scent of blood."
No scientific journal is safe from scrutiny.
JGB · 13 March 2008
On what basis do you assert that rigorous peer review would have prevented Einstein's paper from being published? You must provide a clear logical connection here otherwise you are just attempting to make some random fearmongering illogical argument.
Stuart Weinstein · 13 March 2008
With respect to Copernicus and heli-geo centrism..
I wrote this in another thread. But its applicable in this one too.
WW writes:
“A point I deem worthy of consideration in the Ptolemy/Copernicus/Tycho/Kepler progression is that it took centuries to get from a Ptolemaic epicyclic/geocentric theory to Copernican heliostatic/heliocentric/epicyclic/constant-velocity model, and even after that, the venerated (as an observational astronomer) Tycho Brahe asserted that the data better matched a Ptolemaic model over the falsified Copernican model.”
This isn’t so strange as it seems in hindsight. Although the epicylic method was based on an incorrect theory, it did offer an algorithm that could be used to compute orbital phenomenon of arbitrary precision limited by the number of “cycles” that could be determined and used.
I believe (someone correct me if I am wrong) that Copernicus claimed that the orbits of the planets were circular (now I think old Nic knew better, but circular orbits may have been a nod to certain religious authorities). It could be that Tycho could see from his detailed observations that circular orbits couldn’t cut it. Hence, although a Copernican paradigm was ultimately a better picture of the solar system, epicycles allowed one to compute more precise timing of astronomical phenomena. So from a 16th century perspective, I would argue that epicycles were the better model.
With Kepler’s laws came a more precise view of the nature of planetary orbits, and a more concise algorithm for computing orbits. At that point, epicycles were doomed to a footnote in history.
“By falsified, I mean, from a sixteenth century perspective: No 1000+ mph wind at equator due to Earth’s axial spin; no observed parallactic displacement of stars. Subsequently, Kepler seems to have simultaneously recognized the scientific value of Tycho’s data as well as the harm in Tycho’s dogmatism, and decided that the ends justified the means. Kepler deceived Tycho and his heirs. But Kepler ultimately produced the heliocentric/elliptical/changing velocity planetary orbit model we so clearly recognize as “true” today
Assuming this progression and regression is not unique, where in this drama is evolution?
I think sometime before Kepler; that is, we currently have a Ptolemaic/dogmatic theory of evolution.”
Not a chance. At worst it may be between classical mechanics and QM.
“The truth is mighty, and will prevail (eventually).”
The “truth” has already prevailed. What we are trying to do is get a more precise description of the “truth”
MartinDH · 13 March 2008
William Wallace · 13 March 2008
Stuart Weinstein: "A number of people understood [special relativity]"
Do you think his boss at the patent office did? Do you think a manager at a patent office promoted Einstein for his S.R. paper, while nearby universities continued to not offer Einstein a position?
SW: "I believe (someone correct me if I am wrong) that Copernicus claimed that the orbits of the planets were circular (now I think old Nic knew better, but circular orbits may have been a nod to certain religious authorities)."
Copernicus' model used epicycles too, in an attempt to reduce discrepancies between his mere mathematical model and actual observations.
Tycho later successfully argued that the geostatic models produced as accurate if not more accurate predictions, and were less complicated than Copernicus's. Both models were wrong, but Tycho's model, the more incorrect one that still lined up with observations (think Coulter's "story to fit the facts"), prevailed for some time, primarily because Tycho was the premiere observational astronomer of his day. [Note: Tycho was born about three and a half years after Copernicus died.]
Incidentally, Copernicus' book actually had a little fluorescent orange sticker that cautioned readers: ~"Heliocentricism is just a scientific theory; a mere mathematical model." And yet science survived. And, the warning was correct.
Okay, the warning was in a preface, was not fluorescent orange, and it was inserted by a sympathetic Lutheran at the printing house. And as far as I can tell, Copernicus was a Catholic priest, though modern secularists like to marginalize if not mask this fact.
William Wallace
Torbjörn Larsson, OM · 13 March 2008
Torbjörn Larsson, OM · 13 March 2008
Torbjörn Larsson, OM · 13 March 2008
To the comments modulo vacuous spelling errors, as it were, I would also like to add the observation that the revolution of cosmology wasn't paradigmatic as the models and methods resembles the earlier ones. Take that, Kuhn!
Mr Darkman · 13 March 2008