Showing posts with label peer-review. Show all posts
Showing posts with label peer-review. Show all posts

Tuesday, March 16, 2010

Mad Neanderthals, peer review and scholarly publication

There's been a growing rumble in the world of scientific publishing for the past several months, focusing especially on the nature and practices of the journal Medical Hypotheses. Briefly put, MH is a non-peer-reviewed journal that publishes original, controversial ResearchBlogging.organd thought-provoking ideas ("hypotheses" defined in the broadest possible sense, I guess you could say) about the medical realm sensu lato. Now, as reported by Science Insider, MH's editor, Bruce Charlton (here's his blog presenting his position on this affair), has all but been been fired as lead editor of the journal (unless MH is completely reorganized), mainly as a result of the brouhaha and subsequent fall-out over MH having accepted to publish a paper denying the link between HIV and AIDS. Indeed, some have gone so far as to wonder whether MH might be labeled "the most hated journal in science."

Orac provides a thoughtful dissection of some of the problems with MH and of the impact of publishing some of what was published in that venue in recent years. I doubt I could do much better than that in terms of providing background and context to the 'regime change' underway at MH. That said, I figured I'd throw out my two cents about this, given two things: 1) I've recently published something in MH; 2) what it means for the public understanding of scientific arguments; and 3) Elsevier's role in all this.

First, two years ago, a short commentary of mine was published in MH (Riel-Salvatore 2008), I hasten to add in response to a paper they had published, which I felt was very poorly argued and completely unsupported by the available data (Underdown 2008). To MH's credit, the process of publishing my reply was very smooth, transparent and, importantly, very quick. My comment was based on a post I first had up on AVRPI, a process I chronicled in detail before, and it took all of three months from the blog-to-published-comment process to unfold, which I was personally quite happy about. Likewise, I have to say that my impression throughout this process was that MH was quite open to even very 'vigorous' criticism of papers it published. It was also nice that you didn't have to pay to publish a comment, whereas you have to pay 'page fees' to publish an actual paper in MH (itself a questionable practice, especially if it doesn't result in open access to the paper in question, but that's another post for another time).

That said, there was a good reason why I felt the need to publish that comment, even though, as a non-peer reviewed piece on a non-peer reviewed piece, it was essentially a double net loss to my research productivity, especially since I had no personal stake in this, i.e, it didn't portray any of my own work negatively. That reason was the amount of play the original paper had received in the popular press. And this, fundamentally, is the issue I have with journals like MH. To the public at large, reading that a 'study' or a 'new paper' has been published in a 'journal' (especially if it is by someone described as a professor or researcher affiliated with a bona fide university), implies that it is a serious contribution to the literature on given debates. In this case, the 'mad Neanderthal' meme as a credible explanation for their disappearance went full-steam ahead, with no real detractors on the record. I suspect that this acceptance was due in no small part to the fact that it had been published in a 'journal', never mind the facts that authors basically need to pay to have their research published in MH, with no resulting public access, and the that, contrarily to most research on Neanderthals that makes its way to the popular press, this paper was not critically evaluated by peers of the author. This is not to say that non-peer reviewed publications don't have their own raison d'être, but rather that they need to be explicitly recognized as such, especially before results published in such sources get fed to the media.

As it is, to the non-specialist, MH certainly has the appearance of a peer-reviewed journal. For one thing, it's a 'journal.' For another, it's published by Elsevier, which touts itself as "the world’s leading publisher of science and health information" (from their website). With such backing, why wouldn't someone assume that MH is a reputable source? It's even got 'medical' right there in the title! Hell, I hadn't heard of MH before reading Underdown's paper, and my first reaction upon seeing it was an Elsevier pub certainly was that it was most likely a peer-reviewed journal. Plus, as this post's inclusion on Research Blogging shows, it even has a doi and everything, making the contents of MH appear as legitimate peer-reviewed publications, as does their inclusion in scientific databases like Web of Science. This is not to exculpate people who don't do their homework, but MH certainly has all the outside appearance of a peer-reviewed publication.

This leads to the third point, namely the business practices of Elsevier, who bought MH in 2002 (the journal was created in 1975). I think an important question to ask is why Elsevier bothered to acquire MH in the first place? Given its current double-take on MH's worth as a scientific publication, it kind of makes one wonder whether the goal of dominating as much of the scientific publishing market as possible made the higher-ups at Elsevier ignore the nature of that journal in their continuing efforts to take over an increasing share of the publishing world, no matter what the costs... I very much doubt that they had as their ultimate goal to make MH into a full-blown peer-reviewed publication (if so, why wait 8 years?), so what's the story here? I think we may be witnessing an instance of Elsevier's business model backfiring, and though they're clearly trying to shift the fall-out solely on MH, I think it ultimately highlights the hypocrisy that grows from the tensions between the mission of scientific publication and the business realities faced by publishing conglomerates within which individuals become increasingly faceless entities conceived more as profit-making devices than conduits for the wide and timely dissemination of scientific knowledge. I think this is all the more grating given that scientists are essentially forced to give away their work to be published in the 'right' Elsevier journals - and those of other large publishing companies - (even if in many cases their reputation far precedes their incorporation by Elsevier) for purposes of getting tenure, professional prestige, etc.

In any case, my point here is not to say that MH is all sorts of awesome and that Elsevier isn't. In fact, my only involvement with MH came as a reaction to a paper that I thought was of pretty low academic quality (which echoes some of the problems that precipitated the current fiasco) and which they nonetheless elected to publish, even though it echoed another short paper written almost 35 years prior (
Wolbarsht 1975). It also isn't that it is not a peer-reviewed journal - even Nature publishes some non-peer reviewed comments that are downright wretched (see a nice takedown here)and which I'm sure the yahoos who write them bandy about as "publications in Nature!" (hey they have doi's and issue/page numbers and everything!). Rather, I think that this whole situation points to some systemic problems in academic publishing, especially as practiced by large conglomerates increasingly detached from the goals and individual realities of the given journals they opt to take over, largely in the name of lucre more than any actual scientific mission.

References

Riel-Salvatore J (2008). Mad Neanderthal disease? Some comments on "A potential role for Transmissible Spongiform Encephalopathies in Neanderthal extinction". Medical hypotheses, 71 (3), 473-4 PMID: 18524493

UNDERDOWN, S. (2008). A potential role for Transmissible Spongiform Encephalopathies in Neanderthal extinction Medical Hypotheses, 71 (1), 4-7 DOI: 10.1016/j.mehy.2007.12.014

Wolbarsht, M. L. 1975. The Demese ef the Ne'enderthels: Wes Lengege E Fecter? Science 187:600-601.

Thursday, March 04, 2010

Research Blogging Awards 2010

Research Blogging Awards 2010








You may have noticed a new widget on the right side-bar of this blog, one linking to the 2010 ResearchBlogging Awards, where I was shocked to see I had been nominated as one of the finalists for best social sciences and anthropology blogs, along with several other blogs some of which are on the AVRPI blogroll. This came as a humbling surprise, albeit I suppose also a flattering one

Regular readers will know that I usually append a ResearchBlogging vignette to the posts in which I discuss peer-reviewed papers. In their own words, RB is "a system for identifying the best, most thoughtful blog posts about peer-reviewed research. Since many blogs combine serious posts with more personal or frivolous posts, our site offers a way to find only the most carefully-crafted posts about cutting-edge research, often written by experts in their respective fields."

Basically, it's a neat system to diffuse the results of blogging on peer-reviewed research, that ensures that the reviewing is done by people with relevant background and qualifications. It also distinguishes bloggers that actually discuss the meat of given studies rather than just linking to or reposting press releases. As I've mentioned before, I think that this kind of quick and in-depth discussion is one of the aspects that make blogs so important and relevant. Plus, it can provide the seed for work that ultimately gets published.

Thinking about it a bit more, I'm very happy about this nomination, given that the time I devote to this blog is time I don't get to devote to A Very Remote Wife Indeed, my students, or my research. So, it's nice to have some kind of external recognition, and a thousand thanks to whomever nominated AVRPI. If you're interested in seeing the nomination go to the next level (i.e., for this blog to nominated as best social science/anthropology research blog of the year), you can vote at Research Blogging, from today until March 23. Here's how:

Voting: Voting for the winners will be conducted by invitation to bloggers registered with ResearchBlogging.org. Invitations will be sent on Thursday, March 4. If you're registered with us, you may want to check your account to make sure your email address is up-to-date. If you're not registered (and you blog about peer-reviewed research), you still have time to register so you can vote. Visit this page for more information.

Awards: The awards will be announced on March 23, 2010.