As my post on “open access” demonstrates, I’ve been thinking a lot about International Relations journals over the last few months, particularly with respect to digital media. Charli’s excellent presentation on the discipline and “web 2.0″ fell at an interesting time for me, as I was working on a journal bid. My sense is that academic International Relations journals have a mixed record when it comes to fulfilling their varied functions in the field, and that better internet integration would help matters. This post seeks to make that case — albeit in a very preliminary way — but also might be read as a rumination on purpose of IR journals… and an attempt to raise questions about the state of journals within international studies. I guess a good place to start might be with the “official line” on academic journals. What are they for? The quasi-random people behind the wikipedia page on the subject write:

An academic journal is a peer-reviewed periodical in which scholarship relating to a particular academic discipline is published. Academic journals serve as forums for the introduction and presentation for scrutiny of new research, and the critique of existing research. Content typically takes the form of articles presenting original research, review articles, and book reviews.

We often hear about journals as sites for “leading” and “cutting-edge” research on particular topics and, depending on the journal, particular inflections. But, as many commentators point out, the time from submission to publication at many prestige journals now lasts at least year. Articles sometimes accumulate a great deal of citation and discussion by appearing at online depositories, such as SSRN. Indeed, work in International Relations — most often quantitative — gets de facto peer reviewed many times before it appears in a journal. Indeed, this kind of peer review is arguably less stochastic and, in aggregate, more complete than what a manuscript receives at a journal.

My sense (and that, I believe, of many others) is that academic journals serve a number of purposes that are connected, but not always tightly coupled, to idealized accounts of what they’re good for.

Professional certification. Leading journals are hard to get into. The volume of submissions, as well as the (related) attitudes of referees and editors, require a piece to “hit the jackpot” in terms of reviewer evaluations. Because referees and editors care about maintaining–and enhancing–the perceived quality of the journal, they work harder to make articles conform to the field or subfield standards of excellence. As we move down and across the journal hierarchy, these forces still operate but to lesser degrees. Thus, lower-ranked journals or journals perceived as being “easier to get into” provide less symbolic capital.

Defining standards of excellence. Another way of saying this is that journals produce, reproduce, and transform genre expectations for the style and content of scholarly work. What appears in leading journals sets standards for what should appear in leading journals; even if scholars don’t necessarily buy those standards, those attempting to publish in such journals will seek to replicate “the formula” in the hopes that it improves their chances of success. The same is true of less prestigious and more specialized journals, but those on the top of the hierarchy inflect as example (whether positive or cautionary) genre expectations associated with many of their less famous relatives.

Vetting work. Regardless of what one thinks of the state of peer review, it does provide a gauntlet that often improves–by some measure or other–the quality of the product. So does the attention of dedicated editors. At the very least, we believe this to be the case, which is all that matters for the role of journals in vetting scholarly pieces.

Publicizing work. Scholars read journals–or at least tables of contents–that “matter” (i.e., have currency) in their subfield and in the broader field. So getting an article into a journal increases– subject to the breadth and depth of that journal’s reach–the chances that it will be read by a targeted audience.

Constituting a scholarly community. Much of the above comes down to shaping the parameters of, and interactions within, scholarly communities. These “purposes” of journals do so in the basic sense of allocating prestige, generating expectations, and so on. But they also contribute to a scholarly sphere of intellectual exchange–they help to define what we talk about and argue over.

My claim is as follows: every one of these purposes is better met by embedding scholarly journals in Web 2.0 architectures and technologies, whether open-access or not, peer-reviewed or not. The particular advantage of these hybrids lies in vetting, publicizing, and constituting a scholarly community.

Digital environments promote post-publication peer review both by allowing comments on articles and by facilitating the publication of traditional “response” pieces. There’s no reason to believe that they undermine the traditional vetting mechanisms, as they handle core articles the same way as non-embedded academic journals.

Traditional journals, on the other hand, do a poor job of publicizing work; particularly older articles that disappear into the ether (or the bowels of the library). That’s why blogs such as The Monkey Cage have occupied such an important position in the landscape. A journal embedded in shifting content — blogs, blog aggregation, web-only features, promotion of timely articles and articles that speak to recent debates in other journals — keeps people coming back to the site and, in doing so, exposes them to journal content.

The advantages in terms of constituting and maintaining a scholarly community should be obvious. Web 2.0 integration promises to transform “inputs into community” into ongoing intellectual transactions among not only scholars, but also the broader interested community.

As alluded to above, this transformation is already occurring. But I worry about two aspects of its trajectory.

The most “important” general journals in the field are way behind.

A number of the current experiments are operating in isolation from the online academic IR community, e.g., they produce “blog posts” that read like op-eds intended for the New York Times, and the only evidence of being in conversation with that community is in the form of desultory blogrolls.

I think you’re central insight is a good one, but I wonder how this deals with the problem of content overload (which I think is probably the larger issue)?

dnexon

It doesn’t. We’re screwed.

Well, not exactly. I do think it at least provides a way of packaging and distributing relevant content.

But yeah. Too many journals. Too many words. Too much to read. I used to think the result was a power-law distribution that reinforced the primacy of “elite journals,” but now I’m not sure.

Neil Levine

You’ve been raising some interesting points and I applaud your efforts to bring journals into the 21st century but I wonder if your thinking is radical enough.

When you start to think of the content separate from the container you realise that the opportunity is much greater than just increasing dissemination (while protecting the values of journals, that your list above). You can start to embed the content in electronic activities in a more profound way than just allowing comments or discussions, or even automatically tracking citations. Take a look at http://book.pressbooks.com/ which contains articles which start to hint at the type of things that can be done once printed material is connected to the web. Tools like hypothes.is and companies like Fluidinfo.com start to come into the mix – allowing sentence-level annotations, contextual meta-data to be added, and so on.

You are right that embedding journal content into web 2.0 technologies has very little downside, as long as editorial rights are managed properly. But I would argue that we need to look beyond current methods of web 2.0 interaction and use the emergence of journals into the public space as a catalyst for a new round of web-based innovation.

dnexon

Neil: excellent points. I agree completely.

http://twitter.com/dailyworldwatch Sumantra Maitra

I think there should be an IR journal just to give young scholars and academics a chance to publish. The old, elitist snobbish journals, discard thousands of pieces often on the names from where they come from. An elite institution scholar or academic would definitely have less scrutiny than a novice…even though the quality of the piece might be the same.

Josh Busby

To Neil’s point, Andrew Moravcsik has been pitching this idea to funders and hopes to launch a major project that would allow people to cite original source material and have people immediately link to the source documents and assess for themselves whether their interpretation of the raw material is correct. This would apply to both archival material as well as secondary sources.

LFC

In theory at least this doesn’t apply to peer-reviewed journals where articles are submitted w names of authors removed. Could be a problem w other journals, eg Foreign Affairs and the like. But there are quite a few of both types of journal around now. The problem is probably not too few journals. (see D.Nexon-J.Hayes exchange below)

Clifford Bob

Neil and Josh: My new Global Right Wing book may be the first to implement Moravcsik’s idea. You can access its active citations bibliography through the book’s website: https://sites.google.com/site/cliffordbob2/grw Creating the bib was quite labor-intensive, and I describe my method at the start of it. (I do not have RAs capable of doing this work for me.) As a result, I only made a limited though still large number of cites active, primarily NGO docs that you can’t get at a university library and that often disappear quickly from the Web. Moravcsik also warned me about copyright issues, so excerpts of most web-based NGO docs are only about a fair-use para long. Comments welcome, not only about the bib but also the book’s argument!