Balancing Act

I’m kind of in the pickle that Maura describes – subscribed to too many sources of information that I would read if I weren’t so busy keeping up with the stream of new information. But Current Cites is always a good ‘un for finding a cross-section of interesting new stuff and this week it pointed me to a twig I must have missed in the current. Sometimes it’s only when you see it the second time, maybe just as you’re pouring a second cup of coffee int he morning, that it catches your eye.

First Mondays (an excellent and long-established open access journal) has an article by Brian Whitworth and Rob Friedman on “Reinventing Academic Publishing Online.” In a nutshell, it examines the fact that the “top” academic journals remain vested in a traditional system in which maintaining barriers and exclusivity because their exclusivity is perceived as rigor and therefore value. The higher your rejection rate, the prouder you are. But there are two mistakes academic publishing can make: publishing stuff that isn’t any good and not publishing stuff that turns out to be good. It’s the cost of the latter – failing to publish something innovative and challenging for fear it might be wrong – that these authors feel is left out of the equation.

These error types trade off, so reducing one increases the other, e.g., a journal can reduce Type I errors to 0 percent by rejecting all submissions, but this also raises Type II errors to 100 percent as nothing useful is published. The commonsense principle is that to win a lottery (get value) you must buy a ticket (take risk). In academic publishing the rigor problem occurs when reducing Type I error increases Type II error more . . . Pursuing rigor alone produces rigor mortis in the theory leg of scientific progress.

The authors point to the fact that the publishing industry essentially determines who is hired and fired in universities, which flies in the face of the mission we are supposedly on and the intellectual freedom that should enable our work.

When a system becomes the mechanism for power, profit and control, idealized goals like the search for truth can easily take a back seat. Authors may not personally want their work locked away in expensive journals that only endowed western universities can afford, but business exclusivity requires it. Authors may personally see others as colleagues in a cooperative research journey, but the system frames them as competition for jobs and grants. As academia becomes a business, new ideas become threats to power rather than opportunities for knowledge growth. Journals become the gatekeepers of academic power rather than cultivators of knowledge, and theories battle weapons in promotion arenas, rather than plows in knowledge fields.

The authors suggest that under the color of “rigor” this model sustains a system in which cross-disciplinary and innovative research is unwelcome. “As more rigorous and exclusive ‘specialties’ emerge, the expected trend is an academic publishing system that produces more and more about less and less.” (And hey, it’ll make the Big Bundle even bigger and more expensive, therefore more profitable.) They think instead technology could offer ways to facilitate information exchange rather than creation of further citadels of isolated specialization. Paying more attention to the mistake of failing to publish something that turns out to be worthwhile will require the creation of a democratic open knowledge exchange which can better balance the equation.

The funny thing is that this tension has existed for a long time. Well before the Internet enabled the opportunity for fundamental change in the way we share research, both Michael Polanyi and Thomas Kuhn described the delicate tension between maintaining an agreed-upon understanding by fending off crackpot theories and the need to allow something new to challenge the dominant paradigm. Both self interest and a more idealized notion of rigor conspire against innovation. What I find interesting about this First Monday article is the idea that our current dominant publishing model has let self-interest reign supreme, and that a new open model could let the more idealized urge to preserve that which is solid and true duke it out with ideas that challenge it. It could balance the risk/reward tradeoff involved in choosing what to publish and which questions to pursue.

By the way, what is your library planning to do for Open Access Week?

(Photo courtesy of rptnorris.)

Faculty Blog Round-Up: Writing Books

At the peak of summer, many faculty are in deep research mode, especially with longer projects, like books, that require the kind of travel or in-depth work they can’t schedule during the semester.  Here’s an overview of the book-writing process from the inside

Dr. Crazy, an anonymous literature professor, is beginning to ponder her topic.

Anthropologist Auto Ethnographer is in the throes of research – research that goes to show why sometimes we just need the original print texts.

Flavia, an anonymous professor of renaissance literature, is substantially revising her dissertation – and has come to some interesting realizations about her book-in-progress.  Check out the comments here, too.

Notorious Ph.D., a historian, is revising and ambivalent about her readers’ feedback.

Finally, John Holbo, a philosopher at National University in Singapore, has just published a book on Plato (with translation by Belle Waring).  This post is interesting for two reasons: it’s an experiment in simultaneous free e-publishing with a print book for sale, as well as reminding us how the scholarly conversation doesn’t end with the book’s publication.

Faculty Blog Round-Up: The Publishing Cycle

Over at Edge of the American West, UC Irvine English professor Scott Eric Kaufman has a bit of a rant about both the delay and format of the January issue of the journal of the Modern Language Association.

Cheer up, SEK; it could be worse.  The anonymous Lumpenprofessoriat tells a tale of woe, with an eventual happy ending, about a much longer submission-to-print process.

On the other hand, Eszter Hargittai, currently a Fellow at Harvard’s Berkman Center, writes at Crooked Timber about “Peer Review at Record Speed” – refuting the Facebook-grades correlation in a peer reviewed, open access publication in just a couple of weeks.

The enormous variation in these stories complicates everything we do, from collection development to instruction to supporting scholarly communications.  The need for speed, especially among those on the tenure-track, might be an untapped reservoir of support for open access online publishing. 

PS – Just in case you were feeling under-appreciated, see why mathematician Rudbeckia Hirta will never leave the academy. 

Enjoy the holiday weekend!

Peer (to Peer) Review?

Gary Olsen raises an interesting issue in the Chron – as more scholars put their efforts into online scholarship, how can it factor into promotion and tenure decisions? His answer – devise a system whereby scholarly societies certify sites that are submitted for peer review, maintain a registry of certified sites, and check back often to make sure they haven’t fallen off in quality or been overtaken by pre-teen hackers.

He says the peer review system for vetting books and articles works pretty well, but P&T committees (and everyone else, apparently) are at a loss when confronting a website –

. . . since no vetting mechanism for scholarly sites exists, even those that are designed by reputable scholars typically undergo no formal review. Such uncertainty disrupts the orderly intercourse of scholarly activity and plays havoc with the tenure-and-promotion system.

Clearly, the scholarly community needs to devise a way to introduce dependability into the world of electronic scholarship. We need a process to certify sites so that we all can distinguish between one that contains reliable material and one that may have been slapped together by a dilettante. We need to be able to ascertain if we can rely on a site for our own scholarship and whether we should give credit toward a colleague’s tenure and promotion for a given site.

Gee, given that we’ve been evaluating and comparing websites and deciding which to highlight as useful ones for research for a couple of decades now . . . are we really incapable of making those choices without a disciplinary stamp of approval? And is peer review really so flawless that we need to replicate it for a new genre of scholarship? And what about all those sites that aren’t scholarly projects per se but are incredibly valuable – the Avalon Project, the Oyez site, or the Pew Research Center for the People and the Press, for example? Should we doubt their value because they aren’t vetted by scholars in the manner of journal articles or university press titles?

The fact is, we work hard to develop in our students the capability of judging quality, not just relying on a peer review stamp of approval. I mean, honestly – if we told students any peer reviewed source is guaranteed to be of high quality we’d be doing them a disservice. So why do P&T committees want to have their critical work so oversimplified for them? Can’t they learn to rely on their own capacity for critical thinking, or is that just for students?

The fact is, these are two entirely separate issues. The quality of websites can be evaluated – and peers already do that. Whether academics are willing to broaden their notions of what counts as scholarship and to consider electronic projects as serious work is another matter altogether. Replicating a cumbersome print-based peer review mechanism, flaws and all, is not the solution. Doing the real work of evaluating a colleague’s scholarship – without relying on university presses and journals to do the vetting for them – is what’s called for. Oh, and a more imaginative and open-minded definition of what scholarship is.

I thought this playful version of Rodin’s The Thinker that I saw on the Washington University of St. Louis campus last week seemed somehow appropriate.

rabbit thinker

ADDITION: I just bumped into This is Scholarship – an interesting response to the MLA task force report that questioned the dependence on the monograph as proof of scholarship over at the InfoFetishist (where there’s a terrific list of things to read and think about).

So maybe, as an addendum to our efforts to encourage more responsible use of open access research opportunitiies, libraries could also help scholars at their institutions think more creatively about what counts as scholarship? Hey, we could at least buy them lunch and let them talk through the issues.

Web 2.0 and Open Science

Drexel University Libraries’ annual Scholarly Communication Symposium focused on web 2.0 in general and open science in particular. This is fast becoming my favorite conference: I can walk there; it’s free; it’s well organized; everyone there is smart, friendly and from diverse backgrounds; you get to eat a great lunch and it’s all over by 1:30!

Keynoter Jean-Claude Bradley (Chemistry) described UsefulChem and his mash-up of technologies for disseminating his work. I was struck by his pragmatic approach–some articles are better suited for peer-reviewed journals, some items better suited for blog posts or wikis, some items for mailing lists. He described what he called “open science” which is making your lab notebooks and all data available to anyone who would like to look at it. He claimed the old way to evaluate information was to see if it was peer-reviewed, the new way is to make all the data available and let everyone look at it to see if they can find any problems.

A questioner in the Q and A asked about patents and giving up the power to exclude. Bradley responded, “if you are trying to get a patent, I wouldn’t recommend this approach. But if you have a project in which you don’t care about a patent, it’s a great way to find collaborators.” The costs of 2.0 may include giving up the power to exclude, but in return you often get feedback on your work where previously you wouldn’t get any and you get found more.

Bradley struck me as an example of the kind of scholar who has figured out how to mix the new tools with the old and use them both to advance his own work and to advance his field. Whether he has any life outside his work and posting to his blogs and wikis is harder to say.

He mentioned a few tools I hadn’t heard of. He described Friendfinder as some kind of friend feed app that informs you what your friends are doing, who finds you interesting, who finds you boring. (At this point an old Blondie song jumped to mind–once had friends it was a gas/ soon turned out/ to be a pain in the ass…) The point was this is how he keeps up with new information, through his social network. ChemSpider is a free hosting service of 20 million molecules, JSpecView allows people to look at fine details of your spectra, which is apparently very important in chemistry; and something in Google called InChiKey, again having to do with molecules. The overall idea was how the web was able to provide more detail that was formerly not available with just the peer reviewed journal article.

When asked if 2.0 is truly transformative, he said, “collaboration is not necessarily new or different, but now you can do it faster and with people all over the world. In a large enterprise like science this can make a big difference.” Well put.

Two other points. Bradley predicted open science would lead to the day when computers could do the number of experiments that took his students a year to do in one weekend; and when asked if he worried about the archiving of his work he said he tried to take care of this through 1. redundancy, and b. that in 5-10 years all his work will be obsolete anyway. (!)

The panelists and my roundtable were full of engaged people with lots to contribute. Banu Onaral, in particular, raised some provocative issues, including the idea that Asia will lead the way in the new certification of academic credentials, and she asked the question, what happens when another country (e.g. China?) that maybe doesn’t share our values buys up these formerly free hosting services (e.g. Google etc?) and they decide to restrict them and we trusted them with our collective genius?

Thanks to Drexel University Libraries for another stimulating scholarly communication symposium.