Why are open access supporters defending the impact factor? science politics | email to someone | printer friendly
Maybe I'm naive. Maybe I'm just too thick to get it. But over the last few days I've been on the receiving end of quite some flak for my criticisms of Thomson Scientific's impact factor (IF) by, of all poeple, open access supporters! The discussion has been going on behind closed doors in two different threads on a message board for editors of PLoS One. Obviously, these discussions are confidential, so there won't be any names, but let me give you the gist of the debate.
Currently, Thomson Scientific (TS) is not listing PLoS One. Therefore, PLoS One does not have an IF. PLoS One editors are negotiating with TS to get listed, but so far without effect. Given the current weight of the IF in promotion, grants and tenure, it's understandable that people would like to have PLoS One listed with TS. But the whole philosophy behind PLoS One is that it shouldn't matter where something is published. Post-publication review is what should determine the quality of a publication after it was published, not some editor at some journal before peer-review. This may be one of the reasons (my speculation here) that TS is so reluctant to list PLoS One: if this concept is successful, it would eradicate the IF along with journals. So on the message board, I have been arguing that instead of bolstering the value of the IF, We, the scientists, should declare our independence of the IF and start creating a fairer, better publishing system, where scientists and not editors decide what is high-qality and breakthrough research, what is the kind of bread-and-butter research without which no breakthroughs can happen and which studies are not worth the bytes they occupy in cyberspace. The weaknesses of the IF are well known and covered. Despite the flawed nature of the IF, quite a number of people are defending its use and demand PLoS One should do everything possible to get listed. Here are a few quotes from my fellow PLoS One academic editors:
I agree with all that has been stated about the negative aspects of the IF. However, the REALITY is that the uninitiated, such as a Committe judging tenure, or a Committee deciding on a new Chair appointment, absolutely require Impact Factors for each article.
[...]
Therefore there is no use in arguing against the importance or lack of same of the IF.....lets just get it.
[...]
Scientists (sad but true) belong to the most conservative professionals in general. Despite anything that is counting agaist the IF, this will remain the measure for 99% of us for time to come.
[...]
Authors will still care about it, although they will officially say that IF's are ridiculuous. But scientists are hypocrits (like most people) and they will continue to send their papers to high-IF journals, whether we like it or not.
[...]
I say this with some sadness, because I myself do not care much about IF:s, but I know a terrible lot who does and I have given up all my attempts to discuss this with people, since it seems hopeless to argue about. That's human nature, I guess.
[...]
People are still quite concerned about IF:s, although they admit that they are misleading, but as long as the research finance system favours authors who publish articles in high-IF journals, they will continue to try get published there, whether we like it or not.
[...]
I couldn't agree more with all that is being said about IFs. Unfortunately, the reality for most academics is that all kinds of evaluation committees use IFs to evaluate a researcher's output.
[...]
I know how flawed IF is, but we just cannot be blind to the reality and should still make a best effort to have PLoS ONE indexed by Thomson.
[...]
The reasons you enumerate against the IF system are of course valid. However, IFs are still the most used way of evaluating a researcher's career and value. Even if we find this ridiculous, it's just the way it is. Therefore, I find it very important for PLoS ONE to try to get an IF, independently of the other suggestions that have been made.

And so on and so on. It's basically always: "I know the IF is really bad, but what could be possibly do about it? So let's try to arrange ourselves with it".
How can people who donate time and enthusiasm for the open access movement and publishing reform be so fatalistic? WE are the customers of the monopolist private company that TS is. WE decide who we promote and who gets tenure. How can something as flawed and pernicious as the IF have so much control over people? I just don't get it. Do you?

Wednesday 03 September 2008 - 15:27:21 ----- comments: 5

Comments
bullet Anonymous
Guest
03 Sep 08: 15:56 |
No, I don't get it. There's a place for realpolitik, but this is not it -- authors have the real power in this situation. I am very disappointed that PLoS, especially PLoS ONE, will not stand up and openly refuse to be part of the Impact Factor Insanity.

bullet Bill Hooker
Guest
03 Sep 08: 16:04 |
(The comment above is me, forgot to sign.)

bullet kevin z
Guest
03 Sep 08: 20:25 |
PLoS ONE should define the FU factor for these gutless cowards. So much for the bold movers and shakers of the publishing world.

bullet Peter Suber
Guest
04 Sep 08: 08:18 |
I wrote about these issues in an article published on Tuesday,

"Thinking about prestige, quality, and open access", SPARC Open Access Newsletter, September 2, 2008
http://www.earlham.edu/~peters/fos/newsletter/09-02-08.htm#prestige

See esp. Section 8.

I argue that *universities* should stop relying on IFs to evaluate the quality of faculty or their work. But it doesn't follow that *journals* shouldn't stop caring about IF.

Peter


bullet bjoern

Comments: 110
Location: Berlin, Germany
04 Sep 08: 11:10 |
That's a great article! Thanks for sharing!

Submit comment
Subject
Username:
Comment:

This site is powered by e107, which is released under the terms of the GNU GPL License.
linking back to brembs.net




Welcome Guest
Username:

Password:


Remember me

[ ]
[ ]
[ ]
 Currently Online (18)
 Extra Information
MicroBlog
NeuroTwitter

on [11 Jun 09: 07:16]
I have two articles in the new Laborjournal http://laborjournal.de whohoo!

on [04 Jun 09: 07:24]
Accepted in Current Biology: "mushroom-bodies regulate habit-formation in Drosophila"!

on [27 May 09: 02:55]
Many chimneys here in Fribourg have tiny little houses on them. What gives?

on [24 May 09: 16:29]
Interspersing FriendFeed commenting makes grading students' papers bearable...

on [12 May 09: 11:52]
Just got back from my lecture on scientific publishing: the incredulity of the students when they learn about our system is hilarious!

on [08 May 09: 10:18]
First version of my Habilitation talk is ready: Microbe wars: ecology and toxicology of bacterial toxins

on [30 Apr 09: 17:39]
Getting ready to leave Hawaii - after my presentation this afternoon.

on [25 Apr 09: 16:57]
Now handled 20 papers for PLoS One: http://is.gd/uyyU

on [19 Apr 09: 09:18]
On my last leg from Seattle to Hawaii.

on [17 Apr 09: 18:18]
Getting ready to fly to Hawaii

on [10 Apr 09: 07:05]
iTunes is by far hands down the worst software I have on my computers, with a large margin! What an utter piece of crap!

on [06 Apr 09: 18:43]
JoVE went well, tomorrow's my research talk.

on [03 Apr 09: 05:59]
Starting to be ready for the trip to Edinburgh on Sunday

on [03 Apr 09: 01:24]
Got interviewed by a radio station about this paper yesterday: http://is.gd/qrYx now it's on Spiegel: http://is.gd/qrYS

on [01 Apr 09: 01:03]
I did not know our University had a Web 2.0 service and support team: http://is.gd/q0ZV

on [29 Mar 09: 16:12]
Watching a great program on chronobiology featuring a lot of Till Roenneberg's work. I so love German public TV!

on [20 Mar 09: 10:46]
Our labmeetings are so worthwhile and productive!

on [03 Mar 09: 12:52]
Aced the talk and got the fellowship. That means I'll be a Heisenberg fellow soon: http://tinyurl.com/heisi

on [02 Mar 09: 17:27]
Getting some sleep in Bonn before my 15min talk which will decide if I'm unemployed next month or still in research.

on [26 Feb 09: 04:32]
Back in Berlin, catching up with work here.

on [23 Feb 09: 02:55]
Never, ever stay at the Holiday Inn Bristol Airport! Worst rip-off nightmare ever!

on [23 Feb 09: 02:07]
Getting ready to take the train from Bristol to Exeter.

on [22 Feb 09: 11:30]
Getting the final preparations ready to speak at Exeter tomorrow.

on [20 Feb 09: 12:18]
Have a layover in Seattle, Wa. on April 18. Anybody there up for a beer?

on [03 Feb 09: 13:21]
Yay! I have now undergraduates signed up for all my little side-projects until the summer. I expect some really cool results


Random Video
Wisskomm Wochenschau
GeoCounter
outils webmaster
Render time: 0.7471 sec, 0.3812 of that for queries.