Journal editors are poor selectors of best papers

Journal editors are thought to be exceptional scholars who are capable of identifying the best papers and in particular those that will have the largest impact, typically measured by citation counts. But editors have considerable help: first peer reviewers make reports that should be informative, second authors to some extend self-select in the submission process, they would not send a paper where it has no chance of getting published. But it is difficult to evaluate whether an editor is doing a good job. However, when editors choose to put as lead paper the one they consider the best in the issue, one can in retrospect check whether these papers are cited the most. As I reported earlier, editors turn out not to be particularly good.

What about those papers that get the "best article of the year" award? Tom Coupé does a similar exercise and finds that they are more cited than the median article, and slightly more than the runner-up articles, but they are rarely the most cited in a year. You just cannot trust editors, even though they are even supported by a committee for such awards.

No comments:

Post a Comment