Reliability of Journal Impact Factor Rankings
Darren C Greenwood (d.c.greenwood@leeds.ac.uk)
BMC Medical Research Methodology 2007, 7:48 doi:10.1186/147
ABSTRACT
Background
Journal impact factors and their ranks are used widely by journals, researchers, and research assessment exercises.
Journal impact factors and their ranks are used widely by journals, researchers, and research assessment exercises.
Methods
Based on citations to journals in research and experimental medicine in 2005, Bayesian Markov chain Monte Carlo methods were used to estimate the uncertainty associated with these journal performance indicators.
Results
Intervals representing plausible ranges of values for journal impact factor ranks indicated that most journals cannot be ranked with great precision. Only the top and bottom few journals could place any confidence in their rank position. Intervals were wider and overlapping for most journals.
Conclusion
Decisions placed on journal impact factors are potentially misleading where the uncertainty associated with the measure is ignored. This article proposes that caution should be exercised in the interpretation of journal impact factors and their ranks, and specifically that a measure of uncertainty should be routinely presented alongside the point estimate.
No comments:
Post a Comment