Journal ranking

Journal ranking is widely used in academic circles in the evaluation of an academic journal's impact and quality. Journal rankings are intended to reflect the place of a journal within its field, the relative difficulty of being published in that journal, and the prestige associated with it. They have been recently introduced as official research evaluation tools in some countries such as Norway, Australia, France, and Denmark.[1][2]

Measures

Traditionally, journal ranking “measures” or evaluations have been provided simply through institutional lists established by academic leaders or through committee vote. These approaches have been notoriously politicized and inaccurate reflections of actual prestige and quality, as they would often reflect the biases and personal career objectives of those involved in ranking the journals; also causing the problem of highly disparate evaluations across institutions.[3][4] Consequently, many institutions have required external sources of evaluation of journal quality. The traditional approach here has been through surveys of leading academics in a given field, but this approach too has potential for bias, though not as profound as that seen with institution-generated lists[5] Consequently, governments, institutions, and leaders in scientometric research have turned to a litany of observed bibliometric measures on the journal-level that can be used as surrogates for quality and thus eliminate the need for subjective assessment[6]

Consequently, several journal-level metrics have been proposed, most citation-based:

PageRank algorithm

In 1976 a recursive impact factor that gives citations from journals with high impact greater weight than citations from low-impact journals was proposed.[14] Such a recursive impact factor resembles Google's PageRank algorithm, though the original Pinski and Narin paper uses a "trade balance" approach in which journals score highest when they are often cited but rarely cite other journals; several scholars have proposed related approaches.[15][16][17] In 2006, Johan Bollen, Marko A. Rodriguez, and Herbert Van de Sompel also proposed replacing impact factors with the PageRank algorithm.[18]

The Eigenfactor is another PageRank-type measure of journal influence,[19] with rankings freely available online, along with SCImago.[20]

National rankings

Several countries rank national and international journals, e.g.:

See also

References

  1. Pontille D., Torny D. , "The controversial policies of journal ratings: evaluating social sciences and humanities", Research Evaluation, 19(5), 347-360, 2010
  2. Danish Ministry of Higher Education and Science (2014)""
  3. Lowry, Paul Benjamin; Moody, Gregory D.; Gaskin, James; Galletta, Dennis F.; Humpherys, Sean; Barlow, Jordan B.; and Wilson, David W. (2013). Evaluating journal quality and the Association for Information Systems (AIS) Senior Scholars’ journal basket via bibliometric measures: Do expert journal assessments add value?,” MIS Quarterly (MISQ), vol. 37(4), 993–1012. Also, see YouTube video narrative of this paper at: http://www.youtube.com/watch?v=LZQIDkA-ke0&feature=youtu.be.
  4. Lowry, Paul Benjamin; Romans, Denton; and Curtis, Aaron (2004). "Global journal prestige and supporting disciplines: A scientometric study of information systems journals," Journal of the Association for Information Systems (JAIS), vol. 5(2), pp. 29–80 (http://aisel.aisnet.org/amcis2005/276)
  5. Lowry, Paul Benjamin; Romans, Denton; and Curtis, Aaron (2004). "Global journal prestige and supporting disciplines: A scientometric study of information systems journals," Journal of the Association for Information Systems (JAIS), vol. 5(2), pp. 29–80 (http://aisel.aisnet.org/amcis2005/276)
  6. Lowry, Paul Benjamin; Moody, Gregory D.; Gaskin, James; Galletta, Dennis F.; Humpherys, Sean; Barlow, Jordan B.; and Wilson, David W. (2013). “Evaluating journal quality and the Association for Information Systems (AIS) Senior Scholars’ journal basket via bibliometric measures: Do expert journal assessments add value?,” MIS Quarterly (MISQ), vol. 37(4), 993–1012. Also, see YouTube video narrative of this paper at: http://www.youtube.com/watch?v=LZQIDkA-ke0&feature=youtu.be.
  7. Serenko A., Dohan M. , "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence", Journal of Informetrics, 5(4), 629-648, 2011
  8. Holsapple, C.W., " A Publication Power Approach for identifying premier information systems journals", Journal of the American Society for Information Science and Technology, 59(2), 166-185, 2008
  9. Serenko, A., Jiao, C., "Investigating information systems research in Canada", Canadian Journal of Administrative Sciences, 29(1), 3-24, 2012
  10. Alhoori, Hamed; Furuta, Richard (2013). "Can Social Reference Management Systems Predict a Ranking of Scholarly Venues?" (PDF). Research and Advanced Technology for Digital Libraries. Lecture Notes in Computer Science 8092: 138–143. doi:10.1007/978-3-642-40501-3_14. ISBN 978-3-642-40500-6.
  11. Cornillier, F., Charles, V., "Measuring the attractiveness of academic journals: A direct influence aggregation model", Operations Research Letters, 43(2), 172–176, 2015
  12. "Elsevier Announces Enhanced Journal Metrics SNIP and SJR Now Available in Scopus". Press release. Elsevier. Retrieved 2014-07-27.
  13. Moed, Henk (2010). "Measuring contextual citation impact of scientific journals". Journal of Informetrics 4 (3): 256–27 7. doi:10.1016/j.joi.2010.01.002.
  14. Gabriel Pinski and Francis Narin (1976). "Citation influence for journal aggregates of scientific publications: Theory with application to literature of physics". Information Processing & Management 12 (5): 297–312. doi:10.1016/0306-4573(76)90048-0.
  15. S. J. Liebowitz and J. P. Palmer. (1984). "Assessing the relative impacts of economics journals" (PDF). Journal of Economic Literature (American Economic Association) 22 (1): 77–88. JSTOR 2725228.
  16. I. Palacios-Huerta and O. Volij (2004). "The Measurement of Intellectual Influence". Econometrica 72 (3): 963–977. doi:10.1111/j.1468-0262.2004.00519.x.
  17. Y. K. Kodrzycki and P. D. Yu (2006). "New Approaches to Ranking Economics Journals". B. E. Journal of Economics Analysis and Policy 5 (1). doi:10.2202/1538-0645.1520.
  18. Johan Bollen, Marko A. Rodriguez, and Herbert Van de Sompel.; Rodriguez; Van De Sompel (December 2006). "Journal Status". Scientometrics 69 (3): 1030. arXiv:cs.GL/0601030. Bibcode:2006cs........1030B. doi:10.1145/1255175.1255273. ISBN 9781595936448.
  19. C. T. Bergstrom. (May 2007). "Eigenfactor: Measuring the value and prestige of scholarly journals". College & Research Libraries News 68 (5).
  20. Jevin D. West. "eigenfactor.org". eigenfactor.org. Retrieved 2014-05-18.

External links

This article is issued from Wikipedia - version of the Tuesday, March 08, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.