On the internal dynamics of the Shanghai ranking

Domingo Docampo, Lawrence Cram

    Research output: Contribution to journalArticleResearchpeer-review

    11 Downloads (Pure)

    Abstract

    The Academic Ranking of World Universities (ARWU) published by researchers at Shanghai Jiao Tong University has become a major source of information for university administrators, country officials, students and the public at large. Recent discoveries regarding its internal dynamics allow the inversion of published ARWU indicator scores to reconstruct raw scores for 500 world class universities. This paper explores raw scores in the ARWU and in other contests to contrast the dynamics of rankdriven and score-driven tables, and to explain why the ARWU ranking is a score-driven procedure. We show that the ARWU indicators constitute sub-scales of a single factor accounting for research performance, and provide an account of the system of gains and non-linearities used by ARWU. The paper discusses the non-linearities selected by ARWU, concluding that they are designed to represent the regressive character of indicators measuring research performance. We propose that the utility and usability of the ARWU could be greatly improved by replacing the unwanted dynamical effects of the annual re-scaling based on raw scores of the best performers.
    Original languageEnglish
    Pages (from-to)1347-1366
    Number of pages20
    JournalScientometrics
    Volume98
    Issue number2
    DOIs
    Publication statusPublished - Feb 2014

    Fingerprint

    ranking
    Students
    indicator research
    university ranking
    university
    scaling
    source of information
    performance
    student

    Cite this

    Docampo, Domingo ; Cram, Lawrence. / On the internal dynamics of the Shanghai ranking. In: Scientometrics. 2014 ; Vol. 98, No. 2. pp. 1347-1366.
    @article{be40076db4c544a29eb225cc3dbf3d82,
    title = "On the internal dynamics of the Shanghai ranking",
    abstract = "The Academic Ranking of World Universities (ARWU) published by researchers at Shanghai Jiao Tong University has become a major source of information for university administrators, country officials, students and the public at large. Recent discoveries regarding its internal dynamics allow the inversion of published ARWU indicator scores to reconstruct raw scores for 500 world class universities. This paper explores raw scores in the ARWU and in other contests to contrast the dynamics of rankdriven and score-driven tables, and to explain why the ARWU ranking is a score-driven procedure. We show that the ARWU indicators constitute sub-scales of a single factor accounting for research performance, and provide an account of the system of gains and non-linearities used by ARWU. The paper discusses the non-linearities selected by ARWU, concluding that they are designed to represent the regressive character of indicators measuring research performance. We propose that the utility and usability of the ARWU could be greatly improved by replacing the unwanted dynamical effects of the annual re-scaling based on raw scores of the best performers.",
    author = "Domingo Docampo and Lawrence Cram",
    year = "2014",
    month = "2",
    doi = "10.1007/s11192-013-1143-0",
    language = "English",
    volume = "98",
    pages = "1347--1366",
    journal = "Scientometrics",
    issn = "0138-9130",
    publisher = "Akademiai Kiado Rt.",
    number = "2",

    }

    On the internal dynamics of the Shanghai ranking. / Docampo, Domingo; Cram, Lawrence.

    In: Scientometrics, Vol. 98, No. 2, 02.2014, p. 1347-1366.

    Research output: Contribution to journalArticleResearchpeer-review

    TY - JOUR

    T1 - On the internal dynamics of the Shanghai ranking

    AU - Docampo, Domingo

    AU - Cram, Lawrence

    PY - 2014/2

    Y1 - 2014/2

    N2 - The Academic Ranking of World Universities (ARWU) published by researchers at Shanghai Jiao Tong University has become a major source of information for university administrators, country officials, students and the public at large. Recent discoveries regarding its internal dynamics allow the inversion of published ARWU indicator scores to reconstruct raw scores for 500 world class universities. This paper explores raw scores in the ARWU and in other contests to contrast the dynamics of rankdriven and score-driven tables, and to explain why the ARWU ranking is a score-driven procedure. We show that the ARWU indicators constitute sub-scales of a single factor accounting for research performance, and provide an account of the system of gains and non-linearities used by ARWU. The paper discusses the non-linearities selected by ARWU, concluding that they are designed to represent the regressive character of indicators measuring research performance. We propose that the utility and usability of the ARWU could be greatly improved by replacing the unwanted dynamical effects of the annual re-scaling based on raw scores of the best performers.

    AB - The Academic Ranking of World Universities (ARWU) published by researchers at Shanghai Jiao Tong University has become a major source of information for university administrators, country officials, students and the public at large. Recent discoveries regarding its internal dynamics allow the inversion of published ARWU indicator scores to reconstruct raw scores for 500 world class universities. This paper explores raw scores in the ARWU and in other contests to contrast the dynamics of rankdriven and score-driven tables, and to explain why the ARWU ranking is a score-driven procedure. We show that the ARWU indicators constitute sub-scales of a single factor accounting for research performance, and provide an account of the system of gains and non-linearities used by ARWU. The paper discusses the non-linearities selected by ARWU, concluding that they are designed to represent the regressive character of indicators measuring research performance. We propose that the utility and usability of the ARWU could be greatly improved by replacing the unwanted dynamical effects of the annual re-scaling based on raw scores of the best performers.

    U2 - 10.1007/s11192-013-1143-0

    DO - 10.1007/s11192-013-1143-0

    M3 - Article

    VL - 98

    SP - 1347

    EP - 1366

    JO - Scientometrics

    JF - Scientometrics

    SN - 0138-9130

    IS - 2

    ER -