EconBase
← All papers

The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice

Alexander M. Petersen, Felber Arroyave, Fabio Pammolli

arXiv 21 Jun 2024 · cs.DL · 5 citations (OpenAlex)

arXiv:2406.15311 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Measuring the rate of innovation in academia and industry is fundamental to monitoring the efficiency and competitiveness of the knowledge economy. To this end, a disruption index (CD) was recently developed and applied to publication and patent citation networks (Wu et al., Nature 2019; Park et al., Nature 2023). Here we show that CD systematically decreases over time due to secular growth in research and patent production, following two distinct mechanisms unrelated to innovation -- one behavioral and the other structural. Whereas the behavioral explanation reflects shifts associated with techno-social factors (e.g. self-citation practices), the structural explanation follows from `citation inflation' (CI), an inextricable feature of real citation networks attributable to increasing reference list lengths, which causes CD to systematically decrease. We demonstrate this causal link by way of mathematical deduction, computational simulation, multi-variate regression, and quasi-experimental comparison of the disruptiveness of PNAS versus PNAS Plus articles, which differ only in their lengths. Accordingly, we analyze CD data available in the SciSciNet database and find that disruptiveness incrementally increased from 2005-2015, and that the negative relationship between disruption and team-size is remarkably small in overall magnitude effect size, and shifts from negative to positive for team size $\geq$ 8 coauthors.

Citation extraction

35
references
152
in-text mentions
35
distinct cited
0
self-citations
11,389
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Park M, Leahey E, Funk RJ (2023) (2023) Papers and patents are becoming less disruptive over time1.000254100%
2Petersen AM, Arroyave F, Pammolli F (2023) (2023) The disruption index is biased by citation inflation1.000205100%
3Wu L, Wang D, Evans JA (2019) (2019) Large teams develop and small teams disrupt science and technology1.000135100%
4Pan RK, Petersen AM, Pammolli F, Fortunato S (2018) (2018) The memory of science: Inflation, myopia, and the knowledge network1.000115100%
5Holst V, Algaba A, Tori F, Wenmackers S, Ginis V (2024) (2024) Dataset artefacts are the hidden drivers of the declining disruptiveness in science1.000105100%
6Macher JT, Rutzer C, Weder R (2024) (2024) Is there a secular decline in disruptive patents? Correcting for measurement bias1.00085100%
7Lin Y, Frey CB, Wu L (2023) (2023) Remote collaboration fuses fewer breakthrough ideas1.00064100%
8Bentley RA, et al (2023) (2023) Is disruption decreasing, or is it accelerating?0.92843100%
9Lin Z, Yin Y, Liu L, Wang D (2023) (2023) SciSciNet: A large-scale open data lake for the science of science research0.87482100%
10Schekman R (2010) (2010) Creating a new option for online-only research articles: PNAS Plus0.84333100%

Showing the top 10 of 35 scored citations.