 Research
 Open access
 Published:
Fractal dimension analogous scaleinvariant derivative of Hirsch’s index
Applied Network Science volume 7, Article number: 5 (2022)
Abstract
We propose a scaleinvariant derivative of the hindex as “hdimension”, which is analogous to the fractal dimension of the hindex for institutional performance analysis. The design of hdimension comes from the selfsimilar characteristics of the citation structure. We applied this hdimension to data of 134 Japanese national universities and research institutes, and found wellperforming mediumsized research institutes, where we identified multiple organizations related to natural disasters. This result is reasonable considering that Japan is frequently hit by earthquakes, typhoons, volcanoes and other natural disasters. However, these characteristic institutes are screened by larger universities if we depend on the existing hindex. The scaleinvariant property of the proposed method helps to understand the nature of academic activities, which must promote fair and objective evaluation of research activities to maximize intellectual, and eventually economic opportunity.
Introduction
Citation structure of scientific literature is a major subject of the study of science policy and complex systems. Not only its graphtheoretic structure constitutes a valuable topic, but also its application has a significant impact on society.
The importance of citation structure comes from the fact that citing defines the flow of knowledge. The cited literature contributes to overcoming the intellectual limit of humans by supporting the following researches through the flow of knowledge. Therefore, studying the flow and diffusion of knowledge will allow us

1.
to evaluate the contribution of scientific activity and,

2.
to identify the knowledge flow to forecast the future of scientific research.
Moreover, because the flow of knowledge is a major principle of intellectual production, it also constitutes a prominent driving force of the “Knowledgebased economy” (see OECD 1996), where production, diffusion, distribution and transmission of knowledge is the key to the economic productivity.
In this study, we propose a derivative of J. E. Hirsch’s index (Hirsch 2005) as hdimension, which is analogous to the fractal dimension of Hirsch’s index (hindex hereafter) and has a property of being datasize invariant. hdimension is developed as an institutional index, and it is not for individual researchers.
The authors, who are affiliated to Council for Science, Technology and Innovation (CSTI for short), a department of Japan Cabinet Office, are in charge of establishing evidencebased policy making (EBPM for short) by analyzing human and monetary resource investment, academic output and economic and social outcome. Such analysis is to be integrated to a data analysis platform system as “eCSTI”, which is now partially available to the general public as https://ecsti.go.jp/en. The purpose of this system is to analyze/evaluate governmental policy and act, and it is not to be used for judging or resource allocation of individual institutes or researchers.
In Japan there are more than 100 national universities and research institutes. These organizations have divergent research activities both in their scale and topics. Within the data set of this study there are approximately 1.0e+04 times of difference in the number of articles. The research topics are also highly diversified: major national universities’ research fields are uniformly distributed from mathematics to human studies, but there are institutes specialized in a particular topic such as particle physics, medical science of a specific part of the human body, or genetics.
Among various methods and indices related to citation analysis, hindex proposed in Hirsch (2005) has an advantage in detecting stochastic features of citation data with robustness. Ever since, multiple variations of hindex are created to meet different objectives and data variations. Alonso et al. (2009) is a comprehensive review of such early works, where various applications of the original index and the derivatives are acquainted. Among more recent works based on the hindex is Amane Koizumi’s h5index (Koizumi 2018), which is gathering attention recently (see https://www.elsevier.com/__data/assets/pdf_file/0020/53327/ELSV13013ElsevierResearchMetricsBookr12WEB.pdf, page 40). h5index was developed to measure institutional performance by setting a timewindow of five years (hence the name “h5”). To be precise, let X(t) be the set of articles produced by some organization from its founding up to some year t, then h5index is defined as the hindex calculated on the article set \(X(t)  X(t5)\) provided that \(t \ge 5\). The definition of hindex is given in “Selfsimilarity of citation and hdimension” section. h5index is always associated with a particular interval of five years, for example, from 2014 to 2018, and it can be any five years if adequate data is available. Koizumi’s work also directly inspired this study.
Still, we see difficulties in using hindex (or h5index) for institutional performance evaluation because these indices are heavily correlated to the number of articles on which the indices are defined. It means we cannot compare institutes with a different number of researchers. Another difficulty comes from the fact that the network of citation acquires vertices and links along with time, and each researchers organization has their own stage of development.
Selfsimilarity or fractallike property is almost a universal concept to analyze and understand complex structures. We consider this concept as a primary principle to analyze citation networks. We developed our version of hindex derivative hdimension, or \(h_d\) to take advantage of this property. As a result the index is necessarily scaleinvariant to bring fair and accurate institutional evaluation.
There is substantial criticism on the evaluation of individual researcher based on hindex. In Koltun and Hafner (2021), declining effectiveness of the scientometric measures is reported, that correlation of hindex with scientific awards has dropped due to the changing authorship patterns. In Waltman (2016), it is claimed that productivity over expenditure, or achievement per budget is the key factor to be evaluated, and all the scientometric index which does not consider monetary cost is meaningless or harmful. In Waltman and van Eck (2012), it is claimed that hindex is prone to noise, which makes the index to lose the orderpreserving property and consistency.
However, because this study is strictly institutionoriented, we consider such criticism is not very relevant. Moreover, we believe that a set of academic articles which are richly linked by citation is more valuable than disconnected one, and creating such knowledge circulating system is an important mission of research institutions.
The present study is constructed as follows: in “Selfsimilarity of citation and hdimension” section, we will examine the structural characteristics, in particular statistical selfsimilarity of citation. This examination leads us to the fractal dimension of hindex as hdimension, or \(h_d\). In “hdimension and its implication” section we will apply the proposed index \(h_d\) to the prepared data to study the properties and implications of the proposed index. By referring to \(h_d\), we found wellperforming mediumsized institutes, which are obscured by larger organizations if we depend on the original hindex. We also check the effect of the research field on \(h_d\), to find out that it is not heavily affected by the research field selection. In “Conclusion and future work” section we will summarize this study and discuss the future work.
Selfsimilarity of citation and hdimension
In this section, we propose “hdimension”, a scaleinvariant derivative of the hindex, by considering the selfsimilar characteristics of the citation network. It is analogous to the socalled fractal dimension of the hindex, hence it is named as such.
As we briefly discussed in “Introduction” section, the citation network represents the propagation of knowledge, which means understanding structural characteristics of the citation network will give us insight into the flow of knowledge. For the purpose of structural discussion, we begin with formulating the citation network.
Let \(X=\{u, v, \ldots \}\) be a set of articles we are concerned, and \(E=\{(u, v), (u, w), \ldots \}\) be a set of citation relations between the elements of X; i.e., \((u, v) \in E\) implies \((v, u) \notin E\) because citation is asymmetric. Let us note that a citation relation (u, v) means the article u is cited by the article v. The pair of sets (X, E) defines the “citation network” as an acyclic directed graph. Let c be a function from X to Z,the set of natural numbers, as \(c(u) = \{v (u, v) \in E\}\); function c counts how many times u is cited, or indegree of the vertex u.
Let D be a distribution function in general. For simplicity, let D(b) be the possibility to be \(x<b\) provided that x is a probabilistic variable on which D is defined.
hindex h is defined as follows; let U(x) be a subset of X such that all the members of U(x) has x or more incoming links, then
Equation 1 can be written more simply by using empirical distribution function D as follows; let \(n=X\), the number of articles, and \({\mathbb {D}}\) be a setvalued function as \({\mathbb {D}}(x)=\{u\ u \le nD(x)\}\). Then h can be written as
Note that Eq. 2 describes the hindex as a fixed point based on an empirical distribution function, and this fact directly yields an effective hindex calculation algorithm deployed in this study, which is described in “Appendix” with a sample code.
Let H be the subset of X which defines hindex, namely,
The citation network evolves with time by adding a new article to the network. Therefore, it is natural to identify the increment of n, the size of the data, or E with ongoing time t, which is a common approach to model how a citation network (or other reallife complex network) is built (see Price 1976 or Barabasi and Albert 1999 for example).
Each research institute or university has its own history. An older institute is likely to have a larger set of articles if the researchers’ number is similar. On the other hand, the expectation of the hindex of a larger set of articles is larger if the citation distribution is the same^{Footnote 1}
The median of personal hindex of the researchers who are affiliated to the institute is a good candidate for the purpose of institutional performance measurement. However, the median is not available because there is a significant number of researchrelated people who never appear as the author of the academic papers. The proposed index of this study has the advantage that it only depends on the academic paper database.
Therefore, a simple comparison of hindices of different institutes’ data may only mean that one data has more articles, which means raw hindex is inadequate for institutional evaluation. Actually, the same difficulty exists in the case of personal hindex, which is addressed in the original paper of Hirsch (2005) by denominating the raw index value by the years of being an active researcher.
h5index, which sets a fixed length of five years window to collect the data, overcomes this difficulty by taking a snapshot of uniformly controlled exposure. Despite this improvement, we still have the following concern about the growth of the citation network.
A research institute goes through its own process of development. Newly established institute N is in its early stage, while another institute M is in its mature stage. Suppose if these two institutes share a similar index value. If we are to conclude that N and M achieved similar performance based on this index, the conclusion has very limited significance because N is doing better. Comparison between cases with similar stages of development can be meaningful; otherwise, we are uncertain despite the controlled observation window.
Figure 1 is a visualization of an artificially created acyclic directed graph with similar indegree distribution of typical citation network. The layout is configured to place cited article below its citing article. Because the citing article necessarily comes after the cited one, the network “grows” upwards like a tree grows to the sky.
Inside Fig. 1, we can identify a subnetwork by selecting all the nodes that refer to “B” directly or indirectly. This subnetwork is similar to the original network (which is the articles that cites “A” directly or indirectly) in the sense that they share statistical properties, for example, the degree distribution. Benoit Mandelbrot refers to this property as statistical selfsimilarity in his book (Mandelbrot 1977), Chapter XII, p. 276.
In fact, the fractallike property of the complex network has been gathering attention (for example Song et al. 2005; CorominasMurtra et al. 2013 or Zhao et al. 2006). Hierarchical characteristics of acyclic network is sometimes called “rank” structure from the fact that it is often embedded in a onedimensional ordered space (see Newman 2018 14.7, p. 564).
The hindex defining set H of Eq. 3 and their associated links \(E_H\) also defines a subgraph \((H, E_H)\), which occupies the lower part of Fig. 1 . The indegree distribution \(D_H\) of this subgraph is obtained from the original distribution function D as \(D_H(u)=\frac{D(u)}{D(h)}\) provided that h is the hindex value of the whole citation network and \(u \ge h\). Therefore, the subgraph \((H, E_H)\) shares degree distribution with the original network (X, E) except that it lacks the longtail, or lower degree part of the distribution.
Obviously, the empirical data necessarily have finite steps of similarity, i.e. we cannot go down to statistically similar subnetworks infinitely. In other words, the level of detail of the observed network is limited. Due to this selfsimilarity and nature of citation relation, adding a new node (or growth of the network) also means adding detail to the network.
If the subnetwork H converges to a stationary state when \(t \rightarrow \infty\), such a terminal state should consist of a fair evaluation foundation indifferent to data scale or the institute’s history. However, it is unlikely that such a stationary state exists because of the statistical selfsimilarity of the citation structure.^{Footnote 2} It means infinitely detailed observation leads to infinitely larger observed value, which makes comparison impossible. This difficulty is analogous to the measurement of coast line length, which famously diverges to infinity as the mesh of the survey becomes smaller for more detailed measurement. (see Mandelbrot 1977, chapter 2).
Fortunately, we already know how to treat a measurement of selfsimilar structure that diverges with the observation scale, which is the fractal dimension.
According to this knowledge, we propose hdimension \(h_d\) as follows:
where h is the hindex (or h5index) value, which is the objective measurement, and s is the size of the network, which is the inverse of the scale of observation. The number of articles can not be used as s because it only counts the vertices which have incoming links. In practice, s can be obtained as the sum of the citation counts \(\sum _{u\in X} c(u)\).
hdimension and its implication
In this section, we examine the properties and implications of \(h_d\). In the first subsection, we describe the preparation process of the data. In “Application and examination of hdimension” section we apply the proposed index \(h_d\) to the collected data and analyze the theoretical and empirical properties of \(h_d\). We will check if it is scaleinvariant. In “Research field and hdimension” section we will examine the effect of the research field selection on \(h_d\), and give some intuitive understanding of the proposed index through statistical analysis. In “Adversary strategy against hdimension” section, we will examine \(h_d\) from the “opposite side of the game” and try to construct the strategies to deceive the index.
Data preparation
We used a bibliometric dataset for research articles published in 20142018 from national university corporations, national research and developments agencies and interuniversity research institute corporations in Japan. As a starting point for data collection, a list of institutional identifiers was prepared by using a global research identifier database (DataScience I 2019). As a consequence, 134 GRID (Global Research Identifier Database) ids were obtained including all 86 national university corporations in Japan. We used the Dimensions analytics API (https://docs.dimensions.ai/dsl/) as the platform, which permits us to extract fundamental bibliometric data on a research institute for a given period related to a specific research field by a simple query. The query language is not very different from a common SQL with some extensions.
Since we could extract up to a maximum of 1,000 results only, it is necessary to add the operator, skip, followed by the offset, if we like to obtain all the data when the total count of the result is over 1,000. This iteration to give the offset could be done up to a maximum of 50,000 results. No queries for a specific research institute and the research field gave results of more than 50,000. Therefore, by iterating such queries for 134 research institutes and 22 research fields, we successfully collected the dataset for further analysis.
The number of citations for each article is as of 14 March 2020 in Dimensions, when we collected all the data. The dataset of this study consists of citation counts of 550,602 papers. To measure h5index for each research institute, a set of unique publication ids over all research fields and their number of citations was used. Then h5index was measured according to the definition given by Hirsch (2005), using the algorithm addressed in “Appendix”. Technically, the only difference between the h5index and hindex is that we used research articles for 5 years from 2014 to 2018 in order to measure the recent activities for a research institute instead of the whole activities.
Application and examination of hdimension
Figure 2 shows 134 institutes’ hindex (h5index) values and their number of institutional articles in a loglog plot. It is clearly seen that the h5index and the number of articles shows a strong positive correlation, whose coefficient is 0.85. Figure 2 also empirically denies the existence of the stationary terminal state of the hindex defining subnetwork H, which is discussed at the end of “Selfsimilarity of citation and hdimension” section.
Figure 3 shows \(h_d\) versus the number of articles plot, where we can see that the scaledependence problem of the hindex is mostly resolved. The result has a smaller correlation coefficient of +0.07 with the number of articles.
Thanks to this improvement, we could find wellperforming mediumsized organizations with the number of institutional articles from several hundred to ten thousand. Among these organizations we could identify several research institutes focused on natural disasters, as shown in red “x” in Figs. 2 and 3. There are several institutions that marked even better than disasterrelated organizations, to which we do not refer any further to avoid making them identified.
This result is reasonably understood because Japan is frequently hit by various natural disasters, like typhoons and earthquakes. In contrast, these characteristic leading institutes are overshadowed by larger organizations in Fig. 2. It is evidently seen that the proposed index is useful to evaluate institutional performance by a relatively simple calculation.
However, we cannot easily conclude that the result of Fig. 3 is actually representing institutional performance. The organizations in the data have different research fields, which are known to have different citation conventions.
In the following part, we will show that the proposed index \(h_d\) is robust to the research field configuration difference. This is due to the scaleinvariant design of \(h_d\) and property of the original hindex to select an essential part of the data.
Research field and hdimension
In general, research field is a major factor of the outcome of citation, for example in Qian et al. (2017) it is shown that even the subfields within computer science have significant effect on the citation rates. Various fieldnormalized bibliometric methods are devised and utilized to compensate such variation for the purpose of fair and accurate evaluation (see Ahlgren and Sjögårde 2015; Bornmann and Haunschild 2016; Reddy et al. 2020).
To begin with, we estimate the effect of the research field selection on \(h_d\). The value of hindex is defined by the distribution of citation as described in Eq. 2. The data we are analyzing actually has a joint distribution of the research institutes, research fields, and citation count. Here we define three probabilistic variables as follows: let the research fields be F, institutes G, and citation C. Let P(X) be the probability that a statement X is true, namely, \(P(F=f, G=g, C=c)\) denotes probability of \(F=f, G=g \text {, and } C=c\) for some research field f, institute g, and citation value c.
Then the distribution function D(h) of Eq. 2 can be written as the marginalization of the original data: \(D(h) = \sum _{G} \sum _{F} P(F, G, C < h)\). The research field distribution of some institute \(g_i\) can be written as \(\sum _{C} P(F, G=g_i, C)\). To see the effect of research field difference, we must obtain citation distribution which is independent of particular institute \(g_i\). This can be performed by calculating
of the data. Aggregated term of Eq. 5 is a conditional distribution of research field f multiplied by the proportion of the field f of the research institute \(g_i\). Note that Eq. 5 uses distribution of all the articles that belong to research field f, and not the observed distribution of particular institute \(g_i\). Adding this term over research fields will give randomly controlled citation distribution under the condition of research field selection of particular institute \(g_i\).
Figure 4 is a scatter plot of \(h_d\) of randomly controlled data of Eq. 5 (the horizontal axis) and corresponding institute’s observed \(h_d\) value. In practice, the control is obtained by averaging 200 runs of the randomly selected results. The plot shows weak positive correlation between the controlled expectation and observed value, which is represented by the green segment. However, the residual reached nearly 90 percent of the observed variance. We also checked Kendall’s rank correlation coefficient between the controlled expectation and the data, which was 0.2. In summary, only 10 to 20 percent of the institutional \(h_d\) variation is explained by research field selection. Much of the \(h_d\) variation comes from outside of the research field selection.
We will further analyze how this almost researchfield invariant property of \(h_d\) is realized. Table 1 is a list of researchfield wise values of the number of articles, mean citation, h5index, and hdimension from the prepared data as described in “Data preparation” section.
We can see that mean citations in the 3rd (“Mean”) column and h5index in the 4th column have great variation. Also, these two indices have a strong positive correlation with the size of the data.
In contrast, the proposed index \(h_d\) listed in the far right column of Table 1 shows nearly constant values.
As we discussed in “Selfsimilarity of citation and hdimension” section, the original hindex expectation is a monotonically increasing function of the number of articles. Therefore, the positive correlation of hindex to the number of articles in Table 1 is natural.
However, as for \(h_d\), which is scaleinvariant by its design, is not guaranteed to yield uniform values because different research field may have different citation distribution.
In Fig. 5, we can see that each research field shows approximate powerlaw distribution above its hindex value^{Footnote 3}. Although these distributions have difference in their fewer times cited part, the hindex defining part have very similar distributions with each other. We will see this relation in more detail with simple analytic calculation and empirical check as follows:
The \(h_d\) definition of Eq. 4 can be transformed to \(h=s^{h_d}\), where \(h_d\) serves as the exponent over the inverse of the observation scale s. Then, \(s = n \frac{a}{a1}\) because the expectation of powerlaw distribution with exponent a is \(\frac{a}{a1}\). This is not valid in the overall distribution of citation data, but it holds above the hindex defining point.
Consequently it holds that
for a constant \(k = {\frac{a}{a1}}^{h_d}\).
By substituting D(x) of Eq. 2 with \(bx^{a}\), where b is a constant for normalization to be compatible with the probability distribution, we obtain \(h = nbh^{a}\), which is transformed to
Equation 7 is not a new result, and already described in PRATELLI et al. (2012). From Eqs. 6 and 7 we have \(n^{\frac{1}{a+1}} \sim kn^{h_d}\). Therefore
is obtained.
To confirm the relation between \(h_d\) and powerlaw exponent of Eq. 8, we estimated the powerlaw exponent value of 134 data sets by applying Hill’s estimator (Hill 1975) and compare them with \(h_d\).
The estimation result is shown in Fig. 6, where we can see its mode is approximately \(a=1.2\). Alternatively, we estimate the powerlaw exponent by way of the hindex. Compare Eq. 7 with the fit function of Fig. 2 as \(0.47=\frac{1}{a+1}\), which gives \(a=1.14\). Two different estimates meet quite well.
However, it should be noted that the exponent of the powerlaw distribution and \(h_d\) are based on totally different principles. The powerlaw exponent is a result of fitting a particular function to the observed data. \(h_d\), on the other hand, is based on nonparametric statistics of hindex and fractal.
In summary, \(h_d\) of the research fields are stable because all the research fields share very similar distributions above the hindex defining values, which we can see in Fig. 5.
Following the definition of \(h_d\) and selfsimilar characteristics of citation network, we can infer that a network generated by unifying multiple statistically similar networks (which means these two networks share the same \(h_d\) values) will also yield the same \(h_d\) value. This is consistent with the fact that the original networks are statistically similar subgraphs of the newly generated network. In other words, \(h_d\) is invariant to the operation of identically distributed data set unification.
As a result, we can claim that the difference in research field selection has limited effect on the institutional \(h_d\), which means most of the \(h_d\) variation is not originated from their research fields.
If we stay in the realm of selfsimilar citation structure, Eq. 8 will give us a rough idea of what \(h_d\) is trying to measure. High \(h_d\), or small exponent of powerlaw distribution implies that there is an active and effective knowledge production process which provides readily available knowledge with quality and quantity to create new knowledge. In terms of citation structure, it is a richly connected network.
A pair of artificially constructed acyclic directed graphs with the same number of vertices and different \(h_d\) values are visualized inFig. 7. The left (lower \(h_d\) valued) graph consists of several communities which are sparsely connected with each other, and the higher \(h_d\) graph is more tightly connected. If these two graphs represent citation relations, the higher \(h_d\) graph seems to have more foundational research activities shared among the researches than the lower \(h_d\) valued one.
Adversary strategy against hdimension
In this subsection we will discuss the property of \(h_d\) by trying to conceive a workaround path to gain the index.
Following the Eq. 4, hdimension is defined as
Therefore, the basic heuristics of the strategy is

1.
to gain the hindex value, and

2.
to keep the sum of citations small.
For a given citation sum C, the largest possible hindex is the integer part of \(\sqrt{C}\). Thus, hdimension has a range of \(0\le h_d \le 0.5\).
The network with its maximum \(h_d\) value has a unique degree distribution. Suppose the hindex defining set has h vertices, then all of these vertices have indegree of h, and no other vertex has indegree. Let us refer to the network that has hdimension of 0.5 as “\(h_d\)optimized”.
In a naturally grown citation structure, when an article is cited it becomes more likely to be found and cited by other researchers. But in order to reach the \(h_d\)optimized status, natural citation mechanism have to be stopped in order to avoid citation beyond the targeted hindex value, because any citation that does not contribute to the hindex brings down hdimension.
Another way to gain \(h_d\) is to decrease the denominator while keeping the nominator of Eq. 9 by eliminating articles which does not contribute institutional hindex. This is unlikely to be implemented because all the newly published articles have no citations.
These two bypass strategies are naive, and much more sophisticated workaround will be devised eventually. But for the time being, we consider that \(h_d\) is not particularly easy to workaround if we stay in the world of selfsimilarity.
Conclusion and future work
We proposed an index hdimension, or \(h_d\) as a derivative of the hindex which is analogous to the fractal dimension of the original hindex. Unlike the original hindex, not only \(h_d\) is invariant to the number of articles by its design, it is also robust to the difference of research fields, if not completely independent.
Due to the selfsimilar property of the citation network structure, hindex is strongly and positively correlated to the number of articles, which gains its size as the time goes on. Most of the difficulties in comparing research organizations comes from this fractal property, and we already have an excellent tool to analyze this problem as “fractal dimension”, which was named as such by the famous researcher Benoit Mandelbrot. \(h_d\) is defined as the fractal dimension of hindex.
We prepared a citation data set of 134 Japanese national universities, national research and developments agencies and interuniversity research institutes from the year 2014 to 2018 by using Dimensions analytics API of DigitalScience, Inc., and applied \(h_d\) to the data. We could find several mediumsized research institutes that performs excellently by virtue of scaleinvariant property of \(h_d\), where we could identify multiple organizations focused on natural disaster, which is a reasonable result considering the natural environment of Japan. These characteristic institutes are obscured by major organizations if we depend on the conventional hindex.
We carried out several analysis from various angles on the properties of \(h_d\). We examined the effect of research field on \(h_d\) value, to find out that the original hindex (therefore \(h_d\) as well) is closely related to the exponent of powerlaw distribution, which is quite similar among research fields above their hindex values. This is the reason why \(h_d\) is quite robust against difference in the research field. This property can practically exclude the effect of research field difference from institutional \(h_d\) values.
We also examined how visually different a graph with higher \(h_d\) is from a lower one, to find out that lower \(h_d\) graph is separated into multiple loosely interconnected communities. In order to understand the behavior of \(h_d\) from a different point of view, we also tried to “attack” \(h_d\) and gain the value without following the supposed citation structure growth procedure, to find out that the mechanism behind selfsimilarity of citation structure is natural and hard to destroy.
International comparison of research organizations based on \(h_d\) must be an interesting research topic. The contraposition of the discovery of mediumsized institutes also constitutes a future investigation theme, i.e., the reason why the organizations which produced more than 1.0e+04 articles achieved consistently low \(h_d\) values.
Although single measure can never be the final solution to achieve fair and accurate institutional evaluation, we believe the hdimension can help making good strategic decision to maximize intellectual or economic opportunity. We hope that the network study based on the principle of fractal to become even more active, and if this study could encourage it, the authors could not be more delighted.
Availability of data and materials
The data used in this study is an exclusive property of the data service providing company.
Code availability
Reference implementation of the algorithm is available as the “Appendix”, as well as in the corresponding author’s Github repository: https://github.com/fjt/optimium/blob/master/stat.rb.
Notes
Statistically similar subnetwork keeps to grow along with the whole network unless the similarity is broken at some point. In fact, in Fig. 2 of “hdimension and its implication” section, we will see that the stationary terminal state existence is empirically denied.
hindex is at the crossingpoint of the diagonal straight line and cumulative distribution curve.
Regardless of the distribution of the data because the rank is always uniformly distributed.
Abbreviations
 hindex:

A widely recognized and utilized bibliometric index developed by J. E. Hirsch. See (Hirsch 2005)
 h5index:

A derivative of the hindex defined on the bibliometric data of fiveyears of interval
 hdimension:

A fractal dimension of the h5index or hindex, denoted by h_{d}. The main proposal of this study
 EBPM:

EvidenceBased Policy Making
 CSTI:

Council for Science, Technology and Innovation, which is a department of Japan Cabinet Office
 eCSTI:

An EBPM system of science policy of Japanese government and related organizations, developed by CSTI
References
Ahlgren P, Sjögårde P (2015) Formal definitions of field normalized citation indicators and their implementation at kth royal institute of technology http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva267026
Alonso S, Cabrerizo FJ, HerreraViedma E, Herrera F (2009) hindex: a review focused in its variants, computation and standardization for different scientific fields. J Informetr 4(3):273–289
Barabasi A, Albert R (1999) Emergence of scaling in random networks. Science 286(15):509–512
Bornmann L, Haunschild R (2016) Citation score normalized by cited references (csncr): the introduction of a new citation impact indicator. J Informetr 10(3):875–887. https://doi.org/10.1016/j.joi.2016.07.002
CorominasMurtra B, Goñi J, Solé RV, RodríguezCaso C (2013) On the origins of hierarchy in complex networks. Proc Natl Acad Sci 110(33):13316–13321. https://doi.org/10.1073/pnas.1300832110
DataScience I (2019) The thirtythird public release of grid. https://doi.org/10.6084/m9.figshare.8137970
Dimensions.API.document.team (2020) The official documentation of the dimensions search languages. https://docs.dimensions.ai/dsl/
Elsevier (2019) Research metrics guidebook. https://www.elsevier.com/__data/assets/pdf_file/0020/53327/ELSV13013ElsevierResearchMetricsBookr12WEB.pdf
Hill BM (1975) A simple general approach to the inference about the tail of a distribution. Ann Stat 3:1163–1174. https://doi.org/10.1214/aos/1176343247
Hirsch JE (2005) An index to quantify an individual’s scientific research output. PNAS. https://doi.org/10.1073/pnas.0507655102
Hoare CAR (1961) Algorithm 65: find. Commun ACM 4(7):321–322. https://doi.org/10.1145/366622.366647
Koizumi A (2018) Kenkyuuryokunohakarikata (in Japanese). Gakujutsunodoukou (in Japanese) 23(12):64–67. https://doi.org/10.5363/tits.23.12_64
Koltun V, Hafner D (2021) The hindex is no longer an effective correlate of scientific reputation. PLoS ONE 16(6):e0253397. https://doi.org/10.1371/journal.pone.0253397
Mandelbrot B (1977) Fractals: form, chance and dimension. W H Freeman and Co
Newman M (2018) Networks Oxford. https://doi.org/10.1093/oso/9780198805090.001.0001
OECD (1996) The knowledgebased economy
Pratelli L, Baccini A, Barabesi L, Marcheselli M (2012) Statistical analysis of the Hirsch index. Scand J Stat 39(4):681–694
Press WH, Teukolski SA, Vetterling WT, Flannery BP (2007) Numerical recipes. Cambridge University Press, Cambridge
Price DDS (1976) A general theory of bibliometric and other cumulative advantage processes. J Am Soc Inf Sci. https://doi.org/10.1002/asi.4630270505
Qian Y, Rong W, Jiang N, Tang J, Xiong Z (2017) Citation regression analysis of computer science publications in different ranking categories and subfields. Scientometrics. https://doi.org/10.1007/s1119201622354
Reddy V, Gupta A, White MD, Gupta R, Agarwal P, Prabhu A, Lieber B, Chang YF, Agarwal N (2020) Assessment of the NIHsupported relative citation ratio as a measure of research productivity among 1687 academic neurological surgeons. J Neurosurg 31:1–8. https://doi.org/10.3171/2019.11.JNS192679
Song C, Havlin S, Makse HA (2005) Selfsimilarity of complex networks. Nature. https://doi.org/10.1038/nature03248
Waltman L (2016) Special section on sizeindependent indicators in citation analysis. J Informetr 10(2):645. https://doi.org/10.1016/j.joi.2016.04.001
Waltman L, van Eck NJ (2012) The inconsistency of the hindex. J Am Soc Inf Sci Technol. https://doi.org/10.1002/asi.21678
Zhao J, Yu H, Luo JH, Cao ZW, Li YX (2006) Hierarchical modularity of nested bowties in metabolic networks. BMC Bioinform 7:1–16
Acknowledgements
The authors thank Prof. Amane Koizumi of National Institutes of Natural Sciences, Japan for his kind advice, exact and comprehensive explanation of bibliometrics, especially hindex. The authors also thank Prof. Takahiro Ueyama, fulltime executive member of the CSTI of the Cabinet Office for initiating and promoting of the overall project, invaluable advice and discussion for this study. The authors also thank Mr. Iwao Miyamoto, former director of the Cabinet Office for his direction and management of the overall project, as well as useful discussion and helpful advice for this study. The authors also thank Mr. Toshihiro Shirai, director of the Cabinet Office for his direction and management of the overall project, as well as for the help to publish this study. The authors also thank Professor Naoshiro Shichjo of Graduate Institute for Policy Studies for his effort for the arrangement of additional data acquisition and invaluable advises. The authors also thank Mr. Hiroyuki Sano of mixi, Inc. for preparing additional data and its processing. The authors also thank Professor Miki Haseyama, Mr. Teruo Nishioka, Professor Toshiaki Fujii, Professor Shingo Ebata, Professor Atsushi Kaneda, Dr. Ryoichi Kawada, Mr. Shinsuke Kawachi, Dr. Satoshi Nishiyama, Professor Manami Matsubayashi, Ms. Yoko Inoue, Ms. Minako Ikehata, Mr. Takuya Iwasaki, Mr. Yukio Iwasa, Mr. Yasuhiro Yamaguchi, Mr. Yasuhiro Kubo, Dr. Shinichi Akaike, Mr. Hideyuki Maiwa, Mr. Tomonao Takamatsu, Mr. Hajime Aasano, Mr. Teruki Mita, Dr. Toru Shinohara, Dr. Hideo Arimoto, Mr. Toru Sasabayashi, Mr. Akira Sanagi, Mr. Hiroshi Okumura, Professor Takashi Ishida, Mr. Masato Mizuno for their encouragement and support for this study. Data sourced from Dimensions, an interlinked research information system provided by Digital Science (https://www.dimensions.ai). Data licensed to Japan Cabinet Office as part of the eCSTI project.
Funding
This study was conducted as a part of regular assignment of the Cabinet Office of the Japanese government. The academic paper data set is acquired by the Japanese government’s funding to the Cabinet Office for eCSTI development.
Author information
Authors and Affiliations
Contributions
YF is responsible for the design and implementation of the analysis and index calculation algorithm. NU is responsible for the design and implementation of the analysis and data collection. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors have no known competing interests with the data source, results and the outcome of this study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Here we describe our effective hindex calculation algorithm which is used throughout this study for quick and repeated analysis trials. It is expected to work in O(n) of time to the input size of n.
Typical straight process to obtain hindex from observed data set X is as follows: sort the data X in descending order as \((x_0, \ldots , x_n)\). Then find the first element whose value is less than or equal with its rank, that is, find the first x such that \(x_h \le h\). Here the rank h of such \(x_h\) is the value to be obtained. We will refer to this process as “sorting method” hereafter.
The major part of computational cost of sorting method exists in sorting the data set X, which is expected to be \(O(n \log (n))\)).
Advantage of the sorting method is that it is reasonably fast and straightforward. The problem is the ineffectiveness. Sorting of hth element beyond is not necessary. Actually, first h elements have no need to be sorted either.
The algorithm described here is a direct consequence from the fact that hindex is a fixed point of empirical distribution function, which is formulated as Eq. 2 of “Selfsimilarity of citation and hdimension” section.
Figure 8 illustrates the outline of how the proposed algorithm works. The value to be calculated rests on the crossing point of diagonal green line and the empirical distribution function (purple). To find out the point, we start from a randomly selected value \(P_0\) from the whole data, and repeat the following process: Randomly select \(P_i\) from a data segment \(I_{i1}\). If \(P_i\) has larger (or smaller) rank than \(P_i\) itself, the fixed point is in the segment above (or below) \(P_i\), which is set as \(I_{i}\) and repeat this process to eventually reach the fixed point of Eq. 2.
However, from Fig. 8, it may seem that the algorithm requires totally sorted data. Therefore we will give a nonvisual description in the following part of this section.
In the context of information science, proposed algorithm is a derivative of an algorithm commonly referred to as “quickselect”, which outputs \(k\)th largest (or smallest) element from given data of size n in average computational time of O(n). Quickselect itself is a variation of quicksort, both were developed by the same person C. Hoare (published in 1961 as Hoare 1961). Quickselect works on the given rank k, which is not known when hindex is to be calculated.

1.
The algorithm takes two arguments, the data array to be processed and additional numeral, which is to keep the temporary value of the index while processing. It is initialized as 0.

2.
Create two empty arrays as upper and lower. Create a numeral eq as 0.

3.
Pickup a single element from the data as pivot, compare it with each of the data’s elements. If \(pivot < element\), push the element into the upper array. If \(pivot > element\), put it to lower. If \(pivot = element\), increment eq by one and discard the element.

4.
If \(upper.length + count  pivot\) is equal to 0 or 1, return pivot and exit. This is the BINGO situation.

5.
Otherwise, if \(upper.length + count > pivot\), the hindex should be found in upper. Consequently, return to step1 with the argument data as upper and the numeral argument count is unchanged.

6.
Otherwise, the hindex should be found in lower. Therefore starts from step 1 with new data as lower . As \(eq + upper.length\) elements were found above lower, the numeral argument must be incremented to \(count + eq + upper.length\).
Each time we go back to the beginning of the algorithm, the data to be processed is expected to be half the size^{Footnote 4}. Consequently, comparison and data separation operations will be executed
times in total.
Figure 9 shows plot of performance measurement, in which the processing time of the proposed algorithm shows linear response to the input size, as expected from Eq. 10. In comparison, sorting method shows downward convex response, which is again expected from the burden of sort operation. These two methods were tested with identical randomly generated data set of designated size, twenty runs were averaged for each data.
Because the total computational time is given as the sum of computational time necessary to process each segmented data, if segmentation is consistently unbalanced, for example segmented to a single element array and the rest, the total computational time should be \(\frac{n(n+1)}{2}\). It means the worst case will take \(O(n^2)\) of computational time, which is noted in most of the information science text books (see Press et al. 2007, Chapter 8). \(O(n^2)\) of time complexity can not be tolerated if we are to process large scale data.
Fortunately, we virtually have no need to consider this worst case as the computational time converges to O(n) in probability. We will give a brief proof of convergence as follows:
Let \(a_i\) be the size of \(i\)th segmented data while the algorithm is running. As we select the pivot randomly, the range of \(a_{i+1}\) is given as \([0, a_i1]\), within this range \(a_{i+1}\) is distributed uniformly. Let expected upper bound of each segment size \(a_i\) be \(R(a_i)\) (their lower bound is always 0, which corresponds to the BINGO situation). Additionally, for any probabilistic variable x, let E(x) be expectation and Var(x) be variance of the variable as usual.
Clearly, \(R(a_{i+1})= E(a_i)\), which is \(\frac{R(a_i)}{2}\) as \(a_i\) is also distributed within its range. Therefore \(Var(a_{i+1}) = \frac{Var(a_i)}{4}\) and the first partition size has variance of \(Var(a_1) = \frac{n^2}{4}\). From which the variance of overall computation results as follows: \(Var(\sum _i a_i) \le \sum _i Var(a_i) = \frac{n^2}{3}\).
Let \(C(n) = \sum a_i\), the total computational time to process data of size n. From the definition of O(n), \(C(n) \ne O(n)\) is rewritten as \(\forall \epsilon \ C(n) > \epsilon n\). Because \(\epsilon\) is arbitrary, we can set it to an unbounded above monotonic function \(\epsilon (n)\) and rewrite the condition as \(C(n) > \epsilon (n)n\). From the fact that \(Var(C(n)) \le n^2\), probability \(P(C(n) > O(n)) \le \frac{1}{\epsilon (n)}\) concludes directly from Chebyshev’s inequality, which implies our claim of convergence in probability of the computational time to O(n).
Above discussion also ensures that we encounter only finite \(C(n) > O(n)\) cases even if \(n\rightarrow \infty\). Actually the probability \(P(C(n) = \frac{n(n+1)}{2}))\) is given as \(\frac{1}{n!}\), which is less than 1.0e150 when n is only 1.0e+02; typical data we contemplate has up to 1.0e+08 of size. Actually, as seen from Fig. 9, the proposed algorithm performs more than ten times faster than conventional sorting method even if the data has only 1.0e+05 of size.
Here is a sample implementation of our proposed algorithm in LISP, which is virtually a direct translation from the algorithm description.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Fujita, Y., Usami, N. Fractal dimension analogous scaleinvariant derivative of Hirsch’s index. Appl Netw Sci 7, 5 (2022). https://doi.org/10.1007/s4110902100443x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s4110902100443x