Multiplex flows in citation networks
- Benjamin Renoust^{1, 3}Email authorView ORCID ID profile,
- Vivek Claver^{1, 3, 4} and
- Jean-François Baffier^{1, 2, 3}
Received: 17 March 2017
Accepted: 23 May 2017
Published: 18 July 2017
The Erratum to this article has been published in Applied Network Science 2017 2:27
Abstract
Knowledge is created and transmitted through generations, and innovation is often seen as a process generated from collective intelligence. There is rising interest in studying how innovation emerges from the blending of accumulated knowledge, and from which path an innovation mostly inherits. A citation network can be seen as a perfect example of one generative process leading to innovation. However, the impact and influence of scientific publication are always difficult to capture and measure. We offer a new take on investigating how the knowledge circulates and is transmitted, inspired by the notion of “stream of knowledge”. We propose to look at this question under the lens of flows in directed acyclic graphs (DAGs). In this framework inspired by the work of Strahler, we can also account for other well known measures of influence such as the h-index. We propose then to analyze flows of influence in a citation networks as an ascending flow. From this point on, we can take a finer look at the diffusion of knowledge through the lens of a multiplex network. In this network, each citation of a specific work constitutes one layer of interaction. Within our framework, we design three measures of multiplex flows in DAGs, namely the aggregated, sum and selective flow, to better understand how citations are influenced. We conduct our experiments with the arXiv HEP-Th dataset, and find insights through the visualization of these multiplex networks.
Keywords
Introduction
From the ancient times, knowledge has passed from individuals to others, each step leading to more discoveries and innovations. In modern times, the industrialization of research renders crucial to track this production of knowledge (Gibbons and Johnston 1974; Van Raan 2004). Indeed, it is important for the newly produced innovation to state on which ground it stands, enabling peers to judge the quality of the proposed innovation. An innovation must cite its influential sources to give credit to the work it was inspired from and to state its differences with the competing methods. This is one principle at the heart of the peer reviewing system enabling and validating the publication of new knowledge.
This process of citing sources is very important, because it makes explicit the transmission of knowledge from prior works to an innovation (Bornmann and Daniel 2008) — with the assumption that each new scientific publication is a container of innovation. Thankfully, this production of scientific knowledge can be easily captured in a citation graph. In this graph, nodes are publications citing other publications. This citation relationship is oriented and corresponds to a borrowing or derivation of knowledge. We suspect that the impact of a publication can be captured in this graph. The production of knowledge would then be represented as a growing process in a dynamic network.
Key for countries and organizations in modern science, the study of the production of knowledge is currently investigated from partial indicators that establish rankings and compare scientists. This gave rise to the development of many measures deriving from sociometrics (Waltman 2016) including age, field, and other cues. Three popular indicators are often used: the number of citations, the h-index (Hirsch 2005) — which originally measures both the productivity and the quality of an author —, and the impact factor (Reuters 2012) — which is a time-related average number of citations of a collection. These indicators are used for the evaluation of scientists, however they can be subject to controversy (Pendlebury 2009) and are designed to reflect only the productivity of a scientist rather than measuring the overall production of knowledge. One reason explaining these indicators’ popularity is their simplicity in terms of computation, as opposed to previous network analysis that was seen as too complex to deploy. However, progress in modern graph databases has grown, easing the analysis of dynamic networks (Cattuto et al. 2013).
Inspired by the seminal work from Strahler (1957) and from Hirsh (2005), we propose to bring a fresh look at the production of knowledge based on the analysis of flows in Directed Acyclic Graphs (DAGs). This view is not limited to the production of indicators but allows a more in-depth analysis of the process and diffusion of knowledge. The traditional indicators are very effective and it is important that our framework allows to establish them, while being easily extended. In addition, this DAG framework allows us to take a new perspective on citation relationships and introduces a multiplex network (Kivelä et al. 2014) model that emphasizes on co-citations (as opposed to the regular monoplex citation network).
In this work, we extend our proposition to join the different views on knowledge production in a recursive framework (Renoust et al. 2017) (which is covered in “Ascending flow in citation networks” section) to the analysis of multiplex citation networks and contribute with a new formalism, measures and experiments.
After discussing the literature in “Related works” section, the first part of this manuscript discusses the monoplex view of flows in citation networks (“Ascending flow in citation networks” section). In “Preliminaries” section, we introduce the Strahler numbers and the h-index in a generalized flow framework, and how those two notions belong to one greater notion of flow. We introduce our ascending flow in “Ascending flow in citation networks” section — modeled on the notion of flow of knowledge. We then discuss the parameters of this ascending flow and put it in relation with classical measures, while proposing a dynamic algorithm that allows for quick update. Finally, in “Experimental results” section we run experiments on a publicly available dataset, the arXiv HEP-Th (Gehrke et al. 2003). We then extend our ascending flow to the multiplex networks context from “The citation network as a multiplex network” section, which fits in our generalized flow framework. After defining our multiplex network in “Preliminaries” section, we propose three multiplex flow measures in “Multiplex extensions of the ascending flow” section, namely the aggregated, sum, and selective flows, with implementation in “Dynamic implementation” section. We present how we can visualize our networks in “Influence of layers in the multiplex citation network” section then repeat our experiments in “Experimental results” section on the same dataset and additionally lead in-depth examinations of publications before concluding in “Discussion and conclusion” section.
Related works
Monoplex approaches
The study of the production and transmission of knowledge has attracted quite a few scholars in the domains of social and economical science (Gibbons et al. 1994), with for example a focus on the population at the origin of production (Wuchty et al. 2007), and on transmission to business (Ernst and Kim 2002). These studies come a posteriori when observing controlled domains, with well known sociometric indicators. We are instead interested in the modeling of the production and diffusion of knowledge.
Many interesting attempts for modeling the production and diffusion of knowledge are actually focused on the producers of knowledge themselves, such as in multi-agent simulation (Cowan and Jonard 2001; Cointet and Roth 2007). In these models, the agents are interacting to produce knowledge, and the properties of the resulting interaction network of agents are the focus of analysis. The agents can then be tuned to produce different resulting networks, simulating real world policies (Mueller et al. 2015). The topology of the networks of people producing knowledge is often the main focus in related complex network research (Cowan R and Jonard 2004), with the goal to maximize diffusion in such networks (Alkemade and Castaldi 2005). In contrast, our focus is on the information produced itself and how it relates to previous works.
A good model for this is the citation graph. It mostly applies to academic research, but has found its way in complex network research. Numerous works actually focus on communities (Chen and Redner 2010), and on the characterization of the dynamics of the citation graphs (Gehrke et al. 2003). The closest to the spirit of our research would be the work by Hummon and Dereian (1989) who studied the main paths in the citation network in order to extract backbones and areas of interest. The question of the efficient implementation of these cues has been the focus of a previous contribution (Batagelj 2003). An extension of Hummon and Dereian’s original work has actually been applied to the study of the development of the h-index (Liu and Lu 2012). These methods are focused on the path produced by citations and use them as a base for bibliometrics, but without capturing the global flow of information. We propose in contrast a natural interpretation of flows in DAGs that can easily capture the same measures used for main path analysis.
Before introducing flows in DAGs, we need to mention one of the most cited work in scientometrics which is the Hirsch index (Hirsch 2005), globally known as the h-index. It originally applies to the authors and is designed to measures both the quantity and the quality of the authors’ production. Its definition is that an author with an h-index of h has published h articles which have been cited each at least h times. The version for publications is defined formally in “Preliminaries” section. It was rapidly followed by numerous variants and extensions (Waltman 2016). The most famous is possibly the g-index (Egghe 2006) that is the largest number such that the g articles with the most citations receive at least a total of g ^{2}, averaging the importance of each article. Hirsh (2010) also proposes a more restrictive version called \(\bar {h}\)-index, normalized to domain or age. Other variants are designed with application-specific goals (Bucur et al. 2015). All-in-all, h-index based measures are measures to analyze the productivity of researchers, but do not allow for the in-depth analysis of production, in opposition to main path analysis approaches.
Our work roots its contribution in the analysis of flows in DAGs. Traditional max-flow approaches are quite far from what we define here, because nodes are always sources of information and edges have infinite capacities — we may be closer to multicommodity flows (Assad 1978). Instead, we mostly take our inspiration from a different notion of flows, in river streams, as defined by Strahler (1957). Limited to binary trees, this notion has seen a few extensions (Auber 2002; Delest et al. 2006; Herman et al. 1999) with applications to graph visualization. These versions use flows to highlight and extract most relevant paths in DAGs and trees, then relatively place elements one to another. We will use this approach and adapt it to the production of knowledge.
Multiplex approaches
We later introduce the multiplex formulation of the citation network, which is a network made of multiple overlapping networks (each of which corresponds to a layer) connecting the same set of nodes (Berlingerio et al. 2013). Multiplex networks have been used to model citation networks mainly for clustering purpose (Boden et al. 2012; Dong et al. 2012; Renoust et al. 2014; Speidel et al. 2015). Boden et al. (2012) model the multiplex network from the keyword-publication associations in order to create clusters of publications of similar topic. Dong et al. (2012) share the same goal but mixes different layers from research domains, or different similarity links across the papers (diverse textual similarities, author similarity, and citations). Renoust et al. (2014) use an approach closer to Boden’s, with the different goal to find cohesive groups of co-authors in an author-publication network. Analysis of multiplex DAGs has also recently been proposed by Speidel et al. (2015) using the same arXiv HEP-Th dataset that we use, with the difference that layers are defined by year of publication. Beyond community detection, Pujari and Kanawati (2015) investigated the multiplex citation networks to predict the creation of link between authors: from the citation network they infer a multiplex network of authors and predict links, based on community structure. Our context differs in many ways from those works. The object we are studying, although from the same data, is very different. We keep the citation network as a support for modeling multiplex relationships, with the basic assumption of having a DAG structure. The network we construct presents a very large number of layers (one per co-citation) which is often an issue in the methods presented above. Our goals also differ, we are looking to find paths and remarkable nodes to evaluate the notion of publication impact.
The notion of flow has also been investigated in multiplex networks. Estrada et al. (2014) propose to study the dynamics of information in social networks through the communicability as a measure of flow to study the connectivity of layers. Although the goals and the object we study are quite different, this approach share commonalities with our sum and selective flows. Solé et al. (2015) proposes to study centrality and community structure from the point of view of information transfer within social networks while modeling the flow as a dynamically node-produced unit. Close to Solé et al.’s spirit, (De Domenico et al. 2015) have studied modular flows for random walkers within multiplex social networks derived from citations networks to identify communities of highly interacting researchers. Such approaches do not apply to our case: citations are only produced once and we do not study the dynamics between authors. Flows in their work are modeled to find centralities from random walks (which by definition can not be applied to DAG) with the goal to study community structures among authors.
Some digressing but interesting works focused on the study of time-related dynamics of flows and diffusion in multiplex networks are worth mentioning. Boccaletti et al. (2014) have produced a seminal work on the structural analysis of multiplex networks, however flows and diffusion are only approached from the dynamics side (close to the spirit of Gomez et al. (2013)). Pósfai et al. (2016) use maximum flows to study the controllability of 2-layer multiplex networks. Very recently Yu et al. (2017) proposed an analysis of the diffusion dynamics of binary states (such as the Prisoner’s Dilemma) in a multiplex social networks, investigating how different community layers influence this diffusion.
Ascending flow in citation networks
We now introduce the notion of flow in a citation network inspired by the work of Strahler. We propose the ascending flow, parameterization, and experiments in the arXiv HEP-Th dataset.
Preliminaries
We consider in our setting a citation graph G=(V,E) where V is a set of nodes — publications — and E a set of directed links, hereafter arcs, between nodes of V. An arc a(p,q)∈E represents a citation of publication q by publication p. We consider the graph as being directed acyclic (or DAG). Although real-world data may introduce a few cycles (arXiv edits leading to mutual citations), this is a marginal case that we will discard in our study.
In this setting, an author, journal, book, or proceedings can be modeled as collections of publications. Hence, by observing the collective impact of the collection we can characterize the influence of this set of publications. In other words, in our citation graph formalism — although we will not study them — collections are only sink nodes that can be sourced from the publications themselves. In this work, our measures of the impact of individual publications can be trivially reported to authors and collections.
Definition 1
For a publication p, its in-neighborhood \(\mathcal {N}^- ({p})\) is the set of all the publications referring to p. The size of \(\mathcal {N}^- ({p})\) is simply its in-degree d ^{−}(p). The corollary implies that \(\mathcal {N}^+({p})\), the out-neighboorhood of p, corresponds to all publications to which p is referring to (with a size d ^{+}(p), its out-degree).
Strahler numbers measure the size of river streams depending on their flow of parent streams. If we recall the definition of Strahler’s numbers (Strahler 1957), in binary trees, it starts by assigning 1 to all leaf nodes, then iterates on parent nodes. If a parent node has at least two children with number i, then the node is assigned i+1, otherwise i. This number corresponds to the number of registers necessary to compute binary operations (Flajolet et al. 1979). The Extended Strahler (Auber 2002) does it for general trees (counting the register numbers of n-ary operations).
The h-index is defined as the maximum n such as n papers are cited n times. From this definition, the h-index applies in general trees of depth 3 and can actually be seen as a modified version of the Extended Strahler numbers. In this modification, a root node (e.g. an author) does not increase value from his maximum valuated nodes, but instead gets weighted by the maximum Extended Strahler number of his direct descendants (i.e. the publications).
Strahler numbers have been designed to define the size of river streams based on a hierarchy of dependent streams. Transmission of knowledge is very similar in that sense with publications being tributary to prior works they inherit from, and becoming in turn sources for later works — the h-index then captures the latter quantity. However, we want a finer measure which could capture the impact of a publication across all citations it has generated.
where λ designates a constant for terminal cases (leafs, often λ=1), \(a_{i}\in \mathcal {N}^- ({p})\) represents the ancestors of node p, and F is an application depending on the values \(K(a_{1}),\ldots,K(a_{d^{-}(p)})\phantom {\dot {i}\!}\). To simplify the notations, we denote \(F(\mathcal {N}^- ({p}))=F(K(a_{1}),\ldots,K(a_{d^{-}(p)}))\phantom {\dot {i}\!}\).
where \(s_{i}\in \mathcal {N}^+({p})\) represent the successor of p (instead of the ancestor a _{ i }). Note that this defines a descending flow measure, which captures how much information all nodes in the network receive.
Before we provide our own measure of flow, two natural definitions help defining our framework and its integration with existing metrics.
Definition 2
(Related) Two articles p and q are said to be related if and only if there exist a path from p to q or from q to p. They are k-related if they are related and if the shortest path between them is at most of length k.
Definition 3
(k-diffuse) A measure of a node p is k-diffuse when it limits its computation to a subgraph composed of the k-related nodes of p.
Our base measures, the h-index and the number of citations, are then respectively 2- and 1-diffuse by definition.
We provide now a base measure called ascending flow and discuss its complexity. We then extend it to several variants, such as one that is restricted in depth, hence a better fit to dynamic computation.
Ascending flow in citation networks
where λ _{ p } represent the information created by the publication p — in practice we set λ _{ p }=1. Hence, the more a publication is influential the more credit it will propagate to its ancestors. In contrast to the previous Flow metric, our ascending flow is not only applied to the reversed DAG, but is also equivalent to the sum of the flows computed for each sub-DAG induced by each node.
The ascending flow, formalized above, can be implemented as Algorithm 1. It is important to note that each arc is visited only once and that the total number of visits of all nodes is also equal to the number of arcs. The time complexity of our algorithm is then Θ(m) where m is the number of arcs. This key property is inherent to the DAG nature of our citation network. Another straightforward property of DAGs is that \(m \leqslant \frac {n(n-1)}{2}\) where n is the number of nodes. However, even a linear time complexity is often too costly for large dynamic networks.
Depth restriction and dynamic graph
This depth parameter additionally allows us to reconnect with known measures. The h-index is 2-diffuse and it would not make sense to extend its definition. In turn, the number of citations — which is also the in-degree (d ^{−}(p)) — is 1−diffuse and can be easily translated in a k-diffuse measure, the k-degree, which would be the number of publications created until generation k. Then, an ∞-degree would be the number of all publications seeded by p even indirectly.
Experimental results
We now apply our framework on a real-world setting. We used an available citation graph from 2003 KDD Cup: arXiv HEP-Th^{1} (Gehrke et al. 2003). It consists in an archive of 27,770 publications with 352,807 (internal) citations from the well-known arXiv website of pre-prints in the domain of high energy physics theory, archived between January 1992 to April 2003.
Correlations between measures on the whole archive
Comparison of Pearson coefficients (bottom left, correlation of values) and Spearman coefficient (top right, correlation of ranks) between all measures
Pearson ρ Spearman r _{ s } | h-index | ascending flow | ∞-degree | 1-degree | 2-degree | 5-degree | 10-degree | 20-degree | 1-flow | 2-flow | 5-flow | 10-flow | 20-flow |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
h-index | - | 0.821 | 0.765 | 0.958 | 0.954 | 0.849 | 0.770 | 0.765 | 0.776 | 0.809 | 0.807 | 0.807 | 0.807 |
Ascending flow | 0.546 | - | 0.758 | 0.858 | 0.807 | 0.764 | 0.759 | 0.758 | 0.961 | 0.990 | 0.991 | 0.991 | 0.991 |
∞-degree | 0.476 | 0.267 | - | 0.715 | 0.809 | 0.947 | 1.000 | 1.000 | 0.654 | 0.710 | 0.714 | 0.714 | 0.714 |
1-degree | 0.768 | 0.648 | 0.265 | - | 0.920 | 0.794 | 0.719 | 0.715 | 0.856 | 0.863 | 0.860 | 0.860 | 0.860 |
2-degree | 0.850 | 0.670 | 0.375 | 0.766 | - | 0.908 | 0.815 | 0.809 | 0.725 | 0.776 | 0.775 | 0.775 | 0.775 |
5-degree | 0.626 | 0.347 | 0.856 | 0.367 | 0.546 | - | 0.952 | 0.947 | 0.657 | 0.714 | 0.716 | 0.716 | 0.716 |
10-degree | 0.483 | 0.270 | 0.999 | 0.268 | 0.381 | 0.865 | - | 1.000 | 0.654 | 0.710 | 0.714 | 0.714 | 0.714 |
20-degree | 0.476 | 0.267 | 1.000 | 0.265 | 0.375 | 0.856 | 0.999 | - | 0.654 | 0.710 | 0.714 | 0.714 | 0.714 |
1-flow | 0.637 | 0.694 | 0.330 | 0.904 | 0.638 | 0.367 | 0.332 | 0.330 | - | 0.987 | 0.985 | 0.985 | 0.985 |
2-flow | 0.664 | 0.814 | 0.337 | 0.892 | 0.712 | 0.390 | 0.339 | 0.337 | 0.969 | - | 1.000 | 1.000 | 1.000 |
5-flow | 0.656 | 0.823 | 0.341 | 0.879 | 0.704 | 0.392 | 0.344 | 0.341 | 0.964 | 0.999 | - | 1.000 | 1.000 |
10-flow | 0.656 | 0.823 | 0.341 | 0.879 | 0.704 | 0.392 | 0.344 | 0.341 | 0.964 | 0.999 | 1.000 | - | 1.000 |
20-flow | 0.656 | 0.823 | 0.341 | 0.879 | 0.704 | 0.392 | 0.344 | 0.341 | 0.964 | 0.999 | 1.000 | 1.000 | - |
First, when comparing the h-index, the number of citations, and the total number of publications produced by a work, we can notice a clear difference on our four basic metrics — i.e. the number of citations (=1-degree), the number of publications generated (=∞-degree), the h-index and the ascending flow. We additionally varied the depth of degree and flow in {1,2,5,10,20,∞}. A second observation is that the limitation in depth of our measure is consistent with what we observe when limiting the depth of the k-degree (the most correlated i-flow for a j-degree is when i=j), and the higher k for the k degree, the more it diverges from the k-flow.
Our main observation, is, by value, the h-index is most correlated to the 2-degree. This makes complete sense, since the h-index is also limited in depth at 2 for which it considers a subset of publications. In contrast, when it comes to rankings, the h-index is most correlated to the 1-degree which is equivalent to the number of citations. Interestingly, our ascending flow also shares most correlation with the 2-degree as well and ranks with the 1-degree. This interesting effect may also be observed in Fig. 4 showing that most publications bringing influence to the source publication has done it already in depth two. The link between the h-index and the degree is further observable in Fig. 5.
In terms of computation, from k=2, the ranks obtained by the k-flow are r _{ s }=0.99 similar of those of the regular flow so when a gain of computation is needed, one can use k-diffuse version of the algorithm (Fig. 2).
Searching for a needle in the haystack
We observed all publications with h-index =6 (1054 publications in the dataset). With this sample of fixed h-index nodes, the ascending flow does not correlate well with other classical measures: ρ=0.136 with the 2-degree which was the most correlated value over the network with the ascending flow and the h-index, ρ=0.096 with the number of citations, ρ=0.228 with the total descending nodes (∞-degree).
The chain of max flow citations from ID9201019: The Coupling of Yang-Mills to Extended Objects
Articles (index by date) | Flow | #citations | h-index |
---|---|---|---|
9201019:The Coupling of Yang-Mills to Extended Objects | 425.446 | 16 | 6 |
9208055: Putting String/Fivebrane Duality to the Test | 363.071 | 32 | 18 |
9304154: Duality Symmetric Actions | 57.5917 | 229 | 44 |
9402032: Dyon - Monopole Bound States | 84.5253 | 240 | 54 |
9408074: A Strong Coupling Test of S-Duality | 32.3318 | 290 | 54 |
9510135: Bound States Of Strings And p-Branes | 31.2979 | 775 | 88 |
9802109: Gauge Theory Correlators from Non-Critical String Theory | 23.9841 | 1641 | 81 |
9802150: Anti De Sitter Space And Holography | 14.0768, | 1775 | 82 |
9803001: Macroscopic strings as heavy quarks: Large-N gauge theory | 11.5337 | .239 | 41 |
Comparisons of “similar” publications
We repeated the same experiment with two varying 2-flow measures (h-index =6 and similar date of publication): the first one is 2.25 with 10 citations (Fig. 7b, left), and the second one is 21.59 with 20 citation (Fig. 7b, right). The average h-index is actually higher in the least influential publication (3.45) than in the most influential publication (1.80). However, the most influential has seeded 102 publications (2-degree) for 107 arcs out, when the first one has seeded 68 publications (2-degree) for 182 arcs. The flow measures then capture much more details of the graph produced by citations than the h-index does.
The citation network as a multiplex network
The ascending flow is based on the notion that knowledge diffuses equally among citations, with the implication that two works inspired by a third work borrow equally from it, and that one work citing two other works also borrows equally from each of them. However, there should be a notion of proximity between works that would translate how a work borrows from other works it is citing. Without parsing the whole text of a publication, there is no trivial and unbiased way to evaluate this notion of influence.
We have introduced in the previous section that each publication shows a different structure in the subgraph induced by its direct citing articles. We can consider all edges in this subgraph as one layer of interaction in the subgraph. Indeed, all edges in a direct citation subgraph share the common aspect that all nodes they connect directly cite the top-level node. If we consider our whole citation network as a unified collection of such subgraphs, we can consider that many layers of interactions induced by different publications overlap over the edges. Such a pattern can be captured through a multiplex formulation of our network (Kivelä et al. 2014). A multiplex network \({\mathcal {G}}\) can connect the same two nodes p,q over arcs a(p,q,l) in multiple layers l (see Fig. 12, left).
We present the citation network as a new application case for multiplex network analysis. It allows us to formulate a notion of multiplex flows that may be closer to the spirit of the flow of knowledge we want to capture. In addition, it also enables us to ask new types of questions in terms of relative influence of other work within a citation network, as we will illustrate in the following sections.
After introducing the definition of our multiplex network (“Preliminaries” section), we extend our ascending flow framework with three new multiplex versions: the aggregated flow, the sum flow, and the selective flow in “Multiplex extensions of the ascending flow” section, and implementation in “Dynamic implementation” section. We also study the edge entanglement (“Influence of layers in the multiplex citation network” section) in order to investigate influential works found from our experimental results in “Experimental results” section.
Preliminaries
If we recall our original definition of the citation network (“Preliminaries” section), we consider a citation graph G=(V,E) in which a node p∈V represents a publication, and arcs (p,q)∈E when an article p cites an article q, that is considered a DAG.Each node p then bears a subgraph induced by all its citing articles.
Definition 4
A citation subgraph G _{ p }=(V _{ p },E _{ p }) is induced by a node p such that \(V_{p}={p \cup \mathcal {N}^- ({p})} \subset V\), and E _{ p }⊂E is such that, \(\forall (q,r)\in V_{p}^{2},\;\; \exists a(q,r)\in E\).
Let consider, for each publication p, its induced citation subgraph G _{ p }=(V _{ p },E _{ p }) of G, the multiplex citation network results in combining all individual subgraphs G _{ p } together.
Definition 5
A multiplex network \({\cal {G}}=(V, {\mathcal {E}}, {\mathcal {L}})\) connects nodes (p,q) on different layers l such that arcs \(a(p,q,l)\in \bigcup _{l \in {\mathcal {L}}}{\mathcal {E}}_{l}\). A multiplex citation network \({\cal {G}}=(V, {\mathcal {E}}, {\mathcal {L}})\) is defined such that \({\cal {G}} = \bigcup _{p}^{p \in V}{G_{p}}\), hence \({\mathcal {E}} = \bigcup _{p}^{p \in V}{E_{p}}\) and \({\mathcal {L}} = V\).
Note that an arc a(p,q,l) exists if and only if both p and q cite l or if l=q. As a consequence, the multiplex network once “flattened”^{3}, has the exact same topology as the original citation network. The difference lies in the multiple edges.
Definition 6
A multiplex connection α(p,q) between nodes p and q is defined such that \(\alpha (p,q) = \bigcup _{l}^{l \in {\mathcal {L}}_{p}}{a(p,q,l)},\;\; s.a.\;\; \exists a(p,q) \in {\mathcal {E}}\).
By extension of Definition 4, \({\cal {G}}_{p}=(V_{p}, {\mathcal {E}}_{p}, {\mathcal {L}}_{p})\) designates the multiplex subgraph induced by a node p and its citing articles \(\mathcal {N}^- ({p})\). Note that this definition does not restrict layers to those corresponding to nodes of V _{ p }, since we are interested in observing co-citations.
Definition 7
A citation multiplex subgraph \({\cal {G}}_{p}=(V_{p}, {\mathcal {E}}_{p}, {\mathcal {L}}_{p})\) is induced by a node p with \({\mathcal {E}}_{p} \subset {\mathcal {E}}\) and \({\mathcal {L}}_{p} \subset {\mathcal {L}}\) such that, \(\forall l \in {\mathcal {L}} \; \forall (q,r)\in V_{p}^{2},\;\; \exists a(q,r,l)\in {\mathcal {E}}\).
The co-citation relationship can also be characterized in the multiplex network. From the definition of our multiplex network, we can consider a node p to belong to different layers \({\mathcal {L}}(p)\), corresponding to the articles they cite, in addition to their own.
If we look at two articles such that p cites q, their multiplex connection α(p,q) corresponds to all the citations they have in common, hence the union of all arcs from p to q existing in all subgraphs \(G_{l}, l \in {\mathcal {L}}(p,q) \subset V\): this corresponds to the co-citations of p and q in addition to q itself.
Definition 8
The set of layers \({\mathcal {L}}(p,q)\) connecting two nodes p,q is defined by \({\mathcal {L}}(p,q) = \{\mathcal {N}^+({p}) \cap \mathcal {N}^- ({q}), q\}\). By extension, we define \({\mathcal {L}}(p)=\{\bigcup _{q\in \mathcal {N}^- ({p})}{{\mathcal {L}}(p,q)}, p\}\).
Note that the number of layers of a multiplex connection \(|{\mathcal {L}}(p,q)|\) (respectively, the number of layers to which a publication belongs to \(|{\mathcal {L}}(p)|\)) corresponds to the multiplexity of a connection (respectively, to the multiplexity of a node) (Podolny and Baron (1997)), i.e. the number of different layers connecting the pair of nodes α(p,q) (respectively connecting all pairs of node α(p,q),∀q∈V).
In our multiplex citation network, the notion of neighborhood remains the same as in the monoplex case (Definition 1). However we can refer to a different notion of multiplex degrees δ ^{+}(p) and δ ^{−}(p) that takes into account the number of arcs connecting a node to its neighborhood.
Definition 9
Denote the multiplex out-degree δ ^{+}(p) (respectively the multiplex in-degree δ ^{−}(p)) a node p in the multiplex network \({\mathcal {G}}\). \(\delta ^{+}(p) = |a(p,q,l)|, \forall q \in V,\; \forall l \in {\mathcal {L}},\; s.a.\; \exists a(p,q,l) \in {\mathcal {E}}\) (respectively δ ^{−}(p)=|a(q,p,l)|).
The degrees d ^{+}(p) and d ^{−}(p) still refer to the degree in the monoplex network G, i.e. the size of the neighborhood (Definition 1). We then introduce the degrees \(d^{+}_{l}(p)\) and \(d^{-}_{l}(p)\) corresponding to the degree in the subgraph G _{ l }, i.e. the number of arc adjacent to p on the layer l.
Definition 10
Denote the layer out-degree \(\delta _{l}^{+}(p)\) (respectively the layer in-degree \(\delta _{l}^{-}(p)\)) a node p in the subgraph \({\mathcal {G}_{l}}\). \(\delta _{l}^{+}(p) = |a(p,q,l)|, \forall q \in V,\; s.a.\; \exists a(p,q,l) \in {\mathcal {E}}\) (respectively \(\delta _{l}^{-}(p) = |a(q,p,l)|\)).
We will now turn to our advantage the fact that the definition of the multiplex subgraph induced by one publication p, as in Definition 7, implies that edges bear all the co-cited papers not restricted to the articles citing p. This allows the inspection of the subgraph directly without having to consider the whole graph, and the design of measures that can reduce the influence of an article in favor to other co-cited works.
Multiplex extensions of the ascending flow
Since the multiplex formulation of flows in citation networks offers a wide range of possibilities for new measures of influence, we present three measures of flows: two straight-forward extensions of the ascending flow to the multiplex case, and one more elaborated.
Aggregated flow
Driving this definition is a notion of proximity of sources between two publications: the more they share citations, the closer they can be considered, hence the citing publication is more influenced by the work it is citing. The cited publication will then receive a larger share of the flow gathered by the citing work in comparison to other works marginally cited. One advantage of this view is that, in a developing branch of knowledge, the most recent works sharing many citations with a publication will receive more flow — with the consequence of survey works dispatching more flow to recent works rather than fundamental works. Similar to “Ascending flow in citation networks” section we set λ _{ p }=1 the unit of contribution of one work.
Sum flow
This second extension of the ascending flow to a multiplex network consists in combining multiple monoplex versions of the ascending flow. Indeed, as we explain in “Preliminaries” section, for each publication p, we have an induced subgraph G _{ p }, for which we can compute an ascending flow. With this measure, influential nodes (such as surveys) send individually to each sources only the flow they directly received through their layer. It would correct the disadvantage of the aggregated flow by introducing some level of fairness. Its drawback is that such survey works will receive a boosted flow measure since they have greater chances to belong to many different layers.
If we set the parameter λ _{(p,l)}=1, the contribution of one publication to the whole system will be exactly its number of citations, and a publication that cites lots of work will produce a lot of flow. In order to maintain constant the unit of contribution of a publication of a work, we set λ _{ p }=1 hence \(\sum _{l}^{l \in {\mathcal {L}}(p)}\frac {1}{|{\mathcal {L}}(p)|} = 1\) such that a publication brings exactly 1 unit of contribution to the system.
Selective flow
This last extension attempts to correct both drawbacks of the previously defined flows. It is more restrictive and hybrids both of previous measures: one publication still brings one unit of contribution to the system. Not only flow circulates solely through one layer of interaction, but also the share generated by a layer will be transmitted along this layer.
Similarly to the sum flow, we set the unit of contribution of one publication to λ _{ p }=1, such that \(\sum _{l \in {\mathcal {L}}(p)}\sum _{o\in \mathcal {N}^+({p})} \frac {\lambda _{p}}{d^{-}(p)\times |{\mathcal {L}}(p,o)|}=1\).
The less a cited work shares co-citation, the more it will be rewarded in flow. Contrarily to the aggregated flow, this is designed to increase the flow transmitted from works that brings originality from extra fields.
Dynamic implementation
Although we presented static algorithms for computing our measure, actual dynamic implementation is much simpler. Similarly to the ascending flow, we consider the construction of our citation graph node by node in order to compute our measures. This means that we only need to compute a series of weights, and propagate them up when updating.
In the case of the ascending flow, we need to propagate in the whole hierarchy each time we add a node. For this reason, we proposed the k-diffuse property to ease the computation. The idea is exactly the same with the new measures, although additional details must be taken into account. Since we are using multiplex networks, two implementations are possible: either we take into account each edge colored by its layer individually, or we assign a set of colors (corresponding to layers) to each node and edge.
The aggregated flow propagates exactly the same way as the ascending flow, with the exception of the weighing scheme: there are just a little bit more edges to take into account. The newly added node p will propagate to q a weight \(w_{agg}(p,q)=\frac {\lambda _{p}}{|{\mathcal {L}}(p,q)|}\) and same for q that will propagate with λ _{ q }=w _{ agg }(p,q).
For the sum flow, we first assign different weights for each color. The propagation then occurs similarly to the ascending flow. However, we need to compute an ascending propagation per each layer this newly added node belongs to (1 per citation). The newly added node p will propagate to q for each co-citation l∈(p,q) a weight \(w_{sum}(p,q,l)=\frac {\lambda _{p}}{1+\delta ^{+}(q)}\), then q will propagate individually on each layer l, following the strategy of the ascending flow with λ _{ q,l }=w _{ sum }(p,q,l).
Finally, the selective flow is similar to the sum flow with a different weighting scheme. The newly added node p will propagate to q for each co-citation \(l \in {\mathcal {L}}(p,q)\) a weight assigned per each edge \(w_{sel}(p,q,l)=\frac {\lambda _{p}}{d^{+}(q)\times |{\mathcal {L}}(p,q)|}\), then q will propagate individually on each layer l, following the strategy of the ascending flow with λ _{ q,l }=w _{ sel }(p,q,l).
Although we do not propose a study of parameterization — with timely comparisons — here, all flow measures can be constrained similarly to the ascending flow, i.e. we can apply evanescence or k-diffusion to speed up implementation time.
Influence of layers in the multiplex citation network
The multiplex definition of our citation network allows us many interesting studies, one of each is the analysis of edge entanglement (Renoust et al. 2014). Edge entanglement measures the overlapping of edges in a multiplex network. The entanglement index grows as multiple layers overlap together over multiple edges (similarly to hubs and authorities, but for layers).
One very interesting aspect of this approach is that it computes a second network, the network of overlapping layers (hereafter referred as the “layer network”, see Fig. 12, right), for which the entanglement measures may be computed. The visualization of this multiplex network gives interesting insights on how the layers are behaving together in the multiplex network. We use a publicly released online visualization tool^{4} (Detangler (Renoust et al. 2015)). It offers interaction in the multiplex network allowing to identify groups of particular nodes and their associated layers — as well as the other way around, particular groups of layers with their associated nodes (Renoust et al. 2015). Detangler also offers to study many other aspects of the multiplex network by changing metrics, taking weights into account, and measuring global cohesion of groups of publications (Renoust et al. 2014). For the sake of simplicity, we will only look at the exploration of the layers in association with citing articles as it already brings insights.
This is particularly useful to investigate a multiplex subgraph \({\mathcal {G}}_{p}\) induced by a publication p. For example, the topology of the layer network can indicate subgroups of citations that tend to be co-cited together. With interaction, we can as well identify a subgroup of publications that tend to co-cite the same subgroup of citations. Since \({\mathcal {G}}_{p}\) is by definition induced by p, we also expect the publication p to be the most overlapping publication. However, the co-citing relationships including many additional layers, we can identify other fundamental works that are co-cited in the network.
Experimental results
We follow up on our experiment in “Experimental results” section, and computed values of all new multiplex flows on the arXiv HEP-Th dataset.
Correlations between measures on the whole archive
Comparison of Pearson coefficients (bottom left, correlation of values) and Spearman coefficient (top right, correlation of ranks) between all measures
Spearman r _{ s } | Monoplex | Multiplex | ||||||
---|---|---|---|---|---|---|---|---|
Pearson ρ | h-index | 1-degree | inf-degree | Ascending flow | Aggregated flow | Sum flow | Selective flow | Multiplexity |
h-index | - | 0.958 | 0.765 | 0.821 | 0.846 | 0.873 | 0.836 | 0.330 |
1Degree | 0.768 | - | 0.715 | 0.858 | 0.880 | 0.939 | 0.899 | 0.322 |
InfDegreeCoeff | 0.476 | 0.265 | - | 0.758 | 0.748 | 0.661 | 0.680 | 0.038 |
AscendingFlow | 0.546 | 0.648 | 0.267 | - | 0.975 | 0.918 | 0.967 | -0.011 |
AggregatedFlow | 0.541 | 0.586 | 0.248 | 0.912 | - | 0.952 | 0.962 | 0.110 |
SumFlow | 0.786 | 0.953 | 0.322 | 0.628 | 0.611 | - | 0.972 | 0.226 |
SelectiveFlow | 0.665 | 0.957 | 0.257 | 0.682 | 0.624 | 0.946 | - | 0.072 |
Multiplexity | 0.248 | 0.168 | -0.044 | -0.005 | 0.030 | 0.191 | 0.070 | - |
The second remark is that the original ascending flow and the aggregated flow are very correlated (ρ=0.912). This is of course expected since the definition of the aggregated flow directly extends the ascending flow. Both are actually equivalent when a publication shares exactly the same number of co-citations with all its citing articles. A look at Fig. 13 (a) shows that many cases differ in practice.
Searching for multiple needles in the haystack
To illustrate the difference between the multiplex flows, we can explore a subset of publications with a fixed number of citations (arbitrarily set to 10, corresponding to 591 publications). We can observe in the distributions (Fig. 14b) between our sum and selective flows and the h-index that values widely vary.
Information of the most relevant publication and their main influence as discovered with the different multiplex flows among the (#citations=10, h-index=6) publication subset
Top node | Most flow received from | |
---|---|---|
Aggregated Flow | ID9503097: Inflation With Variable Omega | ID9802030:Open Inflation Without False Vacua |
Sum Flow | ID9303050: Conformal Turbulance with Boundary | ID9307091: Solutions of Conformal Turbulence on a Half Plane |
Selective Flow | ID9503097: Infrared regularization of non-Abelian gauge theories | ID:0728589On the renormalizability and unitarity of the Curci-Ferrari model |
Exploration of individual induced subgraphs
We have identified three interesting publications, and can now investigate their induced subgraphs. We will pay a special attention to how other publications are cited in their subgraphs. The idea is to find whether there are other very influent works that inspired this subset of publications or not. We will also check if we can find sub-communities of co-citations. Layers (hence cited articles) that have a relatively high entanglement index may either form subgroups of layers or be some influent work. Entanglement indices are computed normalized over the whole multiplex network. Relatively high entanglement indices are groups of connected layers (in the layer-interaction network) that display higher values than their surrounding.
If we look at the subgraph identified by the aggregated flow (ID9503097), we can clearly see two communities of cited articles in the layer network (Fig. 16, right) corresponding to the two separated branches of citing articles (Fig. 16, left). One community of layer nodes is also almost separated in two. One subgroup of layer nodes correspond to a smaller group of three publications, two citing another third. A small investigation on this group of publications actually shows that they all have one author in common (M. Gasperini), and that a fair amount of the corresponding subgroup of cited articles have been also published by this author: this may be a case of excessive self-citations.
Now we can look at the subgraph identified by the sum flow (ID9303050). The topology of the layer network suggests two intertwined communities. A fair amount of external nodes shows relatively high entanglement index. They are cited by almost all the other nodes (from selection of those nodes). From the publication network, three other publications show relatively high value of sum flow. A little inspection shows us that those three are from the same authors (M. Rahimitabar and S. Rouhani). From selection, we can see they co-cite mainly four publications (bigger highlighted nodes on the right in Fig. 17), but this time among these there is only one self-citation!
Finally, we can investigate the subgraph identified by the selective flow. The layer network shows a very different topology: it is almost one big connected clique. All the major layer nodes correspond to citing publications nodes. Additional layer nodes almost always connect only one pair of publications each. Manual inspection does not show dominant authors or much self citation in this group, it is actually very well balanced. One citing publication node pops out as it displays a very high flow value. We could suspect that this node is the reason this subgraph was detected in the first place. However, we know from Fig. 18 that most of the top node’s flow does not come from this citing article. Indeed, if we select this node and its citing node, only the citing node’s layer is displayed: the top publication will only receive from this node the share of citation that corresponds to its layer. The citing article must have received influence from many other works.
We inspected the network, and it appears overall flawless: no major work is often co-cited with the top publication; no other citing article brings an imbalanced larger share of flow to the publication; no dominant authors and no excessive self-citation.
Discussion and conclusion
On the notion of flow in citation networks
We have shown that the production and diffusion of knowledge can be modeled in a recursive framework that studies flows in DAGs, with a natural interpretation of the notion stream of knowledge. The framework allows for other known metrics to be embedded, and for efficient computation on large dynamic graphs. By comparing the ascendant flow with the h-index we clearly see some level of correlation, in regards to the meaningfulness of the Pearson coefficient. Our measure’s interpretation is straightforward, and this correlation goes in favor of the relevance of the h-index, and in some extent also to the number of citations. But we do not fully correlate with the h-index, and many cases that are oversimplified by the h-index can be more accurately described by the ascending flow. In addition, the flow can be used to find paths in the citation network, trying to explain the sources of influence. One interesting extension of this study would be to characterize if a node genuinely receives flow from being cited by a large crowd, or maybe once it has spread across different (sub)domains of science, or from being cited by very influent works.
We found cases with large differences among ascending flow for publications with the same h-index. The h-index gives a rough estimation of a publication’s production of knowledge, but it does not take into account how each citation refers to the original work. The ascending flow measure, even 2−diffuse, is reinforced by two factors. A first one is something similar to a “community” effect in citations, i.e. when the citations produced also cite each other in relative proportion, in comparison to citations “outside” that “community” of citations. For example, this happens when a paper has an influence in developing a community of research: the larger the community, the greater the flow. The second effect gets more relevant as the depth of diffusion is greater. It is somewhat close to the hubs and authorities effect: the more citations a paper gets from influential papers the more influential it will become.
The interpretation of flow we propose is much more flexible than the h-index, and can fairly support a wide range of parameters to conduct further experiments (such as additional weights, edge filtering, depth of influence, etc.). More than a metric, when studying the influence of a work (or a collection of works), we argue that the structure of the flow of knowledge it produces, i.e. the DAG generated by a publication and its citations should be taken into account.
On the multiplex interpretation of the citation network
We also proposed to extend this model to a multiplex view of the citation network such as the edges bear the additional information of co-citations. The ascending flow fits well in this new model, and we could define three original flows. Although those interpretations of the flow are not independent of previous metrics, use cases show that it brings finer details, all things being equal. One important direction of future works would be a better study of the design space offered for other measures. We have chosen three interpretations of multiplex flow for our application case, but we will need to study their limits, dynamic/static implementation characteristics, and properties so we can better control and implement them. Implementation of the multiplex measure is a naive extension of the monoplex version, but we surely have room for optimization.
This multiplex view of the network would support many extensions to better fit the idea of knowledge diffusion, and from publication analysis, we could find the number of references to each citation within an article and use it to weight our individual interaction. Text analysis is also another direction that could bring topical proximity to even better refine the networks (as well demonstrated by Dong et al. (2012)).
Interacting with the publication subgraphs on Detangler brought really interesting insights from the content of an article’s co-citation network. This could be a helpful tool to suggest important new readings when evaluating a publication from a specific domain, or even to unearth very influential works on a specific venue. The questions we asked ourselves on self-citations discovered through interaction also opened us to new possibilities: we could use individual authors as a way to define a layer of interactions (such as in the work Boden et al. (2012)), and consider in the same time a co-cited author network (somewhat close to the spirit of one of Detangler’s use-case (Renoust et al. 2015)), forming a multiple-multiplex network. Our introduction of the multiplex DAG also invites us to study with them all known multiplex measure and extend other DAG measures to the multiplex case.
Conclusion
We have introduced the notion of flow in citation networks, proposed a measure the ascending flow, discussed its implementation and experimented with it in the arXiv HEP-Th dataset. This notion of flow allowed us to propose the new approach of the citation network as a multiplex DAG for which we offered three measures — the aggregated, sum and selective flows — with implementation and experiments on the same dataset. We also leveraged visualization to explore our results and discovered interesting insights.
Although our study does not hold for an evaluation for which a comparison with many other metrics and regression will be necessary, we still have set and validated the basis of our framework. Not being high-energy theoretical physicists ourselves, it remains somewhat difficult to directly interpret the results, nonetheless exploration of our results showed interesting insights.
It will be important in the future to carefully curate controlled datasets for which we can expect results and apply former validation. As such, it would be interesting to examine the insights we could extract from a citation network inherited from all publications of a conference venue; to explore neighborhoods of important works such as surveys; to suggest new relevant works from a set of publications; or to analyze the genesis of two merging domains.
We wish to extend our study to other databases, such as DBLP or web of science, and bring the analysis to the authors themselves — although ambiguity in author names is quite challenging. It will be interesting to observe the influence of Nobel prizes for example, find their most influent work and their own influence.
Finally, this framework is not limited to citation networks, but can apply to many other type of transferred information: among our future works is the application to the analysis of news documents. Indeed, DAGs also apply to the study of closely related documents — even if there is no citation relationship, the time dependency between closely related documents can maintain the DAG assumption. It could be an interesting way to find the sources of information, and characterize the impact of news events.
Endnotes
^{1} Available at: http://snap.stanford.edu/data/cit-HepTh.html.
^{2} The Coupling of Yang-Mills to Extended Objects (Dixon et al. 1992), by Dixon, Duff and Sezgin published on arXiv in 1992. And it has well deserved another citation!
^{3} By “flattening”, we mean the process of projecting the multiplex network such that one edge only is shared between two nodes in order to obtain a monoplex version of the multiplex network.
Notes
Declarations
Funding
This work was supported by JST-ERATO Grant Number JPMJER1201, Japan. This study does not express the view of these institutions in the design of the study and collection, analysis, and interpretation of data.
Availability of data and materials
The original citation data are publicly available from http://snap.stanford.edu/data/cit-HepTh.html. Our code and implementation are publicly available from https://github.com/Azzaare/multiplex-carbonara. Processed network data are available under the Tulip.tlpx format at https://github.com/Azzaare/multiplex-carbonara/tree/master/network_data. Individual subgraph data to be explored with Detangler are available at https://github.com/Azzaare/multiplex-carbonara/tree/master/detangler_data. Tulip is available at http://tulip.labri.fr/. Detangler is available at https://github.com/renoust/Detangler/tree/demo, with the online tool at http://164.132.58.138:1723/. All URLs were last accessed on 13/03/2017.
Authors’ contributions
BR and JFB designed the framework and experiments. BR with an emphasis on multiplex networks and JFB on algorithms. VC and BR carried out the implementation. BR carried out the final experiments and drafted the document with the help of JFB. All authors read and approved the final manuscript.
Authors’ information
BR is a post-doctoral researcher at the National Institute of Informatics (NII), Japan, and at the CNRS UMI 3527 Japanese-French Laboratory for Informatics (JFLI), Japan. He was a research engineer at the National Audiovisual Institute (Ina) in Paris, France, from 2009 to 2012, and received his PhD in 2014 from the University of Bordeaux, France. His research interests cover network analysis and visualization, and multimedia analytics.
JFB graduated Master course at University Paris XI in 2011 and got Ph.D. from the University of Tokyo in 2015. His main research topic covers modeling of failures and routing in Networks. Other research topics involve Network Flows, Game analysis and AI for Games (in particular Starcraft), but also Local Search algorithm (HPC) and limited memory algorithms. He is currently member of the JST-ERATO Kawarabayashi project on Large Graph (Big Data) in Tokyo/Sendai, Japan, at the National Institute of Informatics (NII), Japan, and at the CNRS UMI 3527 Japanese-French Laboratory for Informatics (JFLI), Japan. VC is currently a graduate student at UC Berkeley, pursuing Master studies in CS. He graduated from Ecole Polytechnique from 2013 to 2016, specializing in CS, and visited the National Institute of Informatics (NII), Japan, from April 2016 to August 2016. His research interests include graph theory and computer vision.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Alkemade, F, Castaldi C (2005) Strategies for the diffusion of innovations on social networks. Comput Econ 25(1–2):3–23.View ArticleMATHGoogle Scholar
- Assad, AA (1978) Multicommodity network flows—a survey. Networks 8(1):37–91.MathSciNetView ArticleMATHGoogle Scholar
- Auber, D (2002) Using strahler numbers for real time visual exploration of huge graphs In: International Conference on Computer Vision and Graphics, vol. 10:1-3, 56–69.. Vaclav Skala Union Agency, Pilsen. http://wscg.zcu.cz/JWSCG/ and http://www.issn.cc/1213-6972.
- Batagelj, V (2003) Efficient algorithms for citation network analysis. CoRR cs.DL/0309023. http://arxiv.org/abs/cs.DL/0309023.
- Berlingerio, M, Coscia M, Giannotti F, Monreale A, Pedreschi D (2013) Multidimensional networks: foundations of structural analysis. World Wide Web 16(5–6):567–593.View ArticleGoogle Scholar
- Boccaletti, S, Bianconi G, Criado R, Del Genio CI, Gómez-Gardenes J, Romance M, Sendina-Nadal I, Wang Z, Zanin M (2014) The structure and dynamics of multilayer networks. Phys Rep 544(1):1–122.ADSMathSciNetView ArticleGoogle Scholar
- Boden, B, Günnemann S, Hoffmann H, Seidl T (2012) Mining coherent subgraphs in multi-layer graphs with edge labels In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Mining, 1258–1266.. ACM, New York. http://doi.acm.org/10.1145/2339530.2339726.
- Bornmann, L, Daniel H (2008) What do citation counts measure? A review of studies on citing behavior. J Doc 64(1):45–80.View ArticleGoogle Scholar
- Bucur, O, Almasan A, Zubarev R, et al. (2015) An updated h-index measures both the primary and total scientific output of a researcher. Discoveries 3(3):e50.View ArticleGoogle Scholar
- Cattuto, C, Quaggiotto M, Panisson A, Averbuch A (2013) Time-varying Social Networks in a Graph Database: A Neo4J Use Case In: First International Workshop on Graph Data Management Experiences and Systems, GRADES ’13, 11:1–11:6.. ACM, New York. doi:10.1145/2484425.2484442, http://doi.acm.org/10.1145/2484425.2484442.
- Chen, P, Redner S (2010) Community structure of the physical review citation network. J Inform 4(3):278–290.View ArticleGoogle Scholar
- Cointet, J, Roth C (2007) How realistic should knowledge diffusion models be?J Artif Soc Soc Simul 10(3):5.Google Scholar
- Cowan, R, Jonard N (2001) Knowledge Creation, Knowledge Diffusion and Network Structure. In: Kirman A Zimmermann J (eds)Economics with Heterogeneous Interacting Agents, 327–343.. Springer Berlin Heidelberg, Berlin. http://dx.doi.org/10.1007/978-3-642-56472-7_20 http://dx.doi.org/10.1007/978-3-642-56472-7_20.View ArticleGoogle Scholar
- Cowan R, Jonard N (2004) Network structure and the diffusion of knowledge. J Econ Dynam Control 28(8):1557–1575.MathSciNetView ArticleMATHGoogle Scholar
- De Domenico, M, Lancichinetti A, Arenas A, Rosvall M (2015) Identifying modular flows on multilayer networks reveals highly overlapping organization in interconnected systems. Phys Rev X 5(1):011027.Google Scholar
- Delest, M, Don A, Benois-Pineau J (2006) Dag-based visual interfaces for navigation in indexed video content. Multimedia Tools Appl 31(1):51–72.View ArticleGoogle Scholar
- Devlin, SJ, Gnanadesikan R, Kettenring JR (1975) Robust estimation and outlier detection with correlation coefficients. Biometrika 62(3):531–545.View ArticleMATHGoogle Scholar
- Dixon, J, Duff MJ, Sezgin E (1992) The coupling of yang-mills to extended objects. Phys Lett B 279(3–4):265–271.ADSMathSciNetView ArticleGoogle Scholar
- Dong, X, Frossard P, Vandergheynst P, Nefedov N (2012) Clustering with multi-layer graphs: A spectral perspective. IEEE Trans Signal Process 60(11):5820–5831.ADSMathSciNetView ArticleGoogle Scholar
- Egghe, L (2006) Theory and practise of the g-index. Scientometrics 69(1):131–152.View ArticleGoogle Scholar
- Ernst, D, Kim L (2002) Global production networks, knowledge diffusion, and local capability formation. Res Pol 31(8):1417–1429.View ArticleGoogle Scholar
- Estrada, E, Gómez-Gardeñes J (2014) Communicability reveals a transition to coordinated behavior in multiplex networks. Phys Rev E 89(4):042819.ADSView ArticleGoogle Scholar
- Flajolet, P, Raoult JC, Vuillemin J (1979) The number of registers required for evaluating arithmetic expressions. Theor Comput Sci 9(1):99–125.MathSciNetView ArticleMATHGoogle Scholar
- Gehrke, J, Ginsparg P, Kleinberg J (2003) Overview of the 2003 kdd cup. ACM SIGKDD Explor Newsl 5(2):149–151.View ArticleGoogle Scholar
- Gibbons, M, Johnston R (1974) The roles of science in technological innovation. Res Pol 3(3):220–242.View ArticleGoogle Scholar
- Gibbons, M, Limoges C, Nowotny H, Schwartzman S, Scott P, Trow M (1994) The New Production of Knowledge: The Dynamics of Science and Research in Contemporary Societies. Sage, 2455 Teller Road, Thousand Oaks, CA 91320.Google Scholar
- Gomez, S, Diaz-Guilera A, Gomez-Gardenes J, Perez-Vicente CJ, Moreno Y, Arenas A (2013) Diffusion dynamics on multiplex networks. Phys Rev Lett 110(2):028701.ADSView ArticleGoogle Scholar
- Herman, I, Marshall MS, Melançon G, Duke DJ, Delest M, Domenger J-P (1999) Skeletal Images as Visual Cues in Graph Visualization. In: Gröller E, Löffelmann H, Ribarsky W (eds)Data Visualization ’99: Proceedings of the Joint EUROGRAPHICS and IEEE TCVG Symposium on Visualization, 13–22.. Springer Vienna, Vienna. doi:10.1007/978-3-7091-6803-5_2 http://dx.doi.org/10.1007/978-3-7091-6803-5_2.
- Hirsch, JE (2005) An index to quantify an individual’s scientific research output. Proc Nat Acad Sci USA 102(46):16569–16572.ADSView ArticleMATHGoogle Scholar
- Hirsch, JE (2010) An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship. Scientometrics 85(3):741–754.View ArticleGoogle Scholar
- Hummon, NP, Dereian P (1989) Connectivity in a citation network: The development of dna theory. Soc Netw 11(1):39–63.View ArticleGoogle Scholar
- Kivelä, M, Arenas A, Barthelemy M, Gleeson JP, Moreno Y, Porter MA (2014) Multilayer networks. J Complex Netw 2(3):203–271.View ArticleGoogle Scholar
- Liu, JS, Lu LY (2012) An integrated approach for main path analysis: Development of the hirsch index as an example. J Am Soc Inform Sci Technol 63(3):528–542.View ArticleGoogle Scholar
- Mueller, M, Bogner K, Buchmann T, Kudic M (2015) Simulating knowledge diffusion in four structurally distinct networks: An agent-based simulation model. Universität Hohenheim, Fakultät Wirtschafts- und Sozialwissenschaften, Stuttgart. http://hdl.handle.net/10419/112745.
- Pendlebury, DA (2009) The use and misuse of journal metrics and other citation indicators. Archivum immunologiae et therapiae experimentalis 57(1):1–11.View ArticleGoogle Scholar
- Podolny, JM, Baron JN (1997) Resources and relationships: Social networks and mobility in the workplace. Am Soc Rev 65(5):673–693.View ArticleGoogle Scholar
- Pósfai, M, Gao J, Cornelius SP, Barabási AL, D’Souza RM (2016) Controllability of multiplex, multi-time-scale networks. Phys Rev E 94(3):032316.ADSView ArticleGoogle Scholar
- Pujari, M, Kanawati R (2015) Link prediction in multiplex networks. NHM 10(1):17–35.MathSciNetView ArticleMATHGoogle Scholar
- Renoust, B, Claver V, Baffier J-F (2017) Flows of knowledge in citation networks. In: Cherifi H, Gaito S, Quattrociocchi W, Sala A (eds)Complex Networks & Their Applications V: Proceedings of the 5th International Complex Networks and their Applications (COMPLEX NETWORKS 2016), 159–170.. Springer International Publishing, Cham. http://dx.doi.org/10.1007/978-3-319-50901-3_13.
- Renoust, B, Melançon G, Munzner T (2015) Detangler: Visual analytics for multiplex networks. Comput Graph Forum 34(3):321–330. http://dx.doi.org/10.1111/cgf.12644.
- Renoust, B, Melançon G, Viaud M-L (2014) Entanglement in Multiplex Networks: Understanding Group Cohesion in Homophily Networks. In: Missaoui R Sarr I (eds)Social Network Analysis - Community Detection and Evolution, 89–117.. Springer International Publishing, Cham. http://dx.doi.org/10.1007/978-3-319-12188-8_5 http://dx.doi.org/10.1007/978-3-319-12188-8_5.
- Reuters, T (2012) The Thomson Reuters Impact Factor. http://thomsonreuters.com/products_services/science/free/essays/impact_factor/.
- Solé-Ribalta, A, Granell C, Gómez S, Arenas A (2015) Information transfer in community structured multiplex networks. Front Phys 3:61. doi:10.3389/fphy.2015.00061.View ArticleGoogle Scholar
- Speidel, L, Takaguchi T, Masuda N (2015) Community detection in directed acyclic graphs. Eur Phys J B 88:203. doi:10.1140/epjb/e2015-60226-y.ADSView ArticleGoogle Scholar
- Strahler, AN (1957) Quantitative analysis of watershed geomorphology. Eos, Trans Am Geophys Union 38(6):913–920.View ArticleGoogle Scholar
- Sugiyama, K, Tagawa S, Toda M (1981) Methods for visual understanding of hierarchical system structures. IEEE Trans Syst Man, Cybernet 11(2):109–125.MathSciNetView ArticleGoogle Scholar
- Van Raan, AFJ (2004) Measuring science. In: Moed HF, Glänzel W, Schmoch U (eds)Handbook of quantitative science and technology research, 19–50.. Springer, Netherlands. doi:10.1007/1-4020-2755-9, http://www.springer.com/in/book/9781402027024.
- Waltman, L (2016) A review of the literature on citation impact indicators. J Informetrics 10(2):365–391.MathSciNetView ArticleGoogle Scholar
- Wuchty, S, Jones BF, Uzzi B (2007) The increasing dominance of teams in production of knowledge. Science 316(5827):1036–1039.ADSView ArticleGoogle Scholar
- Yu, J, Jiang J, Xiang L (2017) Group-based strategy diffusion in multiplex networks with weighted values. Physica A: Stat Mech Appl 469:148–156.MathSciNetView ArticleGoogle Scholar