 Research
 Open Access
 Published:
Courseprerequisite networks for analyzing and understanding academic curricula
Applied Network Science volumeÂ 8, ArticleÂ number:Â 19 (2023)
Abstract
Understanding a complex system of relationships between courses is of great importance for the universityâ€™s educational mission. This paper is dedicated to the study of courseprerequisite networks (CPNs), where nodes represent courses and directed links represent the formal prerequisite relationships between them. The main goal of CPNs is to model interactions between courses, represent the flow of knowledge in academic curricula, and serve as a key tool for visualizing, analyzing, and optimizing complex curricula. First, we consider several classical centrality measures, discuss their meaning in the context of CPNs, and use them for the identification of important courses. Next, we describe the hierarchical structure of a CPN using the topological stratification of the network. Finally, we perform the interdependence analysis, which allows to quantify the strength of knowledge flow between university divisions and helps to identify the most intradependent, influential, and interdisciplinary areas of study. We discuss how courseprerequisite networks can be used by students, faculty, and administrators for detecting important courses, improving existing and creating new courses, navigating complex curricula, allocating teaching resources, increasing interdisciplinary interactions between departments, revamping curricula, and enhancing the overall studentsâ€™ learning experience. The proposed methodology can be used for the analysis of any CPN, and it is illustrated with a network of courses taught at the California Institute of Technology. The network data analyzed in this paper is publicly available in the GitHub repository.
Introduction
An academic curriculum is a complex system of courses and interactions between them that lies at the heart of a university and underlies its educational mission. Understanding a university curriculum as a whole is an important prerequisite for providing students with a high quality education and meaningful learning experiences. Moreover, designing an appropriate curriculum is of great importance not only from an academic point of view, but also for organizational and financial management.
A full list of courses together with their descriptions given in the university catalog allows, at least in principle, to know everything about the curriculum and answer any question about it. However, it is hard to comprehend this raw data, extract actionable knowledge, and make datadriven decisions.
A network, where nodes represent courses and links represent certain relationships between them, is a natural model for conceptualizing, representing, and analyzing a curriculum. For example, links can represent the temporal relationships between courses based on how many students move from one course to another through out their studies (AkbaĹźMI etÂ al. 2015). These temporal networks can be used for forecasting course enrollments, predicting student performance (Slim etÂ al. 2014a), and estimating the relative contribution of courses (Meghanathan 2017). Alternatively, links between courses can reflect the influence that some subjects have on others based on the expert knowledge of the professors. Such influence network models can be used for the curriculum design and recommendations (SimonÂ de Blas etÂ al. 2021).
This paper focuses of the study of courseprerequisite networks (CPNs), where nodes represent courses and directed links represent the formal prerequisite requirements between them listed in the university catalog. Unlike temporal and influence networks, CPNs are objectively defined and, when in a steady state, donâ€™t change substantially from year to year. Over the last decade, CPNs have attracted a lot of interest from researchers due to their key role in the understanding of the complex structure of academic curricula. For example, Slim et al. used CPNs for detecting crucial courses that have a high impact on students progress and graduation rates (Slim etÂ al. 2014b), Aldrich discussed applications of CPNs to advising and curriculum reform (Aldrich 2015), and Molontay et al. introduced a datadriven probabilistic approach for studying the distribution of graduation time based on the CPN topology (Molontay etÂ al. 2020).
In this paper, we propose a general networksciencebased framework for analysis of CPNs and illustrate it with a CPN based on the courses offered at the California Institute of Technology in the 2021â€“2022 academic year. We show that a CPN is an indispensable tool for visualizing, understanding, and optimizing an academic curriculum. It can be used not only for identification of important courses, but also for improving existing and creating new courses. We discuss how students can use a CPN to navigate their complex curriculum, and how a CPN can help faculty and administrators to meaningfully allocate teaching resources, increase interactions between divisions and departments, revamp the curriculum, and enhance the overall studentsâ€™ learning experience.
The proposed framework is based on network science (Newman 2018; Newman etÂ al. 2006; Dorogovtsev 2010; Easley and Kleinberg 2010), which is an interdisciplinary field that emerged at the intersection of graph theory, computational statistics, computer science, and statistical physics. The basic idea of network science is to use a network as a simplified representation of a complex system that captures the pattern of connection between systemâ€™s components and represents its structural skeleton. Networks have been used to represent a variety of social, technological, information, and biological systems consisting of many interconnected, interacting components. Modeling complex systems with networks has proved to be useful for understanding systems as intricate and diverse as the Internet, the world wide web, food webs, power grids, protein interactions, interwoven social groups, and even the human brain.
The rest of the paper is organized as follows. In â€śNetwork representation of university coursesâ€ť section, we define an abstract CPN and basic related notions and describe the Caltech CPN and its giant connected component. In â€śCentrality measuresâ€ť section is dedicated to the identification of important courses and different measures for importance quantification. In â€śTopological stratificationâ€ť section, we construct the topological stratification of a CPN and discuss how the emergent hierarchical structure on the CPN can be used for finding hidden prerequisites and creating comprehensive schedules for different areas of study. In â€śInterdependence analysisâ€ť section, we perform an interdependence analysis of a CPN that provides a birdâ€™s eye view of the whole curriculum and allows to quantify the strength of flow of knowledge from one university division or area of study to another and identify the most intradependent, influential, and interdisciplinary divisions and areas of study. Finally, â€śSummary and discussionâ€ť section concludes with a brief summary and specific recommendations on how students, faculty, and administrators can use the results of the CPN analysis for efficient navigation and optimal enhancement of the curriculum.
Network representation of university courses
The main object of study in this paper is a courseprerequisite network (CPN), which is a directed network that describes interactions between university courses. In a CPN, nodes represent different courses and directed links between nodes represent the courseprerequisite relationships between the corresponding courses. A course X is called a prerequisite for course Y if taking X is required before taking Y. Usually prerequisites cover material that is necessary for understanding more advanced courses. For example, a calculus course is often listed as a prerequisite for a course on differential equations. If X is a prerequisite for Y, then, in the CPN, this is represented by a directed link from node X to node Y. In this case, Y is called a postrequisite of X.
It is convenient to mathematically represent a CPN by its adjacency matrix. If a CPN has n nodes labeled by \(1,\ldots ,n\), then its adjacency matrix is the \(n\times n\) matrix with elements \(A_{ij}\), \(i,j=1,\ldots ,n\), defined as follows:
The adjacency matrices of CPNs are sparse (most of \(A_{ij}\) equal to zero), since a typical course has a small number of prerequisites and serves as a prerequisite to a small number of courses.
As an example, consider a toy curriculum consisting of six courses: A, B, C, X, Y, and Z. The courseprerequisite relationships are summarized in TableÂ 1.
Course X has two prerequisites, A and B, course Y has two prerequisites, B and C, and all other courses have no prerequisites. If a course does not have any prerequisites, like courses A, B, C, and Z, then it can be taken any time. If a course does not have any prerequisites and postrequisites, like course Z, then it is represented by an isolated node, i.e. a node without incoming and outgoing links. FigureÂ 1 shows the CPN induced by the toy curriculum.
The adjacency matrix of the this toy CPN is
A courseprerequisite network represents the flow of knowledge between different courses in a university curriculum. The main goal of this paper is to show how CPNs can be used for visualization of complex curricula, drawing important observations and insights about the courses, and helping students to navigate and faculty and administrators to optimize their curricula.
The methods described here can be applied to the analysis of any CPN. We will illustrate them with a real CPN based on the courses that were offered at the California Institute of Technology (Caltech) in the 2021â€“2022 academic year. The Caltech CPN, consisting of both undergraduate and graduate courses, is shown in Fig.Â 2. All network visualizations in this paper are done in Gephi, an opensource and free network visualization software package (https://gephi.org/). For visual clarity, the network visualization in Fig.Â 2 omits the node labels (course names). A larger and more detailed visualization of the Caltech CPN is shown in Fig.Â 15 in the â€śAppendixâ€ť. The network data is publicly available in the GitHub repository (https://github.com/pstavrin/CoursePrerequisiteNetworks).
Any university curriculum contains courses that are completely independent of each other: they are not prerequisites for each other, not prerequisites for another course, there is not a course which is a common prerequisite for them, etc. This independence between two courses manifests itself in the CPN by the absence of a path between the nodes representing the courses. Independent courses belong to different connected components of the CPN. Technically, a (weakly) connected component of a CPN is a subset of nodes such that for any two nodes in the subset there exists at least one path through the network connecting the nodes, where paths are allowed to go in both ways along any link (the directions of the links are ignored). Each isolated node constitutes a trivial connected component. Isolated nodes usually represent seminars, projects, outreach, and special topics courses. For example, the toy CPN on Fig.Â 1 has two connected components: consisting of nodes {A, B, C, X, Y} and one isolated node Z.
Realworld CPNs have several small connected components and one â€śgiantâ€ť connected component, called the largest connected component (LCC), which contains the largest fraction of nodes, almost all links, and constitutes the most interesting and nontrivial part of a CPN. The LCC of a CPN, denoted by \({\mathcal {G}}\), is the main part of the network, which represents its complex structure and function.
In the Caltech CPN, in addition to isolated nodes, there are 10 connected components represented by different colors in Fig.Â 2 and, in more detail, in Fig.Â 15. All but one are very small, with sizes not exceeding six nodes. The largest connected component \({\mathcal {G}}\) (shown in pink) contains \(n=436\) nodes (57% of all nodes) and \(m=747\) links (97% of all links). In what follows, we focus our analysis on the largest connect component \({\mathcal {G}}\) of the Caltech CPN, which is shown in Fig.Â 16 in the â€śAppendixâ€ť.
Centrality measures
One of the most interesting and intriguing questions about a university curriculum is the following: â€śWhich are the most important courses in the curriculum?â€ť. In other words, â€śWhich are the most important nodes in the CPN?â€ť. Knowing the most important courses, the courses that form the â€śbackboneâ€ť of the curriculum, could help to a) better allocate university resources to provide students with better experiences in these courses and b) inform students about these courses, so that they can pay special attention to them.
There are different ways to define the â€śimportanceâ€ť of a node in a CPN. Here, we will consider three widely used in network science centrality measures, which quantify the node importance: degree, PageRank centrality, and betweenness centrality.
Degree distributions
The total degree of a node is the total number of links connected to it. In directed networks like CPNs, nodes have two kinds of degree: an indegree, the number of incoming links, and an outdegree, the number of outgoing links. The indegree \(k_\text {in}(i)\) of a node i is the number of prerequisites course i has, and the outdegree \(k_\text {out}(i)\) of i is the number of courses for which i is a prerequisite. In terms of the adjacency matrix A, the in and outdegrees of node i are given by
The total degree of node i is then
The indegree of a node measures how specialized the corresponding course is: the larger \(k_\text {in}(i)\) is, the more prerequisites course i has, the more specialized it is. The outdegree, on the other hand, measures how fundamental a course is: the larger \(k_\text {out}(i)\) is, the more courses have i as a prerequisite, the more fundamental course i is. We expect that in realwold CPNs, the in and outdegrees of nodes are negatively correlated. The absolute value of the Pearson correlation coefficient between in and outdegrees of nodes,
can be used to measure the structural difference between fundamental and specialized courses.
To elaborate more on this, consider two extreme cases shown in Fig.Â 3.
In curriculum (a), essentially all courses are structurally equivalent (except for the first and the last one); there are no fundamental and specialized courses. The sequences of in and outdegrees are \(k_\text {in}=(0,1,\ldots ,1)\) and \(k_\text {out}=(1,\ldots ,1,0)\), and the correlation coefficient between them is
In curriculum (b), however, there are fundamental courses (bottom row) and specialized courses (top row). These two types of courses are structurally very different: all fundamental courses are prerequisites for all specialized courses. The sequences of in and outdegrees are \(k_\text {in}=(0,\ldots ,0,n/2,\ldots ,n/2)\) and \(k_\text {out}=(n/2,\ldots ,n/2,0,\ldots ,0)\), and the correlation coefficient between them is
In realworld CPNs, the correlation coefficient \(\rho _\text {in,out}\in (1,0)\), and its magnitude \(\rho _\text {in,out}\) quantifies the structural â€śgapâ€ť between fundamental and specialized courses: the larger \(\rho _\text {in,out}\) is, the more significant the split of the curriculum into fundamental and specialized courses.
FigureÂ 4 shows the histograms of in, out, and total degrees in the LCC \({\mathcal {G}}\) of the Caltech CPN.
All degree distributions are rightskewed and have long right tails. A network is called scalefree, a term coined in the seminal paper (BarabĂˇsi and Albert 1999), if its degree distribution follows a powerlaw,
where \({\mathbb {P}}(k)\) is the probability that a node chosen uniformly at random has degree k, \(k_{\text {min}}\) is the lower cutoff for the scaling region, and \(\gamma\) is the powerlaw exponent. Many realworld networks are approximately scalefree, with the powerlaw exponent typically in the range \(2<\gamma <3\) (Newman 2018). For example, both the in and outdegrees of the World Wide Web approximately follow powerlaw distributions with \(\gamma _{\text {in}}=2.1\) and \(\gamma _{\text {out}}=2.7\) (Broder etÂ al. 2000). For the LCC \({\mathcal {G}}\) of the Caltech CPN, the hypothesis test for discerning and quantifying powerlaw behavior in empirical data developed in Clauset etÂ al. (2009) accepts the hypothesis that the total degree distribution (right panel in Fig.Â 4) approximately follows a powerlaw, but rejects that hypothesis for the in and outdegrees. The maximumlikelihood fitting method developed in Clauset etÂ al. (2009) estimates the powerlaw exponent \(\gamma\) and the lower cutoff \(k_{\text {min}}\) as follows:
Most courses in \({\mathcal {G}}\) (74%) have one or two prerequisites (left panel in Fig.Â 4) and many (63%) are â€śdead ends,â€ť i.e. they do not serve as prerequisites for other courses (middle panel in Fig.Â 4). The average in, out, and total degrees are (note that always \(\bar{k}_\text {in}=\bar{k}_\text {out}=\bar{k}/2\)):
The Pearson correlation coefficient between in and outdegrees of nodes is
It is instructive to see how exactly the in and outdegrees contribute to the total degrees of nodes. Let \({\mathcal {G}}_d\subset {\mathcal {G}}\) be the subset of nodes with total degree d and \(n_d\) be the number of nodes in \({\mathcal {G}}_d\),
Then for any node in \({\mathcal {G}}_d\) the sum of its in and outdegrees is exactly d,
Let \(\bar{k}_\text {in}^{(d)}\) and \(\bar{k}_\text {out}^{(d)}\) be the average in and outdegrees of nodes in \({\mathcal {G}}_d\),
Then, by averaging (13) over all nodes \(i\in {\mathcal {G}}_d\), we have
for any total degree d. FigureÂ 5 shows the decomposition of the total degree d into the in and out components \(\bar{k}_\text {in}^{(d)}\) and \(\bar{k}_\text {out}^{(d)}\).
In all subsets \({\mathcal {G}}_d\subset {\mathcal {G}}\) for \(d>5\), \(\bar{k}_\text {out}^{(d)}\) strongly dominates \(\bar{k}_\text {in}^{(d)}\) and contributes the most to the total degree d. The indegree component can be viewed as a â€śnoiseâ€ť added to the outdegree component.
Tables 2, 3, and 4 list the top courses with respect to the in, out, and total degrees.
As expected, the top indegree nodes in TableÂ 2 include some of the most specialized courses offered at Caltech. These courses are often at the graduate level and require a considerable amount of previous coursework in order to be taken. The top outdegree nodes in TableÂ 3 correspond to some of the most fundamental courses in mathematics, physics, biology, and chemistry that serve as prerequisites for many other courses. Note that some of these courses, such as MaÂ 1 and PhÂ 1, are introductory and elementary, but some, such as ACMÂ 95/100, ACMÂ 116, and PhÂ 125 are relatively advanced. These advanced courses serve as the basis for even more advanced courses, often at the graduate level. TableÂ 4 follows the order of TableÂ 3 closely. This confirms the dominance of the outdegree over the indegree established in Fig.Â 5.
Out of the three types of node degree, the outdegree is the most suitable measure of course importance. Any node i in a CPN fully controls its indegree since the instructor who teaches course i can choose which and how many other courses should be listed as prerequisites for i. Therefore, at least in principle, any node can make its indegree as large as the entire network size. The indegree measures the specialization of a course quantified by that single course, but not its importance. The importance of a node should be determined by other nodes, not by the node itself. This is exactly what happens for the outdegree since its value is determined by other courses: the outdegree of node i is the number of other courses that decide to require i as a prerequisite and establish links from i to them. A node can â€ścontrolâ€ť its outdegree only by being important for other nodes.
PageRank centrality
The outdegree is a simple and easily interpretable measure of course importance, but it has limitations and drawbacks. The outdegree of course i gives it one â€śimportance pointâ€ť for every other course j that lists i as its prerequisite, but it does not take into account whether j itself is an important course or not. As an example, consider two courses, A and B, in Fig.Â 6.
The outdegree does not distinguish between these two courses and calls them equally important since \(k_\text {out}(\text {A})=k_\text {out}(\text {B})=1\). Intuitively, however, course B is more important than A, since B is a prerequisite for Y, and Y has a larger outdegree than X (i.e., gives students more options for future coursework). Hence, the importance of a course i is not only about how many courses use i as a prerequisite, but also about how important the postrequisites of i are.
This idea is implemented in the PageRank centrality measure (Page etÂ al. 1999), which is a key ingredient of the Google search engine (The anatomy 1998). The PageRank centrality \(\pi (i)\) of node i is the sum of two terms. One term is a small amount \(\phi\) of â€śfreeâ€ť importance that all nodes get regardless of their positions in the network. The other term is proportional to the sum of the PageRank centralities of iâ€™s postrequisites, normalized by their indegrees, so that
A course j contributes to \(\pi (i)\) if and only if \(A_{ij}=1\), i.e. i is a prerequisite for j (equivalently, j is a postrequisite for i). Dividing \(\pi (j)\) by \(k_{\text {in}}(j)\) allows to prevent j from being too influential by increasing the number of its prerequisites and, thus, contributing to \(\pi (i)\) for many i. Any course j that adopts this strategy of requiring many prerequisites will indeed contribute to many PageRank centralities \(\pi (i)\), but its contribution \(\pi (j)/k_{\text {in}}(j)\) will be small, since its indegree \(k_{\text {in}}(j)\) will be large. The damping factor \(\alpha \in (0,1)\) controls the relative contributions to \(\pi (i)\) from the network structure and â€śfree centrality.â€ť If \(\alpha =0\), then \(\pi (i)=\phi\) for all nodes, which corresponds to the ultimately egalitarian case, where all nodes are equally important and network structure plays no role in determining node importance. As \(\alpha\) increases, the influence of the network structure becomes stronger. The value of damping factor is usually set to \(\alpha =0.85\), which is found to give good results (The anatomy 1998). The constant term \(\phi\) ensures that any course i with zero outdegree, i.e. a â€śdead endâ€ť with \(A_{ij}=0\) for all j, still gets a nonzero centrality \(\pi (i)=\phi \ne 0\). This allows dead ends to contribute to PageRank centralities of their prerequisites.
It can be shown (e.g. Newman 2018, section 7.1.4) that system (16) of n equations has a unique solution, and the vector \(\pi =(\pi (1),\ldots ,\pi (n))^\top\) of PageRank centralities is given by
where I is the \(n\times n\) identity matrix, \({\textbf{1}}=(1,\ldots ,1)^\top\) is the \(n\times 1\) vector of ones, and \(K_{\text {in}}\) is the diagonal matrix with diagonal elements \(K_{ii}=\max \{k_{\text {in}}(i),1\}\). A nonzero value of \(\phi\) guarantees that \(\pi \ne 0\), but the exact value of \(\phi\) does not affect the ranking based on PageRank centralities. This observation allows to conveniently set \(\phi =1\), and get
It is worth mentioning that in the original definition of the PageRank centrality (16), \(A_{ji}\) and \(k_{\text {out}}(j)\) are used instead of \(A_{ij}\) and \(k_{\text {in}}(j)\), respectively. As a result, in (18), \(A^\top\) and \(K_{\text {out}}\) appear instead of A and \(K_{\text {in}}\). The reason for that is that the original version of PageRank was developed for the World Wide Web (WWW), where nodes (web pages) can control their outgoing links (hyperlinks to other web pages) but cannot control their incoming links (hyperlinks from other web pages), and where the importance of nodes is derived from incoming links. For CPNs the situation is exactly the opposite, and the roles of incoming and outgoing links, compared to the WWW, are switched. Therefore, (16) and (18) represent PageRank adapted to CPNs. The PageRank centralities of CPN nodes can be computed by using the standard PageRank method and applying it to \(A^\top\), the transpose on CPNâ€™s adjacency matrix A. In this paper, all centrality measures are computed in NetworkX, a Python package for analysis of complex networks (https://networkx.org/).
FigureÂ 7 shows the largest connected component \({\mathcal {G}}\) of Caltechâ€™s CPN, where the size of node i is proportional to its PageRank centrality \(\pi (i)\). TableÂ 5 lists the top 12 courses with respect to PageRank.
It is interesting to compare the top 12 outdegree courses in TableÂ 3 with the top 12 PageRank courses in TableÂ 5. The first observation is that 10 out of 12 courses are present in both tables. This suggests that, similar to the outdegree, the PageRank centrality measures how fundamental a course is. However, among those 10 common courses, PageRank tends to rank higher courses that are more introductory. For example, PageRank prefers MaÂ 1 to MaÂ 2, PhÂ 1 to PhÂ 2, ChÂ 1 to ChÂ 41, and CS 1 to CS 2, while outdegree prefers MaÂ 2 to MaÂ 1, PhÂ 2 to PhÂ 1, ChÂ 41 to ChÂ 1, while CS 2 does not appear in the top 12 with respect to outdegree. The second course that made it to the top 12 according to PageRank but not according to outdegree is MaÂ 5, â€śIntroduction to Abstract Algebra.â€ť The outdegree of MaÂ 5 is 11, and 3 out of its postrequisites have positive outdegrees (see the bottom right tail of a network in Fig.Â 18). This is also a case where PageRank can highlight certain characteristics of a university. Caltechâ€™s Mathematics department is very algebra oriented, with a lot of research carried out in algebraic fields and a lot of courses offered in advanced algebra topics. Due to this, Ma 5 is listed as a prerequisite for all such courses, thus boosting its place in the PageRank rankings.
PageRankâ€™s preference towards fundamental introductory courses can be explained as follows. A course has a high PageRank centrality if it is either fundamental (has large outdegree) or less fundamental but serves as a prerequisite for fundamental courses. Consider now two courses in a CPN, A and B, which are approximately equally fundamental, \(k_{\text {out}}(\text {A})\approx k_{\text {out}}(\text {B})\). If A is more introductory than B, then directed paths in the CPN starting from A are expected to be longer than directed paths starting from B. As a result, the postrequisites of A are likely to have higher PageRank scores than the postrequisites of B and, therefore, A is likely to have a higher PageRank than B, \(\pi (\text {A})>\pi (\text {B})\).
Overall, in CPNs, the PageRank centrality measures how fundamental a course is and favors more introductory courses.
Betweenness centrality
A courseprerequisite network represents the flow of knowledge between different courses in a university curriculum, where knowledge â€śflowsâ€ť along directed paths in the CPN from less to more advanced courses. A course with a small degree and low PageRank can still be important and influential if it occupies a dominant position with respect to the paths in the CPN. As an example, consider a course X in Fig.Â 8.
Although this course has small in and outdegrees and is poorly connected to the rest of the CPN, it serves as a bridge between two subsets of courses. Any path from the left subset to the right must go through course X. This gives X control over the flow of knowledge between other courses and makes it important.
This notion of importance is formalized in the betweenness centrality (Anthonisse 1971; Freeman 1977). Mathematically, the betweenness centrality \(\beta (i)\) of node i in a CPN is defined as follows. Let \(\sigma (s,t)\) be the total number of shortest paths from node s to node t, and \(\sigma (s,ti)\) be the number of shortest paths from s to t that pass through node i. All paths are understood as directed paths that go along directed links. Note that if \(\sigma (s,t)>0\), i.e. there exists a path from s to t, then \(\sigma (t,s)=0\), since a CPN does not have loops. The betweenness centrality of node i is
where the sum is over all nodes s,Â t in the CPN that are different from i, with a convention that if \(\sigma (s,t)=\sigma (s,ti)=0\), then \(\sigma (s,ti)/\sigma (s,t)=0\). For example, the betweenness of course X in Fig.Â 8 is \(\beta (\text {X})=49\). For a connected pair of nodes (s,Â t), i.e. for nodes with \(\sigma (s,t)\ne 0\), the ratio \(\sigma (s,ti)/\sigma (s,t)\) can be interpreted as the probability that a shortest path from s to t, chosen uniformly at random from all shortest paths from s to t, passes through i.
The betweenness centrality quantifies the degree to which a node is located between other nodes. If a node has zero indegree (â€śsourceâ€ť) or zero outdegree (â€śsinkâ€ť or â€śdead endâ€ť), then, by definition (19), its betweenness is zero,
For courseprerequisite networks, betweenness has the following interesting interpretation. Courses with high betweenness are intermediatelevel courses that serve as critical bridges between less and more advanced courses. Removing them from a CPN (by halting their teaching) would greatly disrupt the flow of knowledge in the CPN.
FigureÂ 9 shows the LCC \({\mathcal {G}}\) of Caltechâ€™s CPN, where the size of node i is proportional to its betweenness centrality \(\beta (i)\). TableÂ 6 lists the top 12 courses with respect to the betweenness.
As expected, all high betweenness courses are important intermediatelevel courses that equip students with fundamental (but not elementary) concepts and tools in mathematics, physics, chemistry, and computer science, in preparation for more advanced courses. Interestingly, many high betweenness courses are interdisciplinary. For example, ChÂ 21 combines physics and chemistry, ACMÂ 95/100 teaches methods of applied mathematics (complex analysis, ordinary differential equations, partial differential equations) for the physical sciences, and ACMÂ 116 is a course on probability models for science and engineering students. This suggests that courses with high betweenness do not only serve as bridges between less and more advanced courses, but are also likely to be interdisciplinary and combine different traditional academic disciplines.
Among the top 12 PageRank courses in TableÂ 5 and top 12 betweenness courses in TableÂ 6, there are 4 courses that appear in both tables: PhÂ 125, PhÂ 2, ACMÂ 95/100, and MaÂ 2. These are important, fundamental courses at the intermediate level. The presence of courses with high values of both centrality measures suggests that PageRank and betweenness are positively correlated. Indeed, for the Caltech CPN the Pearson correlation coefficient between PageRank and betweenness is
FigureÂ 10 shows the scatter plot of the two centrality measures. There is a noticeable positive correlation between PageRank and betweenness, especially for courses with large values of PageRank or betweenness. This means that courses which are important with respect to one centrality measure tend to be also important with respect to the other.
To better visualize the interplay between PageRank and betweenness, Fig.Â 11 shows the LLC \({\mathcal {G}}\) of the Caltech CPN, where node size is proportional to nodeâ€™s betweenness and the color intensity is proportional to nodeâ€™s PageRank, so that large dark nodes are important with respect to both centrality measures. As expected in view of (21), on average, larger nodes tends to be darker. One notable exception is the small dark node in the middle of Fig.Â 11, which corresponds to MaÂ 1, Freshman Math. It has the highest PageRank in \({\mathcal {G}}\), but its betweenness is zero since its indegree is zero.
Topological stratification
A courseprerequisite network is a directed network with a special property: it does not have cycles (or loops). A cycle is a closed directed path, i.e. a path that starts and ends at the same node and goes along links only in their forward direction. Absence of cycles means that if there is a directed path from node i to node j, then there is no a directed path from j to i. A directed network without cycles is called a directed acyclic graph (DAG).
Directed acyclic graphs constitute an important class of directed networks and have many scientific, statistical, and computational applications in various fields. Examples of complex systems which are modeled as DAGs include citation networks (Radicchi etÂ al. 2012), where nodes represent academic papers and links represent citations between them, and food webs (Dunne etÂ al. 2002), where nodes represent species in an ecosystem and links represent predatorâ€“prey relationships. In the causal set approach to quantum gravity, DAGs are used to describe the discrete structure of spacetime (Bombelli etÂ al. 1987). Bayesian networks (Cowell etÂ al. 1999) and feedforward neural networks (Goodfellow etÂ al. 2016), which are widely used in causal inference and machine learning, are other important examples of directed acyclic graphs.
The underlying reason why any CPN is a DAG is that CPN nodes representing courses are partially timeordered: any course can be taken only after its prerequisites have been taken. Existence of a cycle \(i\rightarrow j \rightarrow k\rightarrow \ldots \rightarrow i\) would mean that course i is an indirect prerequisite for itself and, therefore, i can be taken only after i has been taken, which is absurd. The acyclic structure of a CPN is thus a direct corollary of the timeordering. The timeordering is partial since if nodes i and j are not connected by a directed path, i.e. neither course serves as an indirect prerequisite for the other, then courses i and j can be taken in any order.
The acyclic structure of a DAG allows to topologically order its nodes. A topological ordering of a directed network is an ordering of its nodes \(i_1<i_2<\ldots <i_n\) such that for each link \(i_k\rightarrow i_m\) from node \(i_k\) to node \(i_m\), we have \(i_k<i_m\), i.e. \(i_k\) appears before \(i_m\) in the ordering. To illustrate this definition, consider a DAG on Fig.Â 12.
This graph has several topological orderings. For example,
are two of them. It can be shown that a directed network has a topological ordering if and only if it is a DAG, and the topological ordering is unique if and only if the network has a Hamiltonian path (a directed path that visits each node exactly once) (Sedgewick and Wayne 2011). Realworld CPNs do not have Hamiltonian paths, since otherwise would imply that for any pair of courses one is an indirect prerequisite for the other, which is not realistic. As a result, realworld CPNs allow multiple topological orderings.
A topological ordering of a CPN is a traversal of the network in which each course is visited only after all its prerequisites have been visited. This linear ordering yields a ranking of CPN nodes. The ranking induced by a topological ordering has, however, a serious drawback: it imposes a total order on partially ordered CPN nodes by arbitrary ordering topologically equivalent nodes, i.e. nodes that are not connected by a directed path (courses that are not indirect prerequisites for each other) (Zinoviev 2018). This drawback stems from the nonuniqueness of topological ordering. For example, the first topological ordering in (22) ranks D higher than A, and the second ordering ranks A higher than D, although A and D are topologically equivalent.
The arbitrariness of ranking can be remedied as follows. Instead of imposing a total order on CPN nodes, we can partition the nodes into disjoint subsets, or strata, of topologically equivalent nodes. The last stratum \({\mathcal {S}}_T\) is a subset of nodes with zero outdegree, i.e. the most advanced courses without any postrequisites (sinks or dead ends). The second to last stratum \({\mathcal {S}}_{T1}\) is obtained by first removing \({\mathcal {S}}_T\) together with their incoming links and then finding nodes with zero outdegree in the remaining network. This process continues until all nodes are assign to their strata and the CPN is partitioned into T strata,
We refer to this ordered partition \(S({\mathcal {G}})\) as the topological stratification of CPN \({\mathcal {G}}\). Each stratum \({\mathcal {S}}_t\) consists of topologically equivalent and unordered nodes, but the partition itself is ordered. For the network in Fig.Â 12, the topological stratification looks as follows:
The process of finding the topological stratification of a CPN resembles a slicing process: the nodes are â€śslicedâ€ť, stratumbystratum, starting from the most advanced courses at the â€śtopâ€ť of the network to the most elementary courses at the â€śbottomâ€ť. There is also an alternative way \(\widetilde{S}\) of partitioning CPN nodes into disjoint subsets of topologically equivalent nodes, which is, in some sense, the reverse of the process described above. Namely, the first subset is a set of nodes with zero indegree. The second subset is obtained by removing the first subset of nodes together with their outgoing links and then finding nodes with zero indegree in the remaining network, and so on. Note that, in general, the partition \(\widetilde{S}({\mathcal {G}})\) obtained by this method is different form the partition (23) obtained via topological stratification. For example, for the network in Fig.Â 12, this alternative method leads to
which is different from (24).
The relationship between the method of topological stratification S and the alternative partitioning method \(\widetilde{S}\) is straightforward. Let \({\mathcal {G}}'\) denote the reverse of \({{\mathcal {G}}}\), i.e. a network obtained from \({{\mathcal {G}}}\) by reversing the directions of all its links. Furthermore, let \(\overleftarrow{\,\,\,}\) be the operation of reversing the order of a partition, i.e.
then
The reason why the topological stratification of \({\mathcal {G}}\) is defined as \(S({\mathcal {G}})\) and not as \(\widetilde{S}({\mathcal {G}})\), that is, why we start from nodes with zero outdegree rather than nodes with zero indegree is the following. While nodes with zero outdegree are indeed advanced courses (all have at least one direct prerequisite and most have many indirect prerequisites), nodes with zero indegree are not necessarily elementary. For example, firstyear graduate courses are quite advanced, but they can have zero indegree in the CPN, since they may not have any formal prerequisites (only informal ones, i.e. â€śknowledge of quantum mechanics and probability theory at the undergraduate level is assumedâ€ť). As it follows from the subsequent discussion, combining those advanced zero indegree courses with truly elementary courses (this is exactly what \(\widetilde{S}\) does) is undesirable.
Topological stratification (23) induces a hierarchical structure on a CPN
where relation \({\mathcal {S}}_{i}\prec {\mathcal {S}}_{i+1}\) means that any course in \({\mathcal {S}}_{i+1}\) can be taken after all courses in \({\mathcal {S}}_{i}\) have been taken. All courses in stratum \({\mathcal {S}}_i\) have approximately the same level of difficulty, and they are more advanced than courses in the previous stratum \({\mathcal {S}}_{i1}\) and less advanced than courses in the next stratum \({\mathcal {S}}_{i+1}\). So, topological stratification of a CPN allows to view the hierarchy of the whole university curriculum with respect to the level of advancement.
Topological stratification describes the â€śmesoscaleâ€ť (intermediatescale) organization of courseprerequisite networks or, more generally, directed acyclic graphs. Other types of mesoscale structures in complex networks include community structure (Girvan and Newman 2002; Porter etÂ al. 2009; Fortunato 2010) that identifies densely connected groups of nodes (â€ścommunitiesâ€ť) that are sparsely connected between each other, coreperiphery structure (Holme 2005; Csermely etÂ al. 2013; Rombach etÂ al. 2014) that divides a network into a densely connected core and a sparser periphery that is well connected to the core, and the kcore decomposition (AlvarezHamelin etÂ al. 2005) together with its refinement, the onion decomposition (HĂ©bertDufresne etÂ al. 2016), that partition a network into a sequence of nested cores. A common feature of all these mesoscale structures is that they partition the network nodes into a collection of subsets with respect to a certain criterion. For the aforementioned structures, this criterion quantifies the density/sparsity of links between nodes or the â€ścorenessâ€ť of the nodes. For the topological stratification, which is defined only for DAGs, this criterion is the topological equivalence of nodes, that is, the absence of directed paths between them. In the context of CPNs, the topological stratification yields subsets of courses of approximately the same level of difficulty that are not indirect prerequisites of each other.
TableÂ 10 in the â€śAppendixâ€ť shows the topological stratification of the LLC \({\mathcal {G}}\) of Caltechâ€™s CPN obtained by using Python module (https://pypi.org/project/toposort/). The resulting stratification has \(T=7\) strata, starting with the most elementary undergraduate courses and building up to the most advanced courses, often at the graduate level.
The topological stratification provides a hierarchical representation of the curriculum, which can be used by students for making more informed choices about what courses they can and should take to move up a level in the hierarchy. Moreover, the topological stratification unveils hidden prerequisites, i.e. courses that are not explicitly listed as official prerequisites for a given course, but would be beneficial if completed before taking the course. For example, ACMÂ 104 (Applied Linear Algebra) is placed in the stratum below ACMÂ 95/100 (Methods of Applied Math),
The list of official prerequisites for ACMÂ 95/100 does not contain ACMÂ 104. However, relation (29) suggests that ACMÂ 104 should be taken before ACMÂ 95/100. This makes sense because ACM 95/100 covers ordinary and partial differential equations, and being familiar with the fundamental concepts of linear algebra such as linear dependence and independence, span, basis, eigenvalues, eigenvectors, and matrix theory is extremely helpful. These topics are covered to some degree in \(\text {Ma~1~abc}\in {\mathcal {S}}_1\), which is an official prerequisite for ACMÂ 95/100, but in ACMÂ 104 they are discussed at a deeper level. The first author, who took both courses, and the second author, who teaches both courses, confirm that ACMÂ 95/100 is a more advanced course, and it would indeed be beneficial to take ACMÂ 104 before taking ACMÂ 95/100.
The hierarchical structure (28) induces a comprehensive schedule in which students can take courses offered by their major department. Let \({\mathcal {M}}\subset {\mathcal {G}}\) be a subset of courses offered by a specific major, such as â€śACMâ€ť (Applied and Computational Mathematics) or â€śIDSâ€ť (Information and Data Sciences). Then (28) reduced on \({\mathcal {M}}\) gives
This reduced hierarchy suggests that students interested in a deep and thorough understanding of their major should first take courses from \({\mathcal {S}}_1\cap {\mathcal {M}}\), then courses from \({\mathcal {S}}_2\cap {\mathcal {M}}\), etc. Courses from \({\mathcal {S}}_t\cap {\mathcal {M}}\) can be taken in any available order and, perhaps, complemented with other relevant courses from \({\mathcal {S}}_t\). This schedule guarantees that all prerequisites from \({\mathcal {M}}\) are satisfied before taking a course that is higher in the hierarchy. Furthermore, as demonstrated above, the comprehensive schedule can recommend hidden prerequisites and provide students who adopt it with confidence that they are as prepared as possible for taking more advanced courses.
Courses that belong to the same stratum \({\mathcal {S}}_t\) are topologically equivalent and generally offered by different university departments. They can be viewed as the building blocks for all courses in \({\mathcal {S}}_{t'}\) for all \(t'>t\), which are also offered by different departments. This creates an intriguing interdependence between departments, which is investigated in the next section.
Interdependence analysis
The term interdisciplinary has become almost synonymous with contemporary research. New research areas constantly emerge through the interaction between two or more academic fields. For example, the recent development of computational, information, and data sciences has allowed for computational thinking and methods to be integrated with numerous traditional academic disciplines, giving rise to new, interdisciplinary fields. To successfully work in the emerging interdisciplinary areas, scientists need to have a broad skillset and should be able to collaborate with colleagues from different departments. Since one of the main goals of modern universities is to prepare the new generation of scientists, we expect this trend to manifest itself in university curricula as well, reflecting the interdisciplinary nature of contemporary science, engineering, and technology. To quantify the degree to which this is the case, we turn to what we refer to as an interdependence analysis.
Interdependence encapsulates whether, and to what extent, courses in one area of study have prerequisites from other areas. For example, a course on algorithms offered by the computer science department may have a discrete math prerequisite offered by the mathematics department. Interdependence also demonstrates the flow of knowledge from one area of study to another, and shows what â€śexternalâ€ť areas a student is expected to be familiar with in order to study a chosen academic discipline. To formalize this in the context of CPNs, we first need to identify the existing areas of study within the university. For the Caltech CPN, we consider 6 academic divisions (TableÂ 7) that offer courses in 25 areas of study, formalized in the corresponding degree options, (TableÂ 8).
Two important remarks regarding the divisions listed inÂ TableÂ 7 are in order. First, although CMSdiv is officially a department in the EAS division, we consider it as a separate standalone division for the purposes of interdependence analysis. The reason is twofold: (a) while other EAS departments focus on applied science and engineering, CMSdiv revolves around computational and mathematical sciences, and (b) EAS considered together with CMSdiv would be too large, making the interdependence analysis at the division level meaningless. It is also important to distinguish between CMSdiv and CMS: CMSdiv is a division and CMS is one of the areas of studies offered by CMSdiv. Second, Caltech has an additional division, HSS (Humanities & Social Sciences), which is excluded from the interdependence analysis because almost all its courses have no prerequisites and postrequisites, i.e. they are isolated nodes in the Caltech CPN and are not in the LCC \({\mathcal {G}}\).
We define the interdependence between areas of study and between academic divisions as follows. Let \({\mathcal {D}}\) be the set of all divisions and \({\mathcal {A}}\) be the set of all areas of study within the university. For every area of study \(a\in {\mathcal {A}}\) there exists a division \(d\in {\mathcal {D}}\) that offers courses in that area, denoted \(a\in d\). For example, \(\text {Ma}\in \text {PMA}\) and \(\text {Bi}\in \text {BBE}\). Let \({\mathcal {C}}_a\subset {\mathcal {G}}\) be the set of all courses in area \(a\in {\mathcal {A}}\). In terms of the CPN nodes,
where \(a_i\) is the area of node (course) i, e.g. the areas of ACMÂ 104 and IDSÂ 157 are ACM and IDS, respectively. The number of courses in \({\mathcal {C}}_a\) is denoted by \({\mathcal {C}}_a\).
Furthermore, let \({\mathcal {C}}_a^+\subset {\mathcal {G}}\) be the multiset of all postrequisites of \({\mathcal {C}}_a\). That is, \({\mathcal {C}}_a^+\) consists of all courses that are pointedto by the courses in \({\mathcal {C}}_a\), and (this is the difference between a â€śsetâ€ť and a â€śmultisetâ€ť) each course can occur more than once. As an example, consider the toy CPN in Fig.Â 1, and let the top row of courses represent the area of study \(a=\{\text {A}, \text {B}, \text {C}\}\). Then, \({\mathcal {C}}_a^+=\{\text {X},\text {X},\text {Y},\text {Y}\}\). Defining \({\mathcal {C}}_a^+\) as a multiset allows to capture the number of times other areas ask for knowledge from area a.
Finally, let \({\mathcal {C}}_{aa'}^+\subset {\mathcal {C}}_a^+\) be a multisubset consisting of courses in \({\mathcal {C}}_a^+\) whose area of study is \(a'\in {\mathcal {A}}\). To measure the dependence of area \(a'\) on area a, we define
where \(\delta\) is the Kronecker delta: \(\delta (x,y)=1\) if \(x=y\) and \(\delta (x,y)=0\) if \(x\ne y\). The quantity under the logarithm has a probabilistic interpretation. The numerator is the total number of existing links from courses in area a to courses in area \(a'\), and the denominator is the maximum possible number of such links. So, if a course \(X_a\) in area a and a course \(X_{a'}\) in area \(a'\) are chosen at random, then \(\exp (1/R^{{\mathcal {A}}}_{aa'})\) is the the probability that there exists a link from \(X_a\) to \(X_{a'}\) in the CPN.
From an informationtheoretic point of view, the nonnegative measure \(R^{{\mathcal {A}}}_{aa'}\ge 0\) is the inverse of the surprisal (MacKay 2003) (also called the Shannon information) of the random event of observing a link from a randomly chosen \(X_a\in {\mathcal {C}}_a\) to a randomly chosen \(X_{a'}\in {\mathcal {C}}_{a'}\). The surprisal measures the level of â€śsurpriseâ€ť of occurring of that random event (existence of the link). As a result, the stronger the dependence of area \(a'\) on area a is, the smaller the surprisal (the larger the number of links from a to \(a'\)), or, equivalently, the larger the measure \(R^{{\mathcal {A}}}_{aa'}\).
The dependence between academic divisions can be defined by analogy with (32). Namely, if \(d,d'\in {\mathcal {D}}\) are two divisions, then the dependence of division \(d'\) on division d can be quantified by
which is the inverse of the information content of the event of observing a link from a random course offered by division d to a random course offered by division \(d'\). As with the areas of study, \(R^{{\mathcal {D}}}_{dd'}\ge 0\), and the larger \(R^{{\mathcal {D}}}_{dd'}\) is, the stronger the dependence of \(d'\) on d.
FigureÂ 13 shows a heatmap visualization and a network representation of the division interdependence matrix \(R^{{\mathcal {D}}}\) for the LCC of the Caltech CPN.
As expected, the diagonal elements \(R^{{\mathcal {D}}}_{dd}\) have relatively large values for all \(d\in {\mathcal {D}}\). This reflects the fact that courses offered by each division are built on top of each other, and more elementary division courses serve as prerequisites for more advanced division courses. The largest value of \(R^{\mathcal {D}}_{dd}\) is for BBE, whose courses are all on biological subjects and are strongly intradependent.
The two most influential divisions, in the sense that all other divisions depend on them, are PMA and CMSdiv. These divisions offer courses on mathematics, physics, and computer science, which serve as crucial prerequisites for science and engineering courses offered by other divisions. Interestingly, the dependence of CMSdiv on PMA is stronger than the dependence of PMA on CMSdiv, which indicates that applied mathematics draws from pure mathematics more than the other way around. The largest clique in the division interdependence network in Fig.Â 13, i.e. the largest subset of fully interconnected nodes, is PMA, CMSdiv, EAS. There is a great flow of knowledge between these three divisions, especially from PMA to CMSdiv and EAS, and from CMSdiv to EAS.
The most interdisciplinary divisions, in the sense that they require knowledge from and depend on most other divisions, are CHCHE, BBE, and GPS. These divisions have a large number of incoming links, contrary to the most influential divisions that have a large number of outgoing links. Being centered around biological, chemical, and geological sciences, CHCHE, BBE, and GPS depend on mathematical methods, computational tools, and physical theories taught in courses offered by other divisions. The converse, however, is not true: PMA and CMSdiv do not have incoming links from CHCHE, GPS or BBE.
Extending the interdependence analysis from the division level to the level of areas of study, Fig.Â 14 shows a heatmap visualization and a network representation of matrix \(R^{{\mathcal {A}}}\) for the LCC of the Caltech CPN. It can be viewed as a finegrained version of Fig.Â 13.
As in the case of divisions, the diagonal elements \(R_{aa}^{{\mathcal {A}}}\) have relatively large values for most \(a\in {\mathcal {A}}\) for a similar reason. Namely, all courses offered in a certain area of study naturally form sequences, where more advanced courses have more elementary courses as prerequisites; this makes the intradependence of the area of study strong. The largest value of \(R_{aa}^{{\mathcal {A}}}\) is for IDS (Information and Data Sciences), the newest option introduced at Caltech in 2018, which has a small number of interconnected courses. On the other extreme, a few areas of study, such as Medical Engineering (MedE) and Biochemistry and Molecular Biophysics (BMB), have zero \(R_{aa}^{{\mathcal {A}}}\). These areas are originated at the intersection of more traditional areas, and have a small number of courses, whose prerequisites come from the said traditional areas.
The most influential areas of study in the Caltech CPN with the biggest impact on other areas are Mathematics (Ma), Applied and Computational Mathematics (ACM), Physics (Ph), and Computer Science (CS). All these areas belong to the two most influential divisions, PMA and CMSdiv. Outgoing links from the nodes representing these areas reach out to almost all other nodes and form the backbone of the area network in Fig.Â 14. The Ma node plays a unique role in the network: it has the largest number of outgoing links, and yet it is the only node that does not have any incoming links. This reflects the fact that many areas depend on mathematics, but mathematics itself does not depend on other areas, at least in the curriculum. The ACM node, an â€śapplied cousinâ€ť of Ma, is also very important for other areas, especially for engineering and physical sciences, but, unlike its â€śpure cousin,â€ť does have a few incoming links. Of particular interest is the interaction between Ph and CS. The main reason behind this interaction is the recent rise of quantum computing, which led to new physics and computer science courses. We expect that, as quantum computing becomes more developed and accessible, the interaction between Ph and CS will become even stronger. The largest clique in the area interdependence network is ACM, CMS and CS, which all belong to CMSdiv.
Among the most interdisciplinary areas of study, i.e. areas with a large number of incoming links, are Aerospace (Ae), Chemical Engineering (ChE), and Geology (Ge). Interestingly, while Ae and ChE also have outgoing links and, thus, have influence on other areas of study, Ge, one of the largest areas at Caltech, has no influence on any other areas.
It is worth mentioning several strong interactions between specialized but related areas. For example, Aerospace (Ae) has a strong impact on Civil Engineering (CE), Mechanical Engineering (ME), Applied Mechanics (AM), and Medical Engineering (MedE). The engineering areas have a significant dependence on Ae because the latter offers important courses on theoretical and computational fluid mechanics which serve as prerequisites for CE, ME, AM, and MedE courses. Other notable interactions include a very strong dependence of Computation & Neural Systems (CNS) on Neurobiology (NB) and the impact of Biology (Bi) on Biological Engineering (BE), CNS and NB.
TableÂ 9 lists the top areas of study with respect to the outdegree, indegree, PageRank and betweenness centralities computed for the area network in Fig.Â 14 with adjacency matrix \(A^{{\mathcal {A}}}\) defined as follows:
Interdisciplinary engineering areas dominate the indegree ranking. The outdegree and PageRank rankings are very similar (like in â€śCentrality measuresâ€ť section) and are dominated by mathematical and computational areas, the most influential areas in the network. The top five betweenness areas come from four different divisions and they serve as critical bridges in transferring knowledge between various areas of study. The fact that ACM is the only area that appears in the top PageRank and betweenness rankings highlights its prominent role in the entire curriculum.
The interdependence analysis shows that there is a strong flow of knowledge from mathematical, physical, and computational sciences to applied and engineering sciences, or more generally, from more theoretical to more applied fields. On the other hand, the flow of knowledge in the reverse direction is rather weak at both division and areaofstudy levels. This observation manifests itself in the fact that the interdependence matrices \(R^{{\mathcal {D}}}\) and \(R^{{\mathcal {A}}}\) visualized in Fig.Â 13 and Fig.Â 14 are approximately upper triangular. Although there are important â€śfeedbackâ€ť links, such as APh \(\rightarrow\) Ph, EE \(\rightarrow\) ACM, where more theoretical areas draw knowledge form more applied areas, the number of such links is rather small. This suggests that to increase the interdependence of the Caltech curriculum, to make it more balanced and interdisciplinary, new theoretical courses with applied prerequisites are needed. These applied prerequisites could provide important application domains for concepts and methods taught in theoretical courses, thereby giving rise to a healthy interaction between theory and applications in the university curriculum.
Summary and discussion
In this paper, we introduced courseprerequisite networks (CPNs), proposed a general networksciencebased framework for their analysis, and illustrated it with a CPN constructed from courses taught at the California Institute of Technology. Conceptually, a CPN represents the flow of knowledge in a university curriculum. This network can be used for curriculum visualization, finding important insights about courses, helping students to navigate the curriculum, and helping faculty and administrators to optimize it.
First, we focused on the identification of important courses in a given CPN. Since â€śimportanceâ€ť can be defined differently, we considered four different centrality metrics that measure different aspects of importance. The indegree measures how specialized a course is: the larger the indegree, the more prerequisites the course has, and the more specialized it is. The top indegree courses require a lot of preparation, and students should be advised to take these courses towards the end of their studies. The outdegree measures how fundamental a course is: the larger the outdegree, the more postrequisites the course has, and the more fundamental it is. The top outdegree courses are usually the most fundamental courses in mathematics, natural sciences, and computer science, and students should aim at taking these courses as soon as possible. The in and outdegrees are negatively correlated, and the absolute value of the Pearson correlation coefficient between in and outdegrees of nodes can be used a measure of the structural â€śgapâ€ť between fundamental and specialized courses in the CPN.
The outdegree is a more suitable measure of course importance than the indegree, since the outdegree of a course is determined by other courses, while its indegree is determined by the course itself. Similar to the outdegree, the PageRank centrality measures how fundamental a course is, but it favors more introductory courses. Unlike the outdegree, PageRank takes into account not only the number of postrequisites, but also their importance. Finally, betweenness identifies intermediatelevel courses that serve is critical bridges between less and more advanced courses. For the Caltech CPN, we found that PageRank and betweenness are positively correlated, and courses which are important with respect to one of the measures tend to be also important with respect to the other. Courses that are ranked highly by both PageRank and betweenness play a vital role in the university curriculum. Students should be advised to pay special attention to these courses. Maximizing the quality of these courses is the key step in improving the whole curriculum. Administrators should, therefore, prioritize enhancing the quality of courses with high PageRank and betweenness scores by ensuring that these courses are taught well (for example, by hiring dedicated teaching faculty) and students are provided with all necessary resources, such as office hours, recitation sessions, and tutoring support.
Next, we introduced the topological stratification of a CPN, which is the ordered partition of the CPN nodes into disjoint subsets, or strata, of topologically equivalent nodes. The topological stratification of a CPN allows to view the hierarchy of the whole university curriculum with respect to the level of advancement, starting from the most elementary undergraduate courses and building up to the most advanced courses at the graduate level. Students can use these strata to make more informed choices about what courses to take in order to obtain a deeper understanding of their area of study. Furthermore, topological stratification unveils hidden prerequisites, i.e. courses that are not formal prerequisites for a given course, but would be beneficial if completed before taking the course. For each course in the curriculum, a group of faculty and students can examine the list of its identified hidden prerequisites and make a decision on whether to make them formal prerequisites (or list them as highly recommended).
A hierarchical structure (28) on a CPN induced by its topological stratification can be reduced on any specific major or area of study. A group of faculty and students can examine the resulting reduced hierarchy (30) and decide whether it indeed provides an comprehensive learning path for obtaining a thorough understanding of the major. The reduced hierarchy can be also used by undergraduate students as a navigation tool and by their academic advisors as a trusted reference for helping students to choose courses.
Finally, the interdependence analysis provides a birdâ€™s eye view of the whole CPN at the division level (craneâ€™s eye view) and the areaofstudy level (owlâ€™s eye view). It allows to quantify the strength of flow of knowledge from one university division or area of study to another and identify the most intradependent, influential, and interdisciplinary divisions and areas of study. The university administration can use the results of interdependence analysis for optimal allocation ot teaching resources to ensure that divisions and departments, which offer courses that many other divisions and departments depend on, do have adequate means for providing their crucial teaching service. The interdependence networks can help faculty to assess their interactions with other divisions and areas of study and increase these interactions by creating new interdisciplinary courses. Finally, students can also use the interdependence networks to discover how they can branch out into new areas of study. To this end, students should find areas that draw knowledge from their current area of study and take course in those areas. This may lead to the development of new academic interests and interdisciplinary studies.
It is important to highlight that although the proposed methodology for CPN data analysis was illustrated with the Caltech CPN, it is by no means specific to Caltech. In fact, it can be usedâ€”in a straightforward way and in a complete analogy with the considered exampleâ€”for the curriculum analysis of essentially any university. To this end, the following CPN data is required:

(a)
List if nodes, representing course. Depending on the goals of the analysis, this list could be limited to only undergraduate courses, only graduate courses, or, like in the considered example, it could include all courses.

(b)
List of directed links, representing prerequisite relationships. This list can be extracted from the university catalog that contains the description of courses.

(c)
Partition of nodes into academic divisions (or other administrative units, such as departments, schools, and colleges).

(d)
Partition of nodes into areas of study, defined by the degree options.
All real networks evolve with time, and so do courseprerequisite networks. Although the speed of evolution of CPNs is relatively low compared to many other networks, such as the world wide web, citation networks, and online social networks, adding new courses, removing old ones, and establishing new prerequisite relationships between courses may eventually change the structure and quantitative properties of a CPN. To keep up with the CPN evolution and have updated results, the described CPN analysis can be redone on a regular basis, for instance every three to five years, depending on how quickly the CPN changes.
To summarize, a CPN is an indispensable tool for summarizing, visualizing, and analyzing an academic curriculum. It can help to better understand and revamp the curriculum, detect important courses, improve existing and create new courses, meaningfully allocate teaching resources, increase interdisciplinary interactions between various university units, and enhance the overall student learning experience.
Availability of data and materials
The network data analyzed in this study is available in the GitHub repository, https://github.com/pstavrin/CoursePrerequisiteNetworks
References
AkbaĹź MI, Basavaraj P, Georgiopoulos M, Garibay Ă–, Garibay I (2015) Curriculum GPS: an adaptive curriculum generation and planning system
Aldrich PR (2015) The curriculum prerequisite network: modeling the curriculum as a complex system. Biochem Mol Biol Educ 43(3):168â€“180. https://doi.org/10.1002/bmb.20861
AlvarezHamelin J, Dallâ€™Asta L, Barrat A, Vespignani A (2005) Large scale networks fingerprinting and visualization using the kcore decomposition. In: Weiss Y, SchĂ¶lkopf B, Platt J (eds) Advances in neural information processing systems, vol 18
Anthonisse JM (1971) The rush in a directed graph. Technical report BN 9/71. https://ir.cwi.nl/pub/9791
BarabĂˇsi AL, Albert R (1999) Emergence of scaling in random networks. Science 286(5439):509â€“512. https://doi.org/10.1126/science.286.5439.509
Bombelli L, Lee J, Meyer D, Sorkin RD (1987) Spacetime as a causal set. Phys Rev Lett 59:521â€“524. https://doi.org/10.1103/PhysRevLett.59.521
Brin S, Page L (1998) The anatomy of a largescale hypertextual web search engine. Comput Netw ISDN Syst 30(1):107â€“117. https://doi.org/10.1016/S01697552(98)00110X
Broder A, Kumar R, Maghoul F, Raghavan P, Rajagopalan S, Stata R, Tomkins A, Wiener J (2000) Graph structure in the web. Comput Netw 33(1):309â€“320. https://doi.org/10.1016/S13891286(00)000839
CaltechCatalog. https://catalog.caltech.edu/archive/202122/
Clauset A, Shalizi CR, Newman MEJ (2009) Powerlaw distributions in empirical data. SIAM Rev 51(4):661â€“703. https://doi.org/10.1137/070710111
Cowell RG, Dawid AP, Lauritzen SL, Spiegelhalter DJ (1999) Probabilistic networks and expert systems. Springer, New York. https://doi.org/10.1007/b97670
Csermely P, London A, Wu LY, Uzzi B (2013) Structure and dynamics of core/periphery networks. J Complex Netw 1(2):93â€“123
Dorogovtsev SN (2010) Lectures on complex networks. Oxford University Press, Oxford
Dunne JA, Williams RJ, Martinez ND (2002) Foodweb structure and network theory: the role of connectance and size. Proc Natl Acad Sci 99(20):12917â€“12922. https://doi.org/10.1073/pnas.192407699
Easley DA, Kleinberg JM (2010) Networks, crowds, and markets: reasoning about a highly connected world. Cambridge University Press, Cambridge
Fortunato S (2010) Community detection in graphs. Phys Rep 486(3):75â€“174
Freeman LC (1977) A set of measures of centrality based on betweenness. Sociometry 40(1):35â€“41. https://doi.org/10.2307/3033543
Gephi: the open graph viz platform. https://gephi.org/
Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci 99(12):7821â€“7826
GitHub: a repository with the Caltech CPN data. https://github.com/pstavrin/CoursePrerequisiteNetworks
Goodfellow IJ, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge
HĂ©bertDufresne L, Grochow J, Allard A (2016) Multiscale structure and topological anomaly detection via a new network statistic: the onion decomposition. Sci Rep 6:31708
Holme P (2005) Coreperiphery organization of complex networks. Phys Rev E 72:046111
MacKay DJC (2003) Information theory, inference and learning algorithms. Cambridge University Press, Cambridge
Meghanathan N (2017) Curriculum network graph: relative contribution of courses. Int J Netw Sci 1(3):223â€“247. https://doi.org/10.1504/IJNS.2017.083580
Molontay R, HorvĂˇth N, Bergmann J, SzekrĂ©nyes D, SzabĂł M (2020) Characterizing curriculum prerequisite networks by a student flow approach. IEEE Trans Learn Technol 13(3):491â€“501. https://doi.org/10.1109/TLT.2020.2981331
NetworkX: a python package for network analysis. https://networkx.org/
Newman MEJ (2018) Networks: an introduction. Oxford University Press, Oxford
Newman M, Barabasi AL, Watts DJ (2006) The structure and dynamics of networks. Princeton University Press, Princeton
Page L, Brin S, Motwani R, Winograd T (1999) The PageRank citation ranking: bringing order to the web. Technical report 199966. http://ilpubs.stanford.edu:8090/422/
Porter MA, Onnela JP, Mucha PJ (2009) Communities in networks. Not Am Math Soc 56(9):1082â€“1097
Radicchi F, Fortunato S, Vespignani A (2012) In: Scharnhorst A, BĂ¶rner K, vanÂ den Besselaar P (eds) Citation networks, pp 233â€“257. https://doi.org/10.1007/9783642230684
Rombach MP, Porter MA, Fowler JH, Mucha PJ (2014) Coreperiphery structure in networks. SIAM J Appl Math 74(1):167â€“190
Sedgewick R, Wayne K (2011) Algorithms, 4th edn. AddisonWesley, Boston
Simon de Blas C, Gomez Gonzalez D, Criado Herrero R (2021) Network analysis: an indispensable tool for curricula design. A real casestudy of the degree on mathematics at the URJC in Spain. PLoS ONE 16(3):1â€“21. https://doi.org/10.1371/journal.pone.0248208
Slim A, Heileman GL, Kozlick J, Abdallah CT (2014) Employing Markov networks on curriculum graphs to predict student performance. In: 2014 13th international conference on machine learning and applications, pp 415â€“418. https://doi.org/10.1109/ICMLA.2014.74
Slim A, Kozlick J, Heileman GL, Wigdahl J, Abdallah CT (2014) Network analysis of university courses. In: Proceedings of the 23rd international conference on world wide web, pp 713â€“718. https://doi.org/10.1145/2567948.2579360
Toposort: a python module that implements topological stratification of directed acyclic graphs. https://pypi.org/project/toposort/
Zinoviev D (2018) Complex network analysis in python. Pragmatic Bookshelf, Raleigh
Acknowledgements
We thank Gloria Brewster and Kimberley Mawhinney for providing us with a database of Caltech courses, Eric V. Smith for the valuable help with the toposort module, Justin Bois for useful feedback on the first draft of the paper, and Liza Bradulina and Sophia Zueva for stimulating discussions. We also thank the anonymous reviewers for useful comments and suggestions.
Funding
This work was supported by the Carver Mead Discovery Grant and the Information Science and Technology (IST) initiative at Caltech.
Author information
Authors and Affiliations
Contributions
KZ designed the study, proposed the methods, and supervised the research; PS cleaned the data, created the network and its visualizations, and developed the code; KZ and PS performed research, analyzed the data, and wrote the manuscript; both authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Authorsâ€™ information
PS is a current senior at the California Institute of Technology majoring in Applied and Computational Mathematics, email: pstavrin@caltech.edu. KZ is a Teaching Professor of Computing and Mathematical Sciences at the California Institute of Technology, http://www.its.caltech.edu/~zuev/.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix: Caltech CPN visualizations
Appendix: Caltech CPN visualizations
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Stavrinides, P., Zuev, K.M. Courseprerequisite networks for analyzing and understanding academic curricula. Appl Netw Sci 8, 19 (2023). https://doi.org/10.1007/s4110902300543w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s4110902300543w
Keywords
 Courseprerequisite networks
 Curriculum analytics
 Curriculium complexity
 Directed acyclic graphs
 Network data analysis
 Higher education