Retweet networks of the European Parliament: evaluation of the community structure
© Cherepnalkoski and Mozetič 2016
Received: 15 January 2016
Accepted: 23 February 2016
Published: 1 June 2016
Analyzing information from social media to uncover underlying real-world phenomena is becoming widespread. The goal of this paper is to evaluate the role of Twitter in identifying communities of influence when the ‘ground truth’ is known. We consider the European Parliament (EP) Twitter users during a period of one year, in which they posted over 560,000 tweets. We represent the influence on Twitter by the number of retweets users get. We construct two networks of influence: (i) core, where both users are the EP members, and (ii) extended, where one user can be outside the EP. We compare the detected communities in both networks to the ‘ground truth’: the political group, country, and language of the EP members. The results show that the core network closely matches the political groups, while the extended network best reflects the country of origin. This provides empirical evidence that the formation of retweet networks and community detection are appropriate tools to reveal real-world relationships, and can be used to uncover hidden properties when the ‘ground truth’ is not known.
KeywordsSocial networks Networks of influence Community detection European Parliament
The ever-increasing social media and user-generated contents on the web is an abundant source of data which can provide relevant insight. This work is based on data from Twitter1, a social networking and micro blogging platform with over 300 million monthly active users, posting over 500 million tweets per day.
There are at least two approaches to analyzing the Twitter data: the (social) network analysis, and the contents analysis. In our previous research (Sluban et al. 2015), we combined both approaches. We detected influential communities, identified discussion topics, and determined the sentiment of the communities towards selected topics. However, the question whether the detected communities have corresponding real-world counterparts remained unanswered.
In this paper, we study retweet networks of the Members of the European Parliament and investigate their community structure. In particular, our goal is to determine what the community structure actually reflects. We approach this problem from the perspective of the network theory, which has been applied successfully to characterize a wide variety of complex systems. We show that the network theory is particularly effective at uncovering structure without prior knowledge of political orientation or national membership.
Twitter provides users with opportunities for different forms of interaction. The most prevalent form of interaction is following other users. When a user follows others, the tweets those users post are shown in the follower’s feed. A user can mention other users in a tweet, which brings the tweet to the attention of the users that are mentioned. Closely related to mentions are replies. A user can reply to a specific tweet from another user, engaging her/him in a direct conversation.
Retweets are the form of interaction most characteristic of Twitter as a social network. A user can retweet the tweets posted by other users. By doing this, the user creates another tweet with the exact same content as the original, with an additional attribution to the original tweet. This way, the information about the original author of the tweet is preserved. An idiosyncrasy of retweets is that the original tweet is always attributed in a retweet, eliminating the possibility of retweeting a retweet. When a user retweets a tweet, it is distributed to all her/his followers, just as if it were an originally authored tweet. Users retweet content that they find interesting or agreeable. Retweets have been analyzed in the context of information spreading and cascade formation. Additionally, retweets have been analyzed as a form of influence.
Existing research has analyzed various means of acquiring relevant tweets from the Twitter APIs (Kumar et al. 2015; Morstatter et al. 2013; Sampson et al. 2015) including the Streaming API used in this work, as well as improvements of the acquisition process by modification of queries.
To the best of our knowledge, there has been no previous work on the analysis of retweet networks of the Members of the European Parliament. Nevertheless, there is a considerable body of literature on several aspects relevant to this study.
Conover et al. 2011a predict the political alignment of Twitter users in the run-up to the 2010 US elections based on content and network structure. They analyze the polarization of retweet and mention networks for the same elections (Conover et al. 2011b). Borondo et al. 2012 analyze the user activity during the 2011 Spanish presidential elections. They additionally analyze the 2012 Catalan elections focusing on the interplay between the language and the community structure of the network (Borondo et al. 2014). Most existing research, as Larsson points out (Larsson 2014), focuses on the online behavior of political figures during election campaigns. Hix et al. 2009 investigate the voting cohesion of political groups in the European Parliament. Larsson 2014 examines the Twitter presence of representatives outside of election periods.
Lazer 2011 highlights the importance of the network science approaches in political science at large, since politics is a relational phenomenon at its core. Recent research has adopted the network approach to investigate the structure of legislative work in the US Congress, including committee and subcommittee membership (Porter et al. 2005), bill cosponsoring (Zhang et al. 2008), and roll-call votes (Waugh et al. 2009). In a more recent work, Dal Maso et al. 2014 examine the community structure with respect to political coalitions and government structure in the Italian Parliament.
As previously noted, there are three main modalities in which users on Twitter interact: 1) the user follows posts of other users, 2) the user responds to other user’s tweets by mentioning them or replying to them, and 3) the user forwards interesting tweets by retweeting them. Based on these three interaction types, one can define three measures of influence of a Twitter user: indegree influence (the number of followers, indicating the size of her/his audience), mention influence (the number of mentions of the user, indicating her/his ability to engage others in conversation), and retweet influence (the number of retweets, indicating the ability of the user to write content of interest to be forwarded to others).
Kwak et al. 2010 compare three different network-based measures of influence on Twitter: the number of followers, page-rank, and the number of retweets—finding the ranking of the most influential users differ depending on the measure. Cha et al. 2010 also compare three different measures of influence: the number of followers, the number of retweets, and the number of mentions—also finding that the most followed users do not necessarily score the highest on the other measures. Wang et al. 2010 compare the number of followers and page-rank with a modified page-rank measure that accounts for topic, again finding that ranking depends on the influence measure. Suh et al. 2010 investigate how different factors such as the account age, the use of hashtags and URLs impact the influence of the user measured by the number of retweets. Bakshy et al. 2011 investigate how information spreads on a retweet network and whether there are preconditions for the user to become influential. Boyd et al. 2010 examine retweets as a conversational practice and note that retweeting can be understood both as a form of information diffusion and as a means of participating in a diffuse conversation. Another perspective on Twitter analysis is to detect and focus on specific events instead of the complete time-frame (Kenett et al. 2014).
Along with the small-world phenomenon and power-law degree distribution, the most salient property that real-world networks exhibit is community structure, where network nodes are partitioned together in tightly knit groups, between which there are only loose connections (Girvan and Newman 2002). The identification of the community structure in the network is commonly based on the optimization of its modularity (Newman and Girvan 2004). Identification of communities in social networks is a very vibrant field of research. Many different algorithms exist which employ various approaches (Fortunato 2010). In this work, we perform community detection by the Louvain method, introduced by Blondel 2008, that is found to be among the best performing algorithms in a variaty of domains (Harenberg et al. 2014; Hric et al. 2014).
Evaluation of the community structure is often performed by qualitative comparison to the ground truth (Lužar et al. 2014; Perc 2010). The methodology for evaluating the degree to which the detected communities match known groups (Yang and Leskovec 2015), used in this work, is based on the B 3 algorithm (Bagga and Baldwin 2011; 2008). The B 3 measure is the most appropriate measure according to the formal constraints for extrinsic clustering evaluation measures proposed by Amigo 2009.
This paper is based on our preliminary work, presented in a workshop proceeding (Cherepnalkoski and Mozetič 2015), and extending it along three main dimensions. First, the collection process is extended from eight months to one year, increasing the data size by 50 %. Second, in addition to examining political group and country membership, we examine language as a potential factor along which the communities are formed. Finally, we investigate the indirect links between the countries in the retweet network in terms of tweet sharing between the EP members and the Europe-wide audience.
The paper is organized as follows. The section “The European Parliament on Twitter” describes the EU Parliament and the Twitter data collected. In the section “Community detection and evaluation”, we outline the Louvain community detection method and the measures to evaluate the detected communities w.r.t. the ‘ground truth’, i.e., the actual labels. The sections “Communities in the core network” and “Communities in the extended network” present the results of the community detection. The “Linking the EU countries in the extended network” section presents the results of the tweet sharing analysis between the countries. In “Conclusions”, we discuss the results and plans for future research.
The European Parliament on Twitter
The European Union (EU) is a political and economic union which currently consists of 28 member states located in Europe. The EU operates through a system of supranational institutions which cover legislative, executive, judiciary, and monetary branches. The European Parliament, together with the Council of the European Union, is the principal legislative body.
The European Parliament
The European Parliament (EP) functions analogously to national parliaments in traditional parliamentary democracies. It is elected every five years directly by the citizens of the EU countries. Member states are allocated a number of seats which roughly reflect the state’s population. The EP members are elected on a national basis, but sit in the EP according to political groups they belong to. They can address the EP in any of the 24 official languages of the EU, but data shows that they primarily use English.
European United Left–Nordic Green Left (GUE-NGL)—socialists and communists group,
Progressive Alliance of Socialists and Democrats (S&D)—social-democrats group,
The Greens-European Free Alliance (Greens-EFA)—greens and regionalists group,
Alliance of Liberals and Democrats for Europe (ALDE)—liberals group,
European People’s Party (EPP)—christian-democrats group,
European Conservatives and Reformists (ECR)—conservatives group,
Europe of Freedom and Direct Democracy (EFDD)—euroskeptics group, and
the Non-Attached Members (NA)—independents.
Acquisition of tweets
The number of Twitter users in the European Parliament by political group
We monitored the activity related to the official accounts of the EP members through the Twitter Streaming API4. For each member, we acquired all their tweets as well as all the replies and retweets.
Together with each tweet, Twitter provides metadata about the tweet which includes the identified language of the tweet. We use this information to determine the language an EP member uses on Twitter. For each EP member, we compute the distribution of languages across all of the tweets posted by her/him. We determine the most commonly used language and use this language in the analysis. In some cases, Twitter is unable to determine the language of a tweet and reports the language as ‘undetermined’. If most of the tweets of an EP member are categorized as ‘undetermined’, we consider him/her as using ‘undetermined’ as their preferred language.
Construction of retweet networks
The collected tweets described in the previous section are used to construct retweet networks. A retweet network is a directed weighted graph, where nodes represent Twitter users and edges represent the retweet relation. The direction of an edge corresponds to the direction of information spreading or influence; the weight of the edge is the number of times one user retweets the other. We construct two retweet networks: (i) the core network, containing as nodes only the EP members and (ii) the extended network, containing as nodes the EP members and all other users which have retweeted or have been retweeted by an EP member.
The size of the two retweet networks
Community detection and evaluation
The political group whose members they are. In a national parliament, the political party is the most determining characteristic of a member of the parliament. In the EP, however, the political groups do not provide neither funding nor any support during the election process.
The country they come from. Each member of the EP is elected in a member state of the EU. The seats in the EP are allocated on a per country bases, and the members represent that country in the parliament.
The language they tweet in. The language the EP members use reflects the audience they address. Members which come from countries which use the same language have more opportunities to share their messages.
The goal of most community detection algorithms, implicit or explicit, is to find the best trade-off between a large intra-cluster density and a small inter-cluster density. Community detection algorithms perform maximization of modularity (Newman 2006). A good partitioning of a network in communities is one in which there are fewer than expected edges between the communities. The modularity is, up to a multiplicative constant, the number of edges falling within groups minus the expected number in an equivalent network with edges placed at random. Previous work on roll-call votes suggests that the result of modularity optimization should find groups and coalitions in a parliament (Dal Maso et al. 2014).
We perform community detection using the well established Louvain algorithm (Blondel et al. 2008). The Louvain method is a computationally very efficient algorithm that is well suited for large networks. It optimizes modularity through an iterative heuristic approach that consists of two repeating phases. In the first phase, modularity is optimized by allowing only local changes in communities; in the second, a new network is build that consists of one node for each previously found community. The algorithm repeats the iterations until the first phase can make no further improvements in modularity.
The F 1 score is a special case of Van Rijsbergen’s effectiveness measure (Van Rijsbergen 1979), where precision and recall can be combined with different weights.
The precision reflects the homogeneity of the community. The lower the number of actual groups in the community, the higher the precision. Conversely, the recall reflects to compactness of the actual group. The lower the number of detected communities in an actual group, the higher the recall. The F 1 score balances the precision and recall.
Communities in the core network
Communities and political groups
We calculate the mean precision, recall, and F 1 score for the core network to characterize how well the community structure reflects the political groups of the EP members. The results are shown in Fig. 4 (rows Groups). The precision is high, 0.843, which reflects the fact that most of the communities, with the exception of C2 and C5, are dominated by a single political group. The recall is moderately high, 0.764, which reflects the fact that most of the political groups, with the exception of S&D and EFDD, are predominantly contained within a single community. The F 1 score is also moderately high, 0.777. In comparison, a random partitioning of the graph into 8 communities has (on average over 1000 random partitionings) precision of 0.195, which is over 4 times lower, recall of 0.140, which is over 5 times lower, and F 1 score of 0.149, which is also over 5 times lower than the scores obtained with the partitioning into communities.
Communities and countries
We also evaluate the correspondence between the EU countries and the detected communities. We again calculate the mean precision, recall, and F 1 score for the network to characterize how well the community structure reflects the country membership of the EP members. The results are shown in Fig. 4 (rows Countries). Both precision and recall are low, 0.191 and 0.321 respectively, which shows that communities in the core network and not organized along country membership. In comparison, a random partitioning of the graph into 8 partitions has (on average over 1000 random partitionings) precision of 0.093, recall of 0.178, and F 1 score of 0.106, which are all only around 2 times lower than the scores obtained with the partitioning into communities. We do not further investigate the differences between individual countries since the overall correspondence between the countries and the communities is low.
Communities and languages
Lastly, we evaluate the correspondence between languages and communities. The results are shown in Fig. 4 (rows Languages). Again, precision and recall are both low, 0.212 and 0.263 respectively, which shows that communities in the core network and not organized along the language in which EP members post tweets. In comparison, a random partitioning of the graph into 8 partitions has (on average over 1000 random partitionings) precision of 0.138, recall of 0.167, and F 1 score of 0.125, which are all only 1.5 times lower than the scores obtained with the partitioning into communities. Again, we do not further investigate the differences between individual languages since the overall correspondence between the languages and the communities is low.
Communities in the extended network
The extended network consists of the EP members as well as all other users which have retweeted or have been retweeted by the EP members. As such, it is several orders of magnitude larger than the core network. Moreover, the edges from non-EP members to the members far outnumber the edges between the EP members. This network reflects the retweeting practice of the general public when it comes to political issues. In this case, we again investigate three alternatives: Is the partitioning of the network in communities dominated by the political groups, by the countries of origin of the EP members, or by the language in which they post their tweets?
Communities and political groups
Analogously to the core network, we analyze how closely the partitioning in communities corresponds to the partitioning in political groups.
The mean precision, recall, and F 1 score for the extended network, which characterize how well the community structure reflects the political group membership, are presented in Fig. 7 (rows Groups). Both precision and recall (and subsequently F 1) are low. In comparison, a random partitioning of the graph into 16 partitions has (on average over 1000 random partitionings) precision which is almost 2 times lower, recall which is 3 times lower, and F 1 score which is around 2 times lower than the ones obtained with the partitioning into communities. These values are still substantially lower than the ones obtained for the core network with respect to political groups.
Communities and countries
The evaluation results for the partitioning in countries are presented in Fig. 7 (rows Countries). In comparison to the partitioning in political groups, they are substantially higher. We also evaluated the average random partitioning, which has precision, recall, and F 1 score that are around 5.5 times lower than the ones obtained with the partitioning into communities. These values are comparable with those for the partitioning in political groups of the core network.
Communities and languages
The evaluation measures for the partitioning by language are presented in Fig. 7 (rows Languages). In comparison to the partitioning by countries, they are slightly lower. This is an interesting result since one would expect that common language used on Twitter is more important than the country of origin.
Linking the EU countries in the extended network
The results in the previous section indicate that the communities in the extended network best reflect the country of origin of the EP members. Figure 8 shows a bipartite network of the EU countries and the detected communities. We project the bipartite network to a unipartite network of countries by defining an appropriate weighting of the network edges. The country network thus represents links between the EU countries in terms of the shared tweets between the EP members and the Europe-wide audience. The sharing of tweets (retweeting) is captured by the detected communities in the extended retweet network.
The weighting of the country network edges is based on the following intuition. A weight should be large when many EP members from a pair of countries occur within only a few communities, and small when only a few members from the two countries share a community. In the extreme, the weight should be 0 when the EP members from the two countries are not together in any community, and 1 when all the members from both countries occur together in the same community.
The resulting weight is a real number in the interval [0,1].
A summary of the F 1 scores
The results suggest that the retweeting behavior of the EP members is driven by their political group membership. On the other hand, the retweeting behavior of the Twitter audience which follows the activities of the EP members is driven by their country of origin. Surprisingly, the language of the EP members used on Twitter does not dominate the retweeting behavior of neither the EP members, nor the general public.
Existing research (Hric et al. 2014) points out that most real world networks do not have clear ‘ground-truth’ counterparts to the detected communities regardless of which community detection algorithm is used. In this work, we show that the communities in the two retweet networks of MEPs have very clear counterparts, namely, political groups and countries.
We have already successfully applied the Louvain method for community detection to uncover influential communities in retweet networks, albeit in the context of climate and energy issues (Sluban et al. 2015). The results of the present study reinforce the suitability of the Louvain method for uncovering communities in retweet networks. In our preliminary work (Cherepnalkoski and Mozetič 2015), we have also performed community detection by hierarchical stochastic block modeling (Peixoto 2014). The first experiments, however, resulted in substantially larger numbers of detected communities and in considerably lower F 1 scores.
Community detection is a very vibrant field of research. There are multiple studies focused on comparison of algorithms for community detection (Fortunato 2010; Harenberg et al. 2014; Hric et al. 2014). Even tough comparing different community detection algorithms is important on its own, we plan to focus our future research in the following three key areas.
The presence and activities of the EP members on Twitter can be coupled with their actions in the Parliament. We plan to investigate the relations between the retweet networks and the roll-call vote networks. One of the findings of this study is that community detection can recreate the structure of different political groups with different degrees of effectiveness. Different political groups, also, manifest different levels of coherency in their voting behavior. Investigating whether these two phenomena are related will contribute to the overarching theme of engagement in social media by elected representatives.
So far, we have disregarded the contents of the tweets posted, and focused on the aggregated retweet behavior only. The spreading of influence on Twitter is, however, dependant on the discussion topics. Different topics are accompanied by different levels of agreement and controversy, and may bring two political groups closer together or move them further apart. We plan to implement topic detection on Twitter data, and investigate how different topics influence the community structure of the retweet network of the EP members.
Different topics convey different sentiment. Sentiment analysis can be applied to uncover the attitude of different communities toward various issues. We have already applied the sentiment analysis to various domains, such as: (i) to compare the sentiment leaning of different network communities towards various environmental topics (Sluban et al. 2015), (ii) to study the emotional dynamics of Facebook comments on conspiracy theories (Zollo et al. 2015), (iii) to analyze the effects of Twitter sentiment on stock prices (Ranco et al. 2015), (iv) to monitor the sentiment about political parties before and after the elections (Smailović et al. 2015), and (v) to rank the widely used emojis by sentiment (Kralj Novak et al. 2015). In the future we plan to employ sentiment analysis to characterize the sentiment of the EP political groups towards different policy and regulation issues.
2 http://www.europarl.europa.eu/meps/en/full-list.html (accessed June 1, 2015)
3 https://twitter.com/Europarl_EN/lists/all-meps-on-twitter/members (accessed September 30, 2014)
This work was supported in part by the European FP7 projects MULTIPLEX (no. 317532) and SIMPOL (no. 610704), the H2020 FET project DOLFINS (no. 640772), and by the Slovenian ARRS programme Knowledge Technologies (no. P2-103).
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Amigó, E, Gonzalo J, Artiles J, Verdejo F (2009) A comparison of extrinsic clustering evaluation metrics based on formal constraints. Inf Retrieval 12(4): 461–486.View ArticleGoogle Scholar
- Bagga, A, Baldwin B (2011) Algorithms for scoring coreference chains In: Proc. 1st Intl. Conf. on Language Resources and Evaluation Workshop on Linguistics Coreference, 563–566.Google Scholar
- Bagga, A, Baldwin B (2008) Entity-based cross-document coreferencing using the vector space model In: Proc. 17th Intl. Conf. on Computational Linguistics (COLING), 79–85.. ACL, Stroudsburg, PA, USA.Google Scholar
- Bakshy, E, Hofman JM, Mason WA, Watts DJ (2011) Everyone’s an influencer: Quantifying influence on twitter In: Proc. 4th ACM Intl. Conf. on Web Search and Data Mining (WSDM), 65–74.. ACM, New York, NY, USA.Google Scholar
- Borondo, J, Morales AJ, Losada JC, Benito RM (2012) Characterizing and modeling an electoral campaign in the context of Twitter: 2011 Spanish Presidential election as a case study. Chaos 22(2): 023138.ADSView ArticleGoogle Scholar
- Borondo, J, Morales AJ, Benito RM, Losada JC (2014) Mapping the online communication patterns of political conversations. Physica A: Stat Mech Appl 414(0): 403–413.View ArticleGoogle Scholar
- Boyd, D, Golder S, Lotan G (2010) Tweet, tweet, retweet: Conversational aspects of retweeting on twitter In: Proc. 43rd Hawaii Intl. Conf. on System Sciences (HICSS), 1–10.Google Scholar
- Blondel, VD, Guillaume JL, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech Theory Exp 2008(10): P10008.View ArticleGoogle Scholar
- Cha, M, Haddadi H, Benevenuto F, Gummadi PK (2010) Measuring user influence in twitter: The million follower fallacy In: Proc. Intl. AAAI Conf. on Weblogs and Social Media (ICWSM), 10–17.Google Scholar
- Cherepnalkoski, D, Mozetič I (2015) A retweet network analysis of the European Parliament In: Proc. 11th Intl. Conf. on Signal-Image Technology & Internet-Based Systems (SITIS), 350–357, doi:http://dx.doi.org/10.1109/SITIS.2015.8.
- Conover, M, Gonçalves B, Ratkiewicz J, Flammini A, Menczer F (2011a) Predicting the political alignment of twitter users In: Proc. 3rd IEEE Conf. on Social Computing (SocialCom).Google Scholar
- Conover, M, Ratkiewicz J, Francisco M, Gonçalves B, Flammini A, Menczer F (2011b) Political polarization on twitter In: Proc. 5th Intl. AAAI Conf. on Weblogs and Social Media (ICWSM).Google Scholar
- Dal Maso, C, Pompa G, Puliga M, Riotta G, Chessa A (2014) Voting behavior, coalitions and government strength through a complex network analysis. PLoS ONE 9(12): 116046. doi:http://dx.doi.org/10.1371/journal.pone.0116046.ADSView ArticleGoogle Scholar
- Fortunato, S (2010) Community detection in graphs. Phys Reports 486(3–5): 75–174.ADSMathSciNetView ArticleGoogle Scholar
- Girvan, M, Newman MEJ (2002) Community structure in social and biological networks. Proc Nat Acad Sci 99(12): 7821–7826.ADSMathSciNetView ArticleMATHGoogle Scholar
- Harenberg, S, Bello G, Gjeltema L, Ranshous S, Harlalka J, Seay R, Padmanabhan K, Samatova N (2014) Community detection in large-scale networks: a survey and empirical evaluation. Wiley Interdiscip Rev Comput Stat 6(6): 426–439.View ArticleGoogle Scholar
- Hix, S, Noury A, Roland G (2009) Voting patterns and alliance formation in the European Parliament. Philos Trans R Soc Lond B Biol Sci 364(1518): 821–831.View ArticleGoogle Scholar
- Hric, D, Darst RK, Fortunato S (2014) Community detection in networks: Structural communities versus ground truth. Phys Rev E 90: 062805. doi:http://dx.doi.org/10.1103/PhysRevE.90.062805.ADSView ArticleGoogle Scholar
- Kenett, DY, Morstatter F, Stanley HE, Liu H (2014) Discovering social events through online attention. PLoS ONE 9(7): 102001. doi:http://dx.doi.org/10.1371/journal.pone.0102001.ADSView ArticleGoogle Scholar
- Kralj Novak, P, Smailović J, Sluban B, Mozetič I (2015) Sentiment of emojis. PLoS ONE 10(12): 0144296. doi:http://dx.doi.org/10.1371/journal.pone.0144296.View ArticleGoogle Scholar
- Kumar, S, Liu H, Mehta S, Subramaniam LV (2015) Exploring a scalable solution to identifying events in noisy twitter streams In: Proc. IEEE/ACM Intl. Conf. on Advances in Social Network Analysis and Mining (ASONAM), 496–499.Google Scholar
- Kwak, H, Lee C, Park H, Moon S (2010) What is Twitter, a social network or a news media? In: Proc. 19th Intl. Conf. on World Wide Web (WWW), 591–600.. ACM, New York, NY, USA.View ArticleGoogle Scholar
- Larsson, AO (2014) The EU Parliament on Twitter—assessing the permanent online practices of parliamentarians. J Inform Technol Polit 0(0): 1–18.Google Scholar
- Lazer, D (2011) Networks in political science: Back to the future. PS: Pol Sci Polit 44: 61–68.Google Scholar
- Lužar, B, Levnajic Z, Povh J, Perc M (2014) Community structure and the evolution of interdisciplinarity in slovenia’s scientific collaboration network. PLoS ONE 9(4): 94429. doi:http://dx.doi.org/10.1371/journal.pone.0094429.ADSView ArticleGoogle Scholar
- Morstatter, F, Pfeffer J, Liu H, Carley KM (2013) Is the sample good enough? comparing data from twitter’s streaming api with twitter’s firehose In: Proc. 7th Intl. AAAI Conf. on Weblogs and Social Media (ICWSM), 400–408.Google Scholar
- Newman, MEJ, Girvan M (2004) Finding and evaluating community structure in networks. Phys Rev E 69: 026113.ADSView ArticleGoogle Scholar
- Newman, MEJ (2006) Modularity and community structure in networks. Proc Nat Acad Sci 103(23): 8577–8582.ADSView ArticleGoogle Scholar
- Peixoto, TP (2014) Hierarchical block structures and high-resolution model selection in large networks. Phys Rev X 4: 011047. doi:http://dx.doi.org/10.1103/PhysRevX.4.011047.Google Scholar
- Perc, M (2010) Growth and structure of slovenia’s scientific collaboration network. J Infometrics 4(4): 475–482.MathSciNetView ArticleGoogle Scholar
- Porter, MA, Mucha PJ, Newman MEJ, Warmbrand CM (2005) A network analysis of committees in the U.S, House of Representatives. Proc Nat Acad Sci 102(20): 7057–7062.ADSView ArticleGoogle Scholar
- Ranco, G, Aleksovski A, Caldarelli G, Grčar M, Mozetič I (2015) The effects of Twitter sentiment on stock price returns. PLoS ONE 10(9): 0138441. doi:http://dx.doi.org/10.1371/journal.pone.0138441.View ArticleGoogle Scholar
- Sampson, J, Morstatter F, Maciejewski R, Liu H (2015) Surpassing the limit: Keyword clustering to improve twitter sample coverage In: Proc. 26th ACM Conf. Hypertext and Social Media (Hypertext), 237–245.Google Scholar
- Sluban, B, Smailović J, Battiston S, Mozetič I (2015) Sentiment leaning of influential communities in social networks. Comput Soc Netw 2(9): 1–21. doi:http://dx.doi.org/10.1186/s40649-015-0016-5.Google Scholar
- Smailović, J, Kranjc J, Grčar M, žnidaršič M, Mozetič I (2015) Monitoring the Twitter sentiment during the Bulgarian elections In: Proc. IEEE Intl. Conf. on Data Science and Advanced Analytics (DSAA), 1–10, doi:http://dx.doi.org/10.1109/DSAA.2015.7344886.
- Suh, B, Hong L, Pirolli P, Chi EH (2010) Want to be retweeted? large scale analytics on factors impacting retweet in twitter network In: Proc. 2nd IEEE Intl. Conf. on Social Computing (SocialCom), 177–184.Google Scholar
- Van Rijsbergen, CJ (1979) Information Retrieval. Butterworth, London, UK.MATHGoogle Scholar
- Waugh, AS, Pei L, Fowler JH, Mucha PJ, Porter MA (2009) Party Polarization in Congress: A Network Science Approach. 0907.3509.Google Scholar
- Weng, J, Lim EP, Jiang J, He Q (2010) Twitterrank: Finding topic-sensitive influential twitterers In: Proc. 3rd ACM Int. Conf. on Web Search and Data Mining (WSDM), 261–270.. ACM, New York, NY, USA.Google Scholar
- Yang, J, Leskovec J (2015) Defining and evaluating network communities based on ground-truth. Knowl Inform Syst 42(1): 181–213.View ArticleGoogle Scholar
- Zhang, Y, Friend AJ, Traud AL, Porter MA, Fowler JH, Mucha PJ (2008) Community structure in congressional cosponsorship networks. Physica A: Stat Mech Appl 387(7): 1705–1712.View ArticleGoogle Scholar
- Zollo, F, Kralj Novak P, Del Vicario M, Bessi A, Mozetič I, Scala A, Caldarelli G, Quattrociocchi W (2015) Emotional dynamics in the age of misinformation. PLoS ONE 10(9): 0138740. doi:http://dx.doi.org/10.1371/journal.pone.0138740.View ArticleGoogle Scholar