Forbidden triads and creative success in jazz: the Miles Davis factor
- Balazs Vedres^{1}Email authorView ORCID ID profile
Received: 14 March 2017
Accepted: 17 August 2017
Published: 29 September 2017
Abstract
This article argues for the importance of forbidden triads – open triads with high-weight edges – in predicting success in creative fields. Forbidden triads had been treated as a residual category beyond closed and open triads, yet I argue that these structures provide opportunities to combine socially evolved styles in new ways. Using data on the entire history of recorded jazz from 1896 to 2010, I show that observed collaborations have tolerated the openness of high weight triads more than expected, observed jazz sessions had more forbidden triads than expected, and the density of forbidden triads contributed to the success of recording sessions, measured by the number of record releases of session material. The article also shows that the sessions of Miles Davis had received an especially high boost from forbidden triads.
Keywords
Introduction
While the spread and adoption of innovations has been a central concern of social network research (Centola 2015), we know much less about the network structures that contribute to the generation of innovation. In the efforts to understand how new ideas are incorporated into existing practices, much attention was devoted to the duality of network closure and open weak ties. Closure is seen to provide a trusted collaborative environment to realize ideas captured by weak ties from outside the cohesive core (Burt 2005). This paper is about the creative potential of a third triad type: forbidden triads – connected triplets with two strong ties and one open dyad. Such triads provide opportunities to recognize unique combinations of skills: generative combinations of tacit knowledge that evolved in the two intersecting strong-tie dyads.
While weak ties and closure are building blocks of small world structures, forbidden triads are building blocks of fold networks. Fold networks have been identified as predictors of the generation of novelty, where overlapping cohesive communities contribute to both the recognition of a novel possibility, and the realization of the novel idea as a product (de Vaan et al., 2015). It was also demonstrated that it is not the agency at the overlap of communities that matters, but the successful mobilization of the non-intersecting unique part of overlapping communities, and overlapping communities have also been shown to be more unstable than non-overlapping communities (Vedres and Stark 2010). Fold networks operate by a generative tension: They provoke the generation of novelty, but also contribute to coordination and loyalty conflicts.
While the overlapping of communities provides a clear mechanism for realizable novelty, the empirical operationalization of fold networks has so far been cumbersome. One needs to identify communities first, and especially communities that overlap to measure network folding. Previous studies have used the number of community memberships of a given node (Vedres and Stark 2010), or the number of subgroup overlaps within a larger collective (De Vaan et al. 2015). But community detection is far from being a universal and simple process: The large number of community detection algorithms is a symptom of the complex nature of mapping the community concept (especially with overlaps allowed) onto sets of nodes in a network (Granell et al. 2015; Xie et al., 2013).
This article uses the density of forbidden triads as a direct measure of foldedness. Forbidden triads are open triads with high-weight legs. The concept was introduced by Mark Granovetter in his seminal article on the significance of weak ties in predicting labor market success (Granovetter 1973). Granovetter argued that strong ties are most likely to be closed, and weak ties are the ones that can bridge communities, and thus provide access to diverse information. Granovetter also argued that strong and open ties are rare and fleeting, thus the label “forbidden.”
Up to this point no one has analyzed the importance of forbidden triads for success, as the four-decades long tradition of parsing triads into strong-and-closed and weak-and-open left little room for seeing any significance for forbidden triads. Prior research has discussed the negative consequences of overlapping closed triads, under the label of Simmelian brokerage, or reinforced brokerage (Burt 2015; Krackhardt and Kilduff 2002) in the context of business ties and managerial networks.
I argue, however, that forbidden triads are the key building blocks of creative networks, as these triads are occasions where two high-weight edges intersect on a central node. This creates an opportunity to hybridize prior practices (such as musical styles), to generate a new kind of practice. Forbidden triads go together with overlapping cohesion: there are many forbidden triads around the intersecting nodes of two communities, if one accepts the assumption that triadic closure is related to high edge weight. In a network with folds (overlapping communities) one expects to see a high density of forbidden triads. I define triad density as the proportion of a kind of triad to all connected triads.
The only decision to be made in defining a forbidden triad is the threshold for an edge weight to qualify as a strong tie. In this article I use a minimal threshold of repeated (as opposed to one-shot) interaction, but also analyze various thresholds to estimate sensitivity of statistical models to classifying strong ties.
This article uses jazz as a case of a creative field, where collective innovation is intricately linked with artistic value (Phillips 2013). Jazz is a field where the product – the music – is a result of a team effort, and band leaders exert considerable effort to select and combine musicians (Kirschbaum and Ribeiro 2016). Miles Davis – arguably the most important band leader in the history of jazz – was especially vocal about the importance of combining musicians for fresh approaches and new sounds (Davis and Troupe 1989). A prior analysis has shown that disconnectedness at the level of cities contributes to the evolution of new styles (Phillips 2011). In this article I take a similar approach at the level of the session, to show the creative importance of the lack of closure.
Using data on the entire history of recorded jazz from 1896 to 2010 (175,000 jazz sessions) the paper presents evidence for the contribution of forbidden triads in musical collaboration to success measured in the number of album releases. Forbidden triads are conceptualized as the proportion of connected triads in a session, where both connected legs of the triad are strong, and one dyad is unconnected. The threshold for tie strength was set at two shared session plays in the past. I analyze the sessions of Miles Davis separately as well, to show how forbidden triads added to the success of his sessions.
I test several hypotheses derived from the argument that creative success is a function of the density of forbidden triads. First, I test the hypothesis that edge strength relates positively to probability of closure. More precisely, I test the hypothesis that minimal triplet legs weight is positively related to the probability of closure. Second, I test the hypothesis that in the observed jazz world edge weights contribute less to the increase in the probability of closure, compared to a randomly rewired jazz world. In other words, jazz musicians tolerate openness of higher weight triads more than expected. I constructed randomly rewired jazz worlds that follow the principle of objectively possible counterfactuals. I generated random jazz worlds that could have happened within hard constraints that one can read from the data, and from practices of jazz musicians. Third, I test the hypothesis that forbidden triads are over-represented in observed jazz sessions, compared to jazz sessions in the rewired jazz worlds. Finally, I test the hypothesis that forbidden triads contribute to success at the session level, even if we take all conceived alternative explanations into account, including unobserved heterogeneity related to the identity of the band leader.
Measuring collaboration and triad densities in jazz
To cover collaborations in recorded jazz, I used the Tom Lord Discography (Lord 2010), what is considered to be the most comprehensive source (Charry 2005). This discography collects musician participation in recording sessions from the beginnings of jazz to the present. I collected data up to 2010 about the complete set of recording sessions available in this discography. The core data is a tripartite graph of time-stamped instances (with a yearly time resolution) of sessions, musicians, and instruments.^{1} The resulting dataset contains information about 175,064 recording sessions, taking place between 1896 and 2010. There were a total of 42,929 band leaders (or band names) and 187,784 musicians playing in these sessions, playing 11,940 different instruments^{2}. The weighted collaborative network among musicians for a given session was generated by summing the prior co-plays for each musician dyads. To ensure strict temporal ordering, only sessions from year t-1 backwards were included, if the focal session took place in year t.
I am interested in relating the presence of three kinds of triads to levels of success. The first kind of triad is a building block of fold networks, the forbidden triad: a triad with two strong ties, and one absent tie. The second kind of triad is an open triad: two weak ties and one absent tie. The third kind of triad is closure: all three ties are present (of any strength). To measure the presence of these triad types I categorically delimit forbidden triads from open triads by a threshold tie strength value, and then count the number of three mutually exclusive triad types (forbidden triads, open triads, and closed triads). I then normalize the number of triads by the number of connected triads (with at least two ties present).
The graph of collaborations on panel b. of Fig. 2 shows open and forbidden triads, and one can see that these resulted from the missing link between Miles Davis and Wynton Kelly. Panels c. and d. show only the open and the forbidden triads separately.
Triad types and minimal triplet legs weight
To chart the space of connected triad types, I use two dimensions: minimal triplet legs weight and the probability of closure. Triplet legs are the two stronger edges in the connected triad, w _{(3)} and w _{(2)}, the third and second edge weights in ascending order of triad edge weights. (The subscripted parenthesized numbers indicate the ascending order statistic.) In an open triad, the weakest edge w _{(1)} = 0. Minimal triplet legs weight is w _{(2)}, the second weight in ascending order, that captures the strength of the triad edges, independently of closure. This measure follows the same considerations that underlie the development of weighted clustering coefficients, where the geometric mean of edge weights is used, as it is more robust to outlying weight values (Onnela et al. 2005; Opsahl and Panzarasa 2009; Saramäki et al. 2007). I use the minimal weight instead of the geometric mean, because the goal is to distinguish triads where leg weights are higher than a threshold value. Weights here are raw ones, measuring the number of times two musicians recorded together in the studio.
Definition of triad types
Minimal legs weight | Closure | |
---|---|---|
Open triad | w _{(2)} = 1 | w _{(1)} = 0 |
Closed triad | w _{(2)} > 0 | w _{(1)} > 0 |
Forbidden triad | w _{(2)} > 1 | w _{(1)} = 0 |
Triad types in the example session of “Kind of Blue”, March 2, 1959
i | j | w _{ ij } | i | k | w _{ ik } | j | k | w _{ jk } | w _{ (3) } | w _{ (2) } | min legs weight | ||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Forbidden triads | 3 | 4 | 11 | 3 | 5 | 0 | 4 | 5 | 6 | 11 | 6 | 6 | |||
1 | 3 | 12 | 1 | 5 | 22 | 3 | 5 | 0 | 22 | 12 | 12 | ||||
Open triads | 3 | 5 | 0 | 3 | 6 | 1 | 5 | 6 | 8 | 8 | 1 | 1 | |||
2 | 3 | 1 | 2 | 5 | 16 | 3 | 5 | 0 | 16 | 1 | 1 | ||||
Closed triads | 2 | 3 | 1 | 2 | 6 | 5 | 3 | 6 | 1 | 5 | 1 | 5 | |||
2 | 4 | 7 | 2 | 6 | 5 | 4 | 6 | 10 | 10 | 7 | 7 | ||||
... | |||||||||||||||
1 | 2 | 35 | 1 | 6 | 13 | 2 | 6 | 5 | 35 | 13 | 13 | ||||
1 | 2 | 35 | 1 | 5 | 22 | 2 | 5 | 16 | 35 | 22 | 22 |
Further data tables at the session level record the identity of band leader, and the number of releases on which material recorded in the session appeared. The number of releases were coded as the number of unique catalog numbers that appear on the session’s entry in the Tom Lord Discography.
Rewired jazz worlds
To test null hypotheses that relate only marginal frequencies to outcomes, I generated random jazz worlds by rewiring the observed tripartite dataset (of sessions, musicians, and instruments). The rewiring was accomplished following the principle of objective possibility: I was re-allocating musicians to sessions in a way that could have happened in real life (with, albeit, small likelihood), and I avoided composing sessions that were not possible according to available evidence. In other words, I was generating jazz worlds with sessions that the recording companies could have recorded.
The first principle for rewiring was that the number of musicians in the session needed to be preserved. Recording in the studio – especially in the first half of the twentieth century – was an expensive affair, and an endeavor to record a trio could not have been easily expanded into a sextet, or big band. So, session degrees were preserved.
Second, I was preserving the number of sessions a musician played, with a window of 1 year. If a trumpet player recorded five times over the year when the session happened, I was allocating that player to five sessions in the rewired jazz world over that one-year period.^{4}
Third, I was preserving the instrument combinations of sessions, as the recorded material would have been different without the same instruments.
Finally, I was only allocating musicians to a session to fill an instrument slot if they played the instrument over the current and previous year. Musicians often play multiple instruments, and it makes a considerable difference if a musician has played the instrument in question only a decade in the past.
In sum, I was generating jazz worlds where the recording company was able to fill the instrument slots in the session with available and able musicians. These musicians of course might have been very different from the observed ones. Imagine, for example Miles Davis on trumpet being swapped for a young trumpet player active in London at the time. The most important difference for us, of course, is that the musicians selected by our rewiring were not selected according to their networks. They were not likely to have played with each other in the past, and they were not likely to have been “friends of friends” either. I generated 100 jazz worlds – simulated complete histories of jazz where an observed jazz session had a corresponding rewired version.
Prevalence of triad types in observed and rewired jazz worlds
The most apparent feature of Fig. 3 is that the probability of closure is increasing with minimal triplet leg weight: if musician i played frequently in the past with musician j, and j played often with k, there is a higher probability that j and k have also played together at least once (compared to less frequent co-plays for i-j and j-k dyads). It is also apparent, that leg weights and the probability of closure in general is much lower in the rewired jazz worlds.
In the observed data (panel a of Fig. 3) minimal triplets with legs weight that equals one are closed with .513 probability. The increase of closure probability is monotonic; the top percentile of minimal triplet legs weight (between 19 and 26) is closed with P = .994. In the rewired data, triplets with minimal legs weight has a probability of closure of .120, that increases suddenly around the threshold of forbidden triads of legs weight equals two (P = .418). The top percentile (minimal legs weight between 4 and 5) is closed with P = .778.
Both in the observed and simulated data about 9% of triads are forbidden ones: triads with high edge weights without closure. In the observed data it seems that the number of forbidden triads is limited by the fact that the edge weights are relatively high, and high edge weight is correlated with closure as well. In the rewired data the number of forbidden triads seems to be limited by the fact that while most triads are open, the average edge weight is small.
To estimate the statistical significance of these differences, I computed a logistic regression model, where the dependent variable is the presence of closure (y = 1), as opposed to an open triad (y = 0), and the independent variables are: first, the triad belongs to the observed triads (x _{ o } = 1), as opposed to the rewired (random jazz world) triads (x _{ o } = 0), second, the minimal triplet legs weight (x _{ w }), and third, the interaction between the observed triad indicator and minimal triplet legs weight (x _{ o } ^{∗} x _{ w }). I was estimating the following logistic regression equation:
Logistic regression estimation of triadic closure
Beta | Odds ratio | SE | p | |
---|---|---|---|---|
Observed | 2.712 | 15.054 | .003 | .000 |
Min legs weight | 1.100 | 3.005 | .002 | .000 |
Observed * Min legs weight | −.639 | .528 | .002 | .000 |
Constant | −2.981 | .051 | .003 | .000 |
N of observations | 10,676,186 | |||
Pseudo R-square | .302 | |||
Log likelihood | −5,122,486 |
The results show that the odds of closure in general is much higher (15.054 times higher) with observed triads than with rewired ones. In the real jazz world musicians are playing repeatedly with each other, while in the rewired world nothing ensures coherence – there are no band identities, and band leaders repeatedly playing with the same musicians. The estimated probability of closure for the weakest connected triad (with two edges of strength one, that is min leg weight of one) equals .549, while the same estimated probability for rewired triads is .133 (in line with the starting values on Fig. 3). The odds of closure triples (multiplies by 3.005) with each additional increase in min leg weight for rewired triads, but for observed triads an increase in min leg weight only multiplies odds of closure by 1.587 (3.005*.528). Observed triads have a high baseline tendency to be closed, but they also have a tendency to “stay open longer” with increasing edge weights.
What this translates to as an actual process in jazz, is that players in the real jazz world can come together in a session where a musician had played a lot with one, and another fellow musician, yet these two alters have never seen each other in the studio. Forbidden triads seem to be a significant distinguishing feature of the jazz world, that does not show up in the randomly rewired version of this world. While the higher closure of the observed jazz world can easily be explained by factors washed out by the rewiring – such as clustering based on geographic proximity, style, and allegiance to a band leader – lower closure in high-weight triads is a non-trivial aspect of the observed jazz world.
The triads that we considered thus far were cut from their session context: the number and composition of musicians by their instruments, and the specific time of recording. The question that I answer subsequently is whether the proportion of forbidden triads at the level of sessions is different in the observed and rewired data. Thus far we reviewed the probability of closure by the weight of edges in triplet legs, without considering the session context. Our relevant unit of analysis for success is the session, and the question that I address is whether the prevalence of forbidden triads in observed sessions are different from rewired sessions. To answer this question, I compared the distribution of forbidden triads density in observed sessions to the average density that we see in 100 randomly rewired jazz worlds.
Regression models of success
I used regression models to relate triad types to success. The dependent variable – the measure of success – in the regression models is the number of releases, ranging from one to 176. (The dependent variable in the OLS models is the ten-base logarithm of the number of releases ranging from .301 to 2.478.) Our key independent variables represent the density of three triad types – forbidden triads, closed triads, and open triads. Tests of multicollinearity are shown in Appendix A. Forbidden triads are defined as triads with a minimal triplet leg weight of two (w _{(2)} ≥ 2), but the results presented are robust to varying this threshold. (See Appendix B for details on model robustness to varying w _{(2)}.) I am using the open triads category as the reference in the multivariate models, and enter squared terms for both closed and forbidden triads densities to capture non-linear (quadratic) relationships.
To mitigate biased estimates dues to right-censoring in the data, I excluded all sessions after the year 2000, leaving at least a 10-year window for each session to accumulate records. Unfortunately the release dates for releases is not available in the Tom Lord dataset, so I was unable to estimate the decay in the frequency of releases by time. I did however estimate models with varying time windows omitted from the right hand side (15 and 20 years), that did not affect the main findings. (See Appendix C for details on robustness to right hand side time cutoffs.)
All triad densities have an inverted U-shape relationship with success, suggesting that too little or too much of any kind of triad is a pathological social structure.
In the following analysis I am testing whether the advantage of forbidden triads over other triad shapes is statistically significant, and whether this relationship remains after controlling for other key alternative hypotheses. Further independent variables are entered, representing key alternative explanations to keep constant. A possible alternative explanation to forbidden triads can be the strength of ties in general. It is possible that forbidden triads are only significant predictors of success because they contain higher weight edges, and in fact it is the intensity of ties in the session that is related to success. Thus I entered the median tie strength in the session, and also the square of median tie strength to test for a non-linear relationship. It is reasonable to expect that at very high levels of tie strength musicians will not be as successful (the returns to tie strength is decreasing), as a high tie strength value might indicate getting locked into repeated and exclusive collaboration with the same set of musicians.
Instrumental innovation is another possible alternative explanation: the session is successful not because of a fold network dynamic, but because forbidden triads are a proxy for experimenting with a new instrument combination: Bringing in a new musician is really about bringing in a new instrument. Thus I entered distinctiveness: the average cosine distance of the instrument combination vector of the session (in the space of the top 200 most frequent instruments) to all other sessions over the preceding 5 years (t-1 to t-5).
Pearson correlation coefficients
1. | 2. | 3. | 4. | 5. | 6. | 7. | 8. | 9. | 10. | 11. | |
---|---|---|---|---|---|---|---|---|---|---|---|
1. Releases | 1.000 | ||||||||||
2. log(Releases) | .822 | 1.000 | |||||||||
3. Forbidden triads | .026 | .046 | 1.000 | ||||||||
4. Closed triads | −.018 | −.036 | −.510 | 1.000 | |||||||
5. Open triads | .003 | .011 | −.066 | −.825 | 1.000 | ||||||
6. Median tie strength | .026 | .043 | −.036 | .165 | −.168 | 1.000 | |||||
7. Distinctiveness | −.159 | −.235 | −.070 | .106 | −.077 | −.017 | 1.000 | ||||
8. Musicians (n) | .061 | .065 | .000 | −.072 | .084 | −.087 | −.097 | 1.000 | |||
9. Newbies proportion | −.053 | −.086 | −.181 | .266 | −.189 | −.216 | .081 | .061 | 1.000 | ||
10. Median past releases | .683 | .663 | .024 | −.015 | .001 | .026 | −.187 | .082 | −.035 | 1.000 | |
11. Past sessions (n) | .025 | .065 | .252 | −.256 | .131 | .120 | −.160 | .224 | −.309 | .038 | 1.000 |
12. Year | −.360 | −.551 | −.005 | −.017 | .022 | −.026 | .306 | −.035 | −.037 | −.430 | .032 |
I estimated both logged dependent variable OLS models, and negative binomial models appropriate for count dependent variables. It is most appropriate if statistical modeling of the number of releases takes into account the count nature of this dependent variable. Releases accumulate over time, and take on discrete positive values. Ordinary least squares models using the original releases variables are not entirely appropriate, as the distribution of count variables is more skewed than an assumed normal distribution. Negative binomial models are especially appropriate for over-dispersed count variables, which fits the number of releases accumulating in time (Cameron and Trivedi 1998; Greene 2003). Another possible approach is to use OLS regression on a logged dependent variable, that is less skewed than the original. To test model robustness I also used OLS models with a logged dependent variable. Using a negative binomial model has the advantage of taking overdispersion into account, and estimating a parameter of overdispersion explicitly, which is not available in OLS models of logged number of releases.
I estimated these models with all session pooled, and with fixed effects included for band leaders, to account for leader specific unobserved heterogeneity in success. Beyond the independent variables presented above, both success and network structure in the session can be highly dependent on unobserved features of the band leader (or band identity in later decades). A session recorded by a high-reputation band leader can both attract high profile musicians with a proven track record and possibly a lack of closure (high forbidden triads density), and the same session might see more subsequent releases. Estimating models that keep the identity of the leader constant (estimate within-leader effects) can get us closer to the goal of capturing the impact of network structure on success. I followed the derivation of the fixed effects negative binomial model proposed by Hausman and coauthors (Hausman et al., 1984), and also include fixed effects OLS models for logged number of releases. This is especially useful in light of more recent doubts about the Hausman-model, namely that the derivation builds the fixed-effects into the distribution of the gamma heterogeneity, α, not the mean (Allison and Waterman 2002).
Starting with the simplest of the estimators, an OLS models with a logged dependent variable estimates the following equation:
for s = 1,2,…N_{sessions}, where y _{ s } is the number of releases that resulted from the session, βare model parameters, X _{ s } are the set of independent variables, and ε _{ s }is the error term, and estimation is ordinary least squares. The same model with band leader fixed effects would be written as:
for l = 1,2,…N_{leaders}, and s = 1,2,…N_{sessions}, where an additional term, γ _{ l } estimates the band leader specific fixed effect (a band leader specific baseline level of success).
The negative binomial model estimates the occurrence rate of releases, and takes into account the nature of count data as non-negative integers. The negative binomial model without fixed effects is estimated by the following equation:
for l = 1,2,…N_{leaders}, where μ _{ s } = E(y _{ s }| x _{ s }) is the occurrence rate of releases, βare model parameters, X _{ s } are the set of independent variables, ε _{ s }is the error term, and the model is based on a maximum likelihood estimator. The negative binomial model is an extension, or rather a generalized version of Poisson regression models, in that it estimates the over-dispersion parameter α, that equals zero for the special case that is a Poisson model (with no overdispersion, a mean that equals variance). The null hypothesis that α equals zero is testable.^{8}
The equation for a negative binomial model with fixed effects is then accordingly:
for l = 1,2,…N_{leaders}, and s = 1,2,…N_{sessions}, where μ _{ ls } = E(y _{ ls }| x _{ ls }) is the occurrence rate, γ _{ l }is the band leader specific fixed effect, βare model parameters, X _{ ls } are the set of independent variables, and ε _{ ls }is the error term.
Predictors of success
Statistical models of success
1. OLS model of log(Releases) | 2. NB model of Releases | 3. OLS model of log(Releases) with fixed effects | 4. NB model of Releases with fixed effects | |
---|---|---|---|---|
Forbidden triads | .0445*** (.0100) | .2648*** (.0511) | .0316*** (.0112) | .2253*** (.0528) |
Forbidden triads (squared) | −.0383*** (.0114) | −.2282*** (.0585) | −.0291** (.0127) | −.2672*** (.0606) |
Closed triads | −.0052 (.0086) | −.0252 (.0449) | .0147 (.0099) | .0730 (.0471) |
Closed triads (squared) | .0044 (.0078) | .0114 (.0409) | −.0173 (.0090) | −.0843* (.0429) |
Median tie strength | −.0007*** (.0002) | .0071*** (.0012) | −.0006* (.0003) | −.0071*** (.0013) |
Median tie strength (squared) | .0000* (.0000) | −.0001*** (.0000) | −.0000 (.0000) | −.0000 (.0000) |
Distinctiveness | −.0723*** (.0067) | −.5120*** (.0354) | −.0425*** (.0094) | .1248*** (.0428) |
Musicians (n) | .0002*** (.0001) | −.0024*** (.0005) | .0011*** (.0001) | .0078*** (.0006) |
Newbies proportion | −.0779*** (.0033) | −.5364*** (.0185) | −.0783*** (.0047) | −.2066*** (.0224) |
Median past releases | .0358*** (.0002) | .1162*** (.0010) | .0261*** (.0002) | .0239*** (.0003) |
Past sessions (n) | −.0000*** (.0000) | .0001*** (.0000) | −.0000*** (.0000) | −.0005*** (.0000) |
Year | −.0040*** (.0000) | −.0200*** (.0001) | −.0055*** (.0001) | −.0027*** (.0004) |
Constant | .7215*** (.0049) | 2.3051*** (.0261) | −.8403*** (.0088) | 1.5289*** (.0392) |
Fixed effects for band leader | No | No | Yes | Yes |
N of observations | 81,527 | 81,527 | 72,042 | 72,042 |
F | 7866.36*** | 1886.44*** | ||
Chi-square | 65,153.39*** | 8088.77*** | ||
R-square (adjusted) | .536 | .189^{a} | .514 | .339^{a} |
Log likelihood | −139,558.13 | −104,666.63 |
The coefficient of the first power of forbidden triads density is positive and significant, while the second power is negative and significant. This suggests that – compared to open triads – an increase in forbidden triads can initially be more beneficial for the number of releases. The density of closed triads is not different from open triads with regards to releases. These findings are consistent across all four models, with or without band leader fixed effects, and with OLS and NB specifications.
This suggests that comparing two sessions of the same size (the same number of triads), the one that features more forbidden triads (at least to a limit of forbidden triads proportion) can be more successful than the session that has only closed and open triads. The paradoxical triad of strong-strong-absent ties seems to be the best predictor of success – even if we compared sessions of the same band leader.
Of the control variables only three are consistent across all four models: Having a higher proportion of newbies means a lower number of releases. A better past track record (higher median number of releases for the past recordings of the musicians on the session) means a higher number of releases to the target session. The overall number of releases decreases as years advance – indicating either a long-range censoring, or a general decline in the level of success for the average jazz session over time.
All four models show the same pattern for both the density of forbidden triads, and the density of closed triads. Increasing forbidden triads density increases the predicted number of releases as well, with a peak of around .50 forbidden triad density (half of the connected triads are forbidden triads). The particular initial and peak predicted number of releases vary from model to model, and the predicted boost to the number of releases just from moving from no forbidden triads to the optimal range is between 1 and 8 %. There is no evidence, however, to any benefits from closure. All four models show basically a flat line for closed triad density (or a line well within the initial confidence intervals). The reference category is the density of open triads (the three densities sum to one); these findings thus show that forbidden triads outperform both open and closed triads in their mid-region.
The example of Miles Davis indicates that high-profile band leaders might take special advantage of network structures, such as forbidden triads. This raises the question whether the findings of our statistical modeling is robust to omitting high profile band leaders. To test this, I omitted 131 most outstanding jazz artists – those that received the National Endowment of the Arts Jazz Masters nomination.^{9} The results without the sessions of the outstanding band leaders are practically identical to the results in the full dataset. (See Appendix D for details.)
To summarize, jazz sessions are more successful if musicians have forbidden triads in their collaboration network: if there is a diversity of socially evolved styles, striking a productive balance between familiarity and freshness. It is important to contrast the consistent finding about the significance of forbidden triads to the ambiguous evidence for the importance of instrument combinations. Distinctiveness in combining instrument is a negative predictor of success in three out of the four models, contrary to the perceived image of jazz as a domain of constant experimentation. It seems that an unexpected mix of instruments is not enough to generate a new sound. Forbidden triads are about a more subtle, more social kind of experimentation that can tap into a novel combination of socially evolved styles rather than merely a combination of instruments.
Conclusions
The history of the jazz field is about constant experimentation – a quest for new sounds. This paper is about the source of new sounds that make a recording successful. I tested hypotheses about the structure of the collaborative network, and hypotheses about attributes of musicians, and the session. The most promising alternative explanation about the importance of instrument combinations was not supported by our regression models. A distinctive instrumentation is a liability, if anything: most models show a significant negative coefficient. Our analysis suggests a different source for new sounds, based on the combination of jointly evolved styles, rather than simply instruments.
I represented a sessions’ collaboration network by the density of triad types. The general imagery of social networks parses triads into two kinds: closed triads that make up cohesive clusters, and open triads that bridge between these clusters. Strong ties are seen to be related with closure, and weak ties are seen as the building blocks of open triads. The third possibility: the openness of strong ties is seen as anomalous, a rare and residual category, a triad that is forbidden (Granovetter 1973). Thus far no one questioned the intuition of Granovetter from more than four decades ago: forbidden triads have not been investigated as network structures of interest.
I argue that forbidden triads are of crucial importance to understand innovation. Novelty is about an interplay of familiar and novel, about the interplay of trusted ties and an unfamiliar face. A forbidden triad is a molecule of an innovative network. In that triad two familiar dyads meet at one of their nodes. A musician invites two co-players to play together for the first time. Strangers are also meeting for the first time, but they have no familiarity to start from. The central node in a forbidden triad can mobilize the trust that he or she has with both of the alters, and he or she can start the translating work between the two jointly evolved styles that can lead to a new sound.
The time resolution of sessions was set to the year of recording. Though most sessions had the recording day available, in several instances the day was missing, or was set to an obviously estimated date (like January 1st).
The high number of different kinds of instruments indicate the innovative nature of the jazz field. As a comparison, the largest collection of musical instruments, the MIMO project (Musical Instrument Museums Online; mimo-international.com) lists a total of 1140 different kinds of instruments – an order of magnitude less. The current nomenclature of 11,940 instruments is a result of weeks of careful coding and collapsing. Jazz musicians have played everything from car parts to kitchen sinks and digital noises
I was also generating random worlds with 2, 5 and 10 year windows, but the 1 year window is the closest to the logic of the jazz field, and it is also the strictest in the availability of musicians. Over 5 years a musician can completely change his or her style, and over 10 years a musician might not even be alive.
A permutation test on the full sample was not practically feasible, so a random sample of 500,000 triads from both the observed, and the rewired triads was taken, and the model was estimated 10,000 times with a randomly permuted dependent variable to generate a distribution of coefficients, and an estimate of p value for each.
I used an Epanechnikov kernel function, and an optimal bandwidth of 0.061 obtained by the normal scale rule (Härdle et al. 2004).
Although tie strength and the number of past sessions are closely related, they do not measure the same thing. Imagine two sessions: one in which there is a high median tie strength, yet a relatively low number of past sessions, and one with zero median tie strength, and a high number of past sessions. In the first session musicians played all their past sessions with each other, while in the second one they accumulated diverse experiences.
Declarations
Acknowledgements
This article builds on concepts developed in prior publications with David Stark and Mathijs de Vaan. I am thankful for their assistance and helpful comments, as well as for valuable insights of Albert-Laszlo Barabasi, Janos Kertesz, Levente Littvay, Thomas Rooney, Roberta Sinatra, Michael Szell, Orsolya Vasarhelyi, Johannes Wachs, and two anonymous reviewers. I am also thankful for the insights and assistance of Carl Nordlund in collecting, preparing, and cleaning the data.
Funding
Research for this manuscript was supported by the US National Science Foundation (award #1123807).
Author’s contributions
The manuscript has one author.
Competing interests
The author declare that he has no competing interest.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Allison PD, Waterman RP (2002) Fixed-effect negative binomial regression models. Sociol Methodol 32:247–265View ArticleGoogle Scholar
- Burt RS (1992) Structural Holes. In: The social structure of competition, pp 8–49Google Scholar
- Burt RS (2005) Brokerage and closure. An introduction to social capital. Oxford University Press, New YorkGoogle Scholar
- Burt RS (2015) Reinforced structural holes. Soc Networks 43:149–161View ArticleGoogle Scholar
- Cameron CA, Trivedi PK (1998) Regression analysis of count data, 2nd edn. EditionGoogle Scholar
- Centola D (2015) The social origins of networks and diffusion. Am J Sociol 120(5):1295–1338View ArticleGoogle Scholar
- Charry E (2005) Reviewed work ( S ): the jazz discography, version 4. 4 [ CD-ROM ] by tom Lord; 85 years of recorded jazz ( 1917-2002, A-Z complete ) [ CD-ROM ] by Walter Bruyninckx and Domi Truffandier. Notes 61(3):833–837View ArticleGoogle Scholar
- Cleveland WS (1979) Robust locally weighted regression and smoothing Scatterplots. J Am Stat Assoc 74(368):829–836MathSciNetView ArticleMATHGoogle Scholar
- Davis, M. and with Q Troupe. 1989. The autobiography. Simon and SchusterGoogle Scholar
- de Vaan M, Stark D, Vedres B (2015) Game changer: the topology of creativity. Am J Sociol 120(4):1–51Google Scholar
- Granell C, Darst RK, Arenas A, Fortunato S, Gómez S (2015) Benchmark model to assess community structure in evolving networks. Phys Rev E 92(1):12805ADSView ArticleGoogle Scholar
- Granovetter M (1973) The strength of weak ties. Am J Sociol 78(6):1360–1380View ArticleGoogle Scholar
- Greene WH (2003) Econometric analysis. Prentice Hall, Upper Saddle RiverGoogle Scholar
- Härdle W, Müller M, Sperlich S, and Werwatz A (2004). Nonparametric and Semiparametric models. Springer Verlag, BerlinGoogle Scholar
- Hausman J, Hall BH, Griliches Z (1984) Econometric models for count data with an application to the Patents-R & D Relationship. Econometrica 52(4):909–938View ArticleGoogle Scholar
- Kirschbaum C, Ribeiro PF (2016) How social network role, geographical context and territorial mobility mediate the adoption of Transgressive styles in the jazz field. J Econ Geogr 16:1187–1210Google Scholar
- Krackhardt D, Kilduff M (2002) Structure, Culture and Simmelian Ties in Entrepreneurial Firms. Soc Networks 24(3):279–290View ArticleGoogle Scholar
- Lord, T. 2010. “The jazz discography”Google Scholar
- Onnela JP, Saramäki J, Kertész J, Kaski K (2005) Intensity and coherence of motifs in weighted complex networks. Phys Rev E Stat Nonlinear Soft Matter Phys 71(6):1–4View ArticleGoogle Scholar
- Opsahl T, Panzarasa P (2009) Clustering in weighted networks. Soc Networks 31(2):155–163View ArticleGoogle Scholar
- Phillips DJ (2011) Jazz and the disconnected: City structural disconnectedness and the emergence of a jazz canon, 1897-1933. Am J Sociol 117(2):420–483View ArticleGoogle Scholar
- Phillips DJ (2013) Shaping Jazz : cities, labels, and the global emergence of an art form. Princeton University Press, PrincetonView ArticleGoogle Scholar
- Saramäki J, Kivelä M, Onnela JP, Kaski K, Kertész J (2007) Generalizations of the clustering coefficient to weighted complex networks. Phys Rev E Stat Nonlinear Soft Matter Phys 75(2):2–5View ArticleGoogle Scholar
- Vedres B, Stark D (2010) Structural Folds : generative disruption in. Am J Sociol 115(4):1150–1190View ArticleGoogle Scholar
- Watts DJ (1999) Networks, dynamics, and the small world phenomenon. Am J Sociol 105(2):493–527View ArticleGoogle Scholar
- Xie J, Kelley S, Szymanski BK (2013) Overlapping community detection in networks. ACM Comput Surv 45(4):1–35View ArticleMATHGoogle Scholar