Research Article  Open Access
Stjepan Begušić, Zvonko Kostanjčar, Dejan Kovač, H. Eugene Stanley, Boris Podobnik, "Information Feedback in Temporal Networks as a Predictor of Market Crashes", Complexity, vol. 2018, Article ID 2834680, 13 pages, 2018. https://doi.org/10.1155/2018/2834680
Information Feedback in Temporal Networks as a Predictor of Market Crashes
Abstract
In complex systems, statistical dependencies between individual components are often considered one of the key mechanisms which drive the system dynamics observed on a macroscopic level. In this paper, we study crosssectional timelagged dependencies in financial markets, quantified by nonparametric measures from information theory, and estimate directed temporal dependency networks in financial markets. We examine the emergence of strongly connected feedback components in the estimated networks, and hypothesize that the existence of information feedback in financial networks induces strong spatiotemporal spillover effects and thus indicates systemic risk. We obtain empirical results by applying our methodology on stock market and real estate data, and demonstrate that the estimated networks exhibit strongly connected components around periods of high volatility in the markets. To further study this phenomenon, we construct a systemic risk indicator based on the proposed approach, and show that it can be used to predict future market distress. Results from both the stock market and real estate data suggest that our approach can be useful in obtaining earlywarning signals for crashes in financial markets.
1. Introduction
Connectivity patterns in complex systems and their dynamic properties have been the focus of extensive research in physical, biological, neurological, and social systems [1–4]. In many studies, identification of strong dependencies between interconnected components has been linked to systemic risk—the risk associated with the collapse of the entire system [5–8]. This line of research is especially prominent in modeling risk in financial systems [9, 10], where dependent components within the system (e.g., banks, companies, and financial assets) are more likely to fail simultaneously and influence other connected components (a phenomenon known also as spillover effect), thus inducing a potential cascade of failures in the entire system [11]. However, due to the dynamic nature of financial systems and often complex dependency relationships, the identification and quantification of these effects is generally not a trivial task [12, 13]. In addition, financial variables and time series (e.g., prices, returns, and volumes) are known to exhibit strongly nonGaussian characteristics, heavy tails, and longrange dependence, which calls into question standard parametric approaches [14].
The complexity of economic and financial systems have been in the focus of research from various perspectives, employing Ising models [15, 16], agentbased models [17–19], and game theory [20]. The instabilities therein, observed as crises and crashes [21, 22], are especially elusive and hard to model and predict [23, 24]. Generally, connectivity patterns in financial markets are modelled by estimating and analyzing graphs of financial assets [25], which have been found to capture the structural properties of these complex systems, such as the hierarchical structures captured by spanning trees in financial markets [26, 27]. Empirical research on connectedness in financial systems and the relation to systemic risk has intensified in the aftermath of the 2008 subprime crisis, focusing either on contagion within the banking sector or the comovement in financial markets [28]. Longin and Solnik [29] first provided formal evidence of increased correlations during bear markets, and recent studies report that volatility crosscorrelations exhibit long memory meaning that once high volatility (risk) is spread across the entire market, it could last for a long time [30]. Adrian and Brunnermeier’s and the systemic expected shortfall (SES) by Acharya et al. [31] quantify the potential distress of financial institutions conditional on other institutions’ poor performance, thus measuring the spillover of losses within the financial sector. Kritzman and Li [32] quantify the divergence of the cross section of financial returns from their historical behavior expressed as the Mahalanobis distance, and find that it can be used similarly to implied volatility in sets of assets without liquid option markets, while accounting for their interactions. To measure the total contribution of assets to the systemic risk of the entire market, Kritzman et al. [33] propose the absorption ratio, based on the principal component analysis of the cross section of financial returns. A more detailed look into the connectivity patterns in financial systems was proposed by Billio et al. [34], who analyzed the dynamic causality patterns in networks of hedge funds, brokers, insurance companies, and banks. They report a highly asymmetric relationship during the subprime crisis of 2008 and find that the proportion of significant causal relationships in the network increases with the financial distress and crises in the market. Recently, Curme et al. [35] introduced a numerical method for validating timelagged correlation networks of assets and found a growing number of statistically validated links and the rise of instability in financial networks. Although the stateoftheart approaches employ correlationbased measures and Granger causality tests for inference of dependency relationships in financial networks, the assumptions of linearity and Gaussianity of these methods are often violated with financial data. In addition, the conclusions drawn from such analyses require further longrange historical backtests of the relationship between specific network patterns and systemic risk in the markets which would include more systemic events than the single 2008 subprime crisis.
In this paper, we investigate the dynamic relationships within a network of financial assets, their evolution through time and relation to the systemic risk in the market. We take a nonparametric approach to identify and validate timelagged crosssectional links between pairs of assets in a financial market. Based on the informationtheoretic concept of entropy which quantifies uncertainty, we measure the dependence between and within time series as a reduction in uncertainty, as quantified by Schreiber’s transfer entropy [36]. The concept of entropy has been used to measure sequential irregularity in many time series applications, with notable results in finance. Moreover, transfer entropybased methods yield stateoftheart results in detecting information flows in computational neuroscience, bioinformatics, and financial economics [37]. Specific financial applications include estimation of serial irregularities and risk in time series or returns and inference of the global dependence networks of financial indices [20, 38–42]. We expand on previous results by investigating the evolution of dynamic causal networks (sometimes referred to as information flow networks) through time and analyzing their association with systemic risk in the market. Moreover, we focus on the emergence of information feedback within these networks and hypothesize that strongly connected feedback components may indicate future distress in the system. The concept of feedback in financial systems was previously linked to systemic risk in various studies [22, 43], most notably, the DebtRank methodology proposed by Battiston et al. [44] uses interbank lending networks to assess the risk within the financial sector. Our approach moves beyond interbank lending networks and relies on time series of returns for any set of financial assets to infer directed dependency networks and study the information feedback within. In addition, previous approaches often depend on fundamental firmlevel financial data, available only in quarterly time intervals and often heterogeneous in nature, while in this paper we estimate dependency networks using asset prices from financial markets, allowing for wider areas of application.
Based on the proposed methodology for estimating dependency networks of financial assets from time series of asset returns, we examine the general levels of predictability in the market and the topologies of the estimated dependency networks. Furthermore, we study the emergence of information feedback in the networks and introduce a networkbased systemic risk indicator to test our hypothesis. We apply the proposed approach to 9 U.S. sector indices on a period from 1999 to 2016 and a selection of S&P 500 constituent company stocks from 1980 to 2016. In addition, we consider the U.S. House Price Index [45] data and apply our approach to the real estate market as well. Our results suggest that the dynamic dependency networks exhibit strongly connected feedback components, particularly around periods of financial crises. The proposed systemic risk indicator is shown to yield predictive power for future market distress, both for the two stock market datasets (sector indices and individual stocks), and the real estate market. These results demonstrate the validity of our approach and indicate that the proposed methodology can be used to construct earlywarning signals for crashes in financial markets.
2. Methods and Data
2.1. Information Theoretic Causality Measures
In thermodynamics and statistical mechanics, entropy is a measure of disorder in a system. In information theory, it is a quantification of uncertainty of a process, based on the Shannon information content of an event : [46]. For a sequence of events , entropy is defined as the average information:
In analogy, the joint entropy for two variables and is defined with the joint probabilities in the sum. The entropy is maximal when all events are equally probable, meaning their distribution is uniform, and minimal (equal to zero) for deterministic processes [47]. In analogy with (1), the idea of conditional entropy measures the uncertainty in left after accounting for the context in :
To measure causality relationships between time series, the most common approach is the WienerGranger concept of causality [48]: if the prediction of time series given its own past is improved by using the past values of another time series , then [49]. Although the most popular approach to Granger causality is based on estimation of VAR models, Schreiber [36] proposed the notion of transfer entropy as a nonparametric version of Granger causality. In the information theoretic sense, transfer entropy is defined as the amount of uncertainty in given its own past reduced by including the past of : where the uncertainty is quantified using the concept of conditional entropy : the uncertainty left in after accounting for the context [37]. Note that owing to the lack of autocorrelation in return time series, we may restrict the past of to and past of to steps and thus reduce the dimensionality of the estimation procedures.
By incorporating Shannon’s entropy given in (2), the transfer entropy formula from (3) can be specified as
The above expression is also known as the KullbackLeibler divergence between distributions and [36]. If the distribution given its own past were independent of , the KL divergence given in (4) would be equal to 0. On the other hand, if would deterministically predict , the KL divergence would reach its maximum value, equal to the entropy . In the GrangerWiener causality sense, by using expression (4) we measure the improvement in predicting when knowing , conditional on the past of itself. It has been shown that for Gaussian variables, transfer entropy is equal to Granger causality [50], which implies that the standard linear and VAR modelbased methods are a special case of the proposed approach.
Due to a positive bias in the estimates , Marschinski and Kantz [38] propose the effective transfer entropy for financial time series, calculated by subtracting the mean of the surrogate measurements , using random permutations of the source time series . In order to measure the fraction of the maximum possible value, we employ the concept of normalized transfer entropy, used in neurophysiology and computational neuroscience [51, 52]. It is defined as the effective transfer entropy divided by the entropy of given its own past, which is the maximum theoretic value of (for a case when ):
This measurement represents the fraction of information in not explained by its own past which is explained by including the past of .
To include potential serial dependency of each time series on its own past , we also estimate the mutual information: . In the discrete case, the expression can be reformulated as follows:
The above expression again corresponds to the KL divergence [47] between the joint distribution and the product of marginal distributions . If the return distributions were independent, the joint distribution would be equal to the product of marginals and the KL divergence would be equal to 0. On the other hand, if the subsequent returns were functionally (deterministically) dependent, then the KL divergence would reach its maximum value, equal to the entropy . In addition, the mutual information measure for Gaussian distributions is determined by the Pearson correlation coefficient —again implying that the proposed approach is a generalization of the correlationbased methods. In analogy with (5), we estimate the effective mutual information (where is estimated using the shuffled time series ) and normalize it by , which is its theoretical maximum.
2.2. Empirical Estimation
Evidently, distributions , , , and need to be estimated, commonly not a simple task due to scarcity of data. Various methods for discretizing asset returns for transfer entropy estimation have been utilized [40, 41], mainly based on binning. Specifically, due to the dynamic nature of financial systems, dependencies are estimated using time windows rather than the entire history, which makes the studied time series considerably short. Since a large number of bins may significantly deteriorate the estimation of multidimensional distributions, we significantly reduce the number of variables by limiting returns into just two classes based on their sign: positive and negative. However, rather than just taking the signs of returns and counting their occurrences on a given time window, we employ concepts from fuzzy set theory [53] and define a sigmoid membership function which encodes realized returns to two classes (positive and negative) with membership and : where is a parameter defining the steepness of the sigmoid function. Note that . Therefore, the sigmoid functions define the membership of for the positive and negative classes, depending on its magnitude—very positive returns will have much higher (and therefore smaller ), and vice versa, as shown in Figure 1.
To better understand the procedure of estimating discrete distributions of returns with just two discrete realizations based on sigmoid membership functions, we give an illustrative example: let be a time series of asset returns at discrete points in time. By simply counting the occurrences of positive and negative returns , one can estimate the discrete distribution of two return classes: and . However, when the sigmoid membership functions are applied, one obtains and . From these memberships, the probabilities can be estimated as (same for ): and . The procedure for multidimensional returns is analogous to this one—returns are discretized to two classes using the proposed sigmoidal membership function, and discrete distributions are estimated by summing the memberships of the samples. In this fashion, we do not treat all signs equally but through memberships assign more weights to those returns which have larger magnitudes, thus, very small either positive or negative returns are not as significant as larger ones. By doing so, we manage to keep the dimensionalities of discrete distributions in (6) and (4) low, while accounting for the magnitude of returns.
To obtain directed causality networks from multiple time series (which represent components of a dynamical complex system), we estimate for all pairs of time series . From these we infer directed networks with weights defined as
In the constructed causality networks, directed edges exist if , with weights equal to the normalized transfer entropy . Similarly, selfloops exist if and their weights correspond to the estimated normalized mutual information . Therefore, we estimate a temporal network where links represent causality relationships between individual financial assets (including selfloops, which indicate serial dependency).
In this contribution, we provide empirical results by performing our analysis on three distinct datasets: (i) daily prices of 9 U.S. sector indices on a period from 1990 to 2017, (ii) daily stock prices of 47 companies which are longestablished constituents of the S&P 500 index from 1980 to 2017, and (iii) quarterly house price indices of 51 U.S. states on a period from 1975 to 2017 [45]. Since prices generally have a positive drift (often modeled as Brownian motion), to measure causality between financial time series we use logarithmic returns, calculated as the change in the logarithm of the price :
Thus, in our analysis time series , correspond to the individual components of the considered financial systems (specifically: 9 sector indices, 47 companies, and 51 house price indices).
2.3. Information Feedback in Directed Dependency Networks
The proposed methodology is based on detecting pairs of time series where knowing the past of one helps predict the future of the other with respect to only knowing its own past. By estimating pairwise links in such a way, we obtain networks where the nodes represent individual time series and the directed links between them denote the estimated dependencies. Even though pairwise methods may not capture a common third driving factor, accounting for all of such effects is virtually impossible in realworld datasets. On a network level, the goal is not to measure the entire dependency of the system (for instance, as measured by the total correlation)—this would require estimation in highdimensional settings, which is especially problematic in systems such as financial markets, where long time windows may not be appropriate due to their dynamic properties. Rather than that, we are interested in the patterns created by the estimated dependency networks, inferred from pairwise links. Note that these are not instantaneous correlations (which would be measured by the correlation/covariance matrices), but rather timelagged effects which may not exist even in the presence of high correlations, and represent a nonlinear extension of the wellknown Granger causality [54].
We hypothesize that feedback effects in the dependency structure of financial assets are symptomatic of severe inefficiencies in the system, and thus are related to the overall level of systemic risk. We define information feedback not only as a bidirectional dependency (or information transfer, as measured by transfer entropy) estimated in pairs of assets, but also as a loop of any size in the network, forming a pattern of cyclic dependency. This is related closely to strongly connected components (SCC) from network theory—defined as subgraphs consisting of nodes which are all reachable from every other node within the same subgraph—as shown in Figure 2.
Evidently, the emergence of SCCs indicates feedback in the networks, not only between pairs of nodes, but also cycles through multiple nodes and edges. We measure this by employing Tarjan’s procedure [56] for identifying SCCs in each network. The procedure is a depthfirst search algorithm which traverses all nodes and their respective neighbors, and partitions the original directed graph into subgraphs corresponding to the SCCs. The algorithm passes once through each node, building a forest of trees and subtrees containing nodes reachable from each traversed node, while keeping track of the highest reachable parent node for each traversed node in the graph (since these links are not necessarily preserved in the trees). Nodes which contain a link to a parent in their tree or another node which may link to a common parent in the tree form a strongly connected component, including all other nodes in their subtree. The algorithm pseudocode for a set of vertices and edges is given below.
 
Algorithm 1. Tarjan’s Strongly Connected Component Algorithm. 
The algorithm does not depend on the ordering of nodes or the choice of the first root node. Moreover, since the depthfirst search traverses each node only once, the computational complexity of . We employ Tarjan’s algorithm to detect SCCs in the estimated directed dependency networks obtained from financial time series, and study the properties and emergence of information feedback in the system.
3. Results
3.1. U.S. Stock Market
First, we analyze the dependency networks of the U.S. financial markets represented by the 9 sector indices and 47 stocks of S&P 500 constituent companies. Before estimating temporal networks, to measure a general amount of predictability we estimate the entropies and conditional entropies for all stocks , and conditional entropies for all stock pairs on a rolling time window of year and a step of 1 day. Figure 3 shows the estimated entropies of the 47 stocks of S&P 500 constituent companies, averaged over all companies and pairs , subtracted from the theoretical maximum entropy, thus quantifying the amount of predictability in the time series of returns through time.
The evidence in Figure 3 suggest that the predictability of stock returns from their own past and the past of other stock returns generally diminishes through time, as indicated by the distinct negative trends in conditional entropies and the differences between the conditional entropies and the entropies of each stock . This may be interpreted through the implications of the efficient market hypothesis [57, 58] and suggests that through the last 4 decades the frictions in the U.S. stock market have decreased—this is in line with a reported increase of liquidity and reduction of trading costs in the U.S. stock market in the observed period from 1980 to 2017 [59].
We estimate the normalized transfer entropies for all pairs of stocks and analyze snapshots of inferred causality networks at different points in time, shown in Figure 4. It is evident that the causality networks exhibit considerable differences in different periods: (a)During the period of stable market growth from 1994 to 2006, the estimated network is sparse with relatively low values of normalized transfer entropy links.(b)During the Dotcom bubble and crash between 1999 and 2001, the network is much more dense with higher link weights.(c)Again during a period of market recovery from 2004 to 2006, the network is considerably lighter in terms of link weights.(d)During the subprime bubble and crisis from 2007 to 2009, the estimate network is almost fully connected with considerably heavier weights.
(a)
(b)
These results suggest that crosssectional causal relationships between stocks rise during turbulent market periods and are substantially lower when the entire system is stable.
To analyze this relationship, we measure the total number of links as a percentage of the maximum possible number of links in the network and the dynamics of this quantity through time. In addition, we study the emergence of feedback relationships in the estimated networks—here we define the elementary feedback pair as a situation where both and are nonnegative for a pair of time series . We count the number of pairs for which such relationships are found and again express it as a percentage of the total possible number of such pairs in a network. In addition, we inspect the average link weight (equal to the average for identified links), and display these quantities for the networks of 47 stocks of longestablished S&P 500 constituents in Figure 5.
The average link weight is shown to gradually decrease over time, which is in line with the predictability levels in Figure 3. However, due to the bias correction in (5), the number of nonnegative estimated normalized transfer entropies (i.e., the number of links) does not have this drift.
We estimate the SCCs in each network through the observed period and analyze the individual SCC sizes (number of nodes within the SCC), demonstrated in Figure 6.
These results reveal the nature of the feedback in temporal causality networks, suggesting that it mainly concentrates within one large SCC, rather than multiple commensurable components. This finding is especially interesting when considering the fact that for correlation matrices of contemporaneous asset returns, the first eigenvalue in the spectral decomposition (also known as market mode) is found to account for the majority of variance in the market [33, 34]. This finding suggests that the common risk component in interconnected financial markets is not only contemporaneous, but also spills over through temporal dependencies between assets, and that this effect seems to persist through time.
Moreover, the notable rise in the SCC size around 1998 which remains relatively high until after the 2008 subprime crash (with some fluctuations between the 2000 Dotcom bubble and the 2008 crash) might be evidence of a phase transition in the complex network of financial assets [2, 60]. The emergence of such a large SCC in the network might be a consequence of the investors forming patterns of feedback trading across almost the entire market—something reported both in individual and institutional investors [61]. A possible line of further research might try to find which behavioral properties of agents on a microstructural level cause such dynamics to be observed in the system [17, 62, 63].
In this paper, we hypothesize that the information feedback observed in directed dependency networks indicates inefficiencies in the financial market and may be used as a measure of systemic risk. To verify our hypothesis, we measure the amount of feedback in each network by only considering the first largest SCC (motivated by the fact that is significantly larger and consists of up to 100% of nodes in the network) and propose a measure based on the outdegrees of all nodes within the largest SCC:
We normalize by which is the maximum possible number of directed links in a fully connected giant SCC which would contain all nodes in the network. We call the quantity in (10) the SCC index and calculate from the networks estimated at each point in time. Due to the fact that the existence of feedback within the network does not necessarily mean that a negative shock is about to occur, we combine the estimated SCC index with the VIX index, calculated using implied volatilities on the S&P 500 index, also known as the fear index. The goal of including the VIX into the earlywarning indicator is to measure both the feedback and fear within the market—however, it is not in the scope of this paper to undertake the details of constructing a comprehensive earlywarning indicator for financial crises: this is left for further analyses which would include exogenous effects and data. In the following results, we only use the observed market data to demonstrate the predictive power of the proposed approach. The results for the SCC index and the indicator for both stocks and sector index datasets are shown in Figure 7.
The estimated SCC index builds up in the bull market prior to the Dotcom bubble of 2000, as well as just prior to the 2008 subprime mortgage crisis, but in both cases deflates with the aftermath of the crashes. The shift in the behavior of the system seen in 2003 has also been reported in a mutual informationbased analysis by Harré and Bossomaier [64]. It is important to note that events such as the September 11 attacks are exogenous to the system and thus cannot be expected to be found in the data and predicted by such endogenous approaches—such considerations are important, especially in the presence of socalled “twin crises” [65]. In the case of the subprime mortgage crisis, although some econometric evidence exists on liquidity and return dependence prior to the crisis [66, 67], the question remains to what extent the housing bubble was priced in the stock market. Our SCC index seems to rise just in the onset of the 2007 instabilities, but prior to the large drawdown in the S&P 500 index of 2008—a similar increase in risk was observed in other systemic risk measures [32, 33].
Generally, there are two assumptions that each earlywarning indicator should meet. First, it should warn prior to the arrival of the large shocks, thus ex ante not ex post. Second, the peaks indicating these shocks should be substantially higher compared to the bulk of the indicator quantifying the rest of the events. To verify that increased values of the SCC index and the proposed systemic risk indicator both rise prior to periods of increased volatility, we inspect the crosscorrelation functions between the two and the volatility of the S&P 500 index, as measured by the standard deviation of returns on a rolling time window of 1 year—the past 1year realized volatility . The crosscorrelation functions for both stocks and sector index data are shown in Figure 8, indicating that both considered signals increase prior to the increase in volatility, by ca. days for stocks and days for sector indices.
(a)
(b)
Furthermore, to test the capacity of the SCC index to predict future distress in the market, we perform a regression on the future 1year realized volatility of the S&P 500 index, calculated as the sample standard deviation. We choose this period even though results from the crosscorrelation analysis may suggest that the index calculated from U.S. stock market data may be predictive over a shorter time frame. Since different time windows for the estimation of the SCC index could very well yield different time frames for the prediction of volatility, this is left to further research and we proceed with the 1year time window both for the estimation of the SCC index and inference on forward volatility prediction. First, we define the reduced model where the input variables are the VIX indicator and the past 1year realized volatility , to account for the autoregressive nature of market volatility: . The VIX is included in the null model in order to investigate how much the proposed SCC index alone improves volatility prediction as opposed to standard techniques and signals. It is also important to note that the past volatility is calculated on a time period and future volatility on , meaning that there is no overlapping between the windows. In the expanded model, we include the SCC index : . To compare these, we use the adjusted measure (which takes into account the number of parameters in the model) and the Akaike information criterion (AIC)—note that the AIC is observed on an additive scale, and only the differences of AIC between models are interpretable, in such a way that a model with AIC reduced by 10 or more is considered to have substantial support [68]. The results in Table 1 demonstrate a significant improvement in future volatility prediction when the SCC index is included, as opposed to the reduced models including only past volatility and the VIX index. This is implied both by the increase in the adjusted measure and the Akaike information criterion (AIC) which is strongly decreased in the expanded model. Although from a modelling perspective the of 0.45 and 0.5 for the expanded models may not seem as an exceptional fit, these are not distant from other results in financial research; for instance, the fit of Shiller’s CAPE on the 10year forward returns which is around 0.5–0.6 (depending on the period) [69]. However, to the best of our knowledge there are no similar results for such short to midterm predictions of market volatility (i.e., the forward 1year period used here). In addition, to see how the combination of VIX and the SCC index fares against the linear model, we include the interaction term in the regression, and observe that the model does not seem to improve significantly, as suggested by the and AIC measures. However, we obtain the best results for the AIC when estimating a linear model using only the interaction term —for both the stocks and sector index datasets, implying that this single variable captures the most important dynamics pertaining to future volatility prediction, and allows for the simplest form of the model. Owing to the normalization of the SCC index by the maximum possible size of the network, both the SCC index estimated from 47 stocks and the one estimated using 9 sector indices perform very consistently with respect to the magnitude of the estimated coefficients. In addition, the fact that the respective models fit very similarly indicates that the proposed methodology captures common effects in the market, observable from different datasets.

3.2. U.S. House Price Index
In addition to the financial market data, we also perform our analysis on the U.S. house price data, which consists of quarterly house price indices for 51 U.S. states from 1970 to 2017. We estimate the directed dependency networks on a time window of quarters (5 years), and compare the calculated SCC index with the overall house price index for the entire U.S. real estate market in Figure 9.
It is evident from the results that the estimated SCC index is high in the midst of the 2007–2009 housing bubble, indicating that there were strong feedback components and dependencies between the real estate prices in U.S. states. We repeat the previous analysis and inspect the crosscorrelation between the estimated SCC index and the volatility of the U.S. HPI index, estimated on a rolling window of 5 years (i.e., 20 quarters)—the results are shown in Figure 10.
Even though the SCC index was estimated on a rolling time window of length quarters (i.e., 5 years), the crosscorrelation in Figure 10 suggest that it is predictable for future volatility on a shorter time span, from 2 to 8 quarters (half to two years). To measure the extent to which volatility prediction is improved by including the SCC index, we employ regressions on the future volatility of the U.S. HPI index. To avoid overlapping windows in calculating input and output variables (past and future volatility), we adopt a 2year window (8 quarters) to estimate both the past volatility and the future volatility which is the dependent variable in the model . The reduced model reads: . The expanded model includes the SCC index: . The results of the performed regressions are given in Table 2.

The results suggest that a significant improvement in the model is introduced by including the SCC index, indicating our proposed indicator manages to capture these effects and timely indicates the systemic risk associated with the U.S. housing market. The strength of the relationship is similar to the one found in financial market data in Section 3.1, although volatilities are generally lower in real estate prices. These results additionally support our hypothesis and extend the applicability of our approach from stock market data to economic complex systems such as the housing market.
4. Summary
In this contribution, we have analyzed directed dependency networks of financial assets, estimated using information theoretic concepts of transfer entropy and mutual information. We employed a resampling technique to remove the estimation bias and obtain validated directed networks. Firstly, we found that the general predictability levels have been diminishing through the last decades in the U.S. stock market, which is coincidental with the reduction in bidask spreads and transaction costs, and may be interpreted as an indicator of rising market efficiency. In addition, we examined the estimated directed dependency networks for various periods in time, and report that the networks exhibit strong connections with feedback loops during periods of high volatility and market crashes, as opposed to sparse networks estimated during periods of stable market growth. To test the hypothesis that information feedback in the financial network indicates elevated systemic risk levels, we estimated directed temporal networks on a rolling time window and identified the strongly connected component (SCC) for each time step. To estimate the contribution of the SCC to the entire system, we define the SCC index as the sum of all SCC node outdegrees, normalized by the maximum theoretical number of links. Using stock market and real estate data, we show that the SCC index can be used to timely indicate systemic risk and predict future market volatility with a remarkable precision and consistently in all the considered datasets. These results indicate that our methodology yields relevant information for evaluating systemic risk in financial networks, and may be useful for both academics and practitioners as a tool for developing earlywarning signals for future market crashes.
Data Availability
The sector index and stock price data used in this paper were obtained from Yahoo! Finance, and are available from Stjepan Begusic (stjepan.begusic@fer.hr) upon request. The U.S. house price data was obtained from the Federal Reserve Bank of St. Louis database (FRED) [45], where it is openly available.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this paper.
Acknowledgments
This work has been supported in part by the Croatian Science Foundation under the project 5349. The authors would also like to thank the reviewers for their insights and comments which helped improve the quality of the paper.
References
 G. Caldarelli, ScaleFree Networks: Complex Webs in Nature and Technology, Oxford University Press, 2007.
 M. E. J. Newman, “The structure and function of complex networks,” SIAM Review, vol. 45, no. 2, pp. 167–256, 2003. View at: Publisher Site  Google Scholar
 E. Bullmore and O. Sporns, “Complex brain networks: graph theoretical analysis of structural and functional systems,” Nature Reviews Neuroscience, vol. 10, no. 3, pp. 186–198, 2009. View at: Publisher Site  Google Scholar
 L. E. Blume, W. A. Brock, S. N. Durlauf, and Y. M. Ioannides, “Identification of social interactions,” Handbook of Social Economics, vol. 1, 2011. View at: Publisher Site  Google Scholar
 D. J. Watts, “A simple model of global cascades on random networks,” Proceedings of the National Academy of Sciences of the United States of America, vol. 99, no. 9, pp. 5766–5771, 2002. View at: Publisher Site  Google Scholar
 L. Blume, D. Easley, J. Kleinberg, R. Kleinberg, and É. Tardos, “Which networks are least susceptible to cascading failures?” in 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science, pp. 393–402, Palm Springs, CA, USA, 2011. View at: Publisher Site  Google Scholar
 F. Schweitzer, G. Fagiolo, D. Sornette, F. VegaRedondo, A. Vespignani, and D. R. White, “Economic networks: the new challenges,” Science, vol. 325, no. 5939, pp. 422–425, 2009. View at: Publisher Site  Google Scholar
 L. Blume, D. Easley, J. Kleinberg, R. Kleinberg, and É. Tardos, “Network formation in the presence of contagious risk,” ACM Transactions on Economics and Computation, vol. 1, no. 2, pp. 1–20, 2013. View at: Publisher Site  Google Scholar
 L. Blume and D. Easley, “Evolution and market behavior,” Journal of Economic Theory, vol. 58, no. 1, pp. 9–40, 1992. View at: Publisher Site  Google Scholar
 D. Bisias, M. Flood, A. W. Lo, and S. Valavanis, “A survey of systemic risk analytics,” Annual Review of Financial Economics, vol. 4, pp. 255–296, 2012. View at: Publisher Site  Google Scholar
 N. M. Boyson, C. W. Stahel, and R. M. Stulz, “Hedge fund contagion and liquidity shocks,” The Journal of Finance, vol. 65, no. 5, pp. 1789–1816, 2010. View at: Publisher Site  Google Scholar
 M. Getmansky, A. W. Lo, and I. Makarov, “An econometric model of serial correlation and illiquidity in hedge fund returns,” Journal of Financial Economics, vol. 74, no. 3, pp. 529–609, 2004. View at: Publisher Site  Google Scholar
 Z. Adams, R. Füss, and R. Gropp, “Spillover effects among financial institutions: a statedependent sensitivity valueatrisk approach,” Journal of Financial and Quantitative Analysis, vol. 49, no. 03, pp. 575–598, 2014. View at: Publisher Site  Google Scholar
 R. Cont, “Empirical properties of asset returns: stylized facts and statistical issues,” Quantitative Finance, vol. 1, no. 2, pp. 223–236, 2001. View at: Publisher Site  Google Scholar
 L. Barnett, J. T. Lizier, M. Harré, A. K. Seth, and T. Bossomaier, “Information flow in a kinetic Ising model peaks in the disordered phase,” Physical Review Letters, vol. 111, no. 17, article 177203, 2013. View at: Publisher Site  Google Scholar
 D. Sornette, “Physics and financial economics (1776–2014): puzzles, Ising and agentbased models,” Reports on Progress in Physics, vol. 77, no. 6, article 062001, 2014. View at: Publisher Site  Google Scholar
 E. Samanidou, E. Zschischang, D. Stauffer, and T. Lux, “Agentbased models of financial markets,” Reports on Progress in Physics, vol. 70, no. 3, pp. 409–450, 2007. View at: Publisher Site  Google Scholar
 W. Bolt, M. Demertzis, C. G. H. Diks, and M. J. van der Leij, “Complex methods in economics: an example of behavioral heterogeneity in house prices,” 2011, De Nederlandsche Bank Working Paper No. 329, https://ssrn.com/abstract=1977238. View at: Publisher Site  Google Scholar
 W. Bolt, M. Demertzis, C. G. H. Diks, C. H. Hommes, and M. van der Leij, “Identifying booms and busts in house prices under heterogeneous expectations,” 2014, Tinbergen Institute Discussion Paper 14157/II, https://ssrn.com/abstract=2541666. View at: Publisher Site  Google Scholar
 M. Harré and T. Bossomaier, “Strategic islands in economic games: isolating economies from better outcomes,” Entropy, vol. 16, no. 9, pp. 5102–5121, 2014. View at: Publisher Site  Google Scholar
 J. B. Rosser, From Catastrophe to Chaos: A General Theory of Economic Discontinuities, Kluwer Academic, 1991. View at: Publisher Site
 D. Sornette, “Critical market crashes,” Physics Reports, vol. 378, no. 1, pp. 1–98, 2003. View at: Publisher Site  Google Scholar
 A. Majdandzic, B. Podobnik, S. V. Buldyrev, D. Y. Kenett, S. Havlin, and H. Eugene Stanley, “Spontaneous recovery in dynamical networks,” Nature Physics, vol. 10, no. 1, pp. 34–38, 2014. View at: Publisher Site  Google Scholar
 C. Diks and J. Wang, “Can a stochastic cusp catastrophe model explain housing market crashes?” Journal of Economic Dynamics and Control, vol. 69, pp. 68–88, 2016. View at: Publisher Site  Google Scholar
 J.P. Onnela, A. Chakraborti, K. Kaski, J. Kertsz, and A. Kanto, “Asset trees and asset graphs in financial markets,” Physica Scripta, vol. T106, no. 1, p. 48, 2003. View at: Publisher Site  Google Scholar
 R. N. Mantegna, “Hierarchical structure in financial markets,” The European Physical Journal B, vol. 11, no. 1, pp. 193–197, 1999. View at: Publisher Site  Google Scholar
 M. Tumminello, C. Coronnello, F. Lillo, S. Miccichè, and R. N. Mantegna, “Spanning Trees and bootstrap reliability estimation in correlationbased networks,” International Journal of Bifurcation and Chaos, vol. 17, no. 7, pp. 2319–2329, 2007. View at: Publisher Site  Google Scholar
 W. Silva, H. Kimura, and V. A. Sobreiro, “An analysis of the literature on systemic financial risk: a survey,” Journal of Financial Stability, vol. 28, pp. 91–114, 2017. View at: Publisher Site  Google Scholar
 F. Longin and B. Solnik, “Extreme correlation of international equity markets,” The Journal of Finance, vol. 56, no. 2, pp. 649–676, 2001. View at: Publisher Site  Google Scholar
 D. Wang, B. Podobnik, D. Horvatić, and H. E. Stanley, “Quantifying and modeling longrange cross correlations in multiple time series with applications to world stock indices,” Physical Review E, vol. 83, no. 4, 2011. View at: Publisher Site  Google Scholar
 V. V. Acharya, L. H. Pedersen, T. Philippon, and M. Richardson, “Measuring systemic risk,” Review of Financial Studies, vol. 30, no. 1, pp. 2–47, 2017. View at: Publisher Site  Google Scholar
 M. Kritzman and Y. Li, “Skulls, financial turbulence, and risk management,” Financial Analysts Journal, vol. 66, no. 5, pp. 30–41, 2010. View at: Publisher Site  Google Scholar
 M. Kritzman, Y. Li, S. Page, and R. Rigobon, “Principal components as a measure of systemic risk,” The Journal of Portfolio Management, vol. 37, no. 4, pp. 112–126, 2011. View at: Publisher Site  Google Scholar
 M. Billio, M. Getmansky, A. W. Lo, and L. Pelizzon, “Econometric measures of connectedness and systemic risk in the finance and insurance sectors,” Journal of Financial Economics, vol. 104, no. 3, pp. 535–559, 2012. View at: Publisher Site  Google Scholar
 C. Curme, M. Tumminello, R. N. Mantegna, H. E. Stanley, and D. Y. Kenett, “Emergence of statistically validated financial intraday leadlag relationships,” Quantitative Finance, vol. 15, no. 8, pp. 1375–1386, 2015. View at: Publisher Site  Google Scholar
 T. Schreiber, “Measuring information transfer,” Physical Review Letters, vol. 85, no. 2, pp. 461–464, 2000. View at: Publisher Site  Google Scholar
 T. Bossomaier, L. Barnett, M. Harré, and J. T. Lizier, An Introduction to Transfer Entropy, Springer Nature, 2016. View at: Publisher Site
 R. Marschinski and H. Kantz, “Analysing the information flow between financial time series,” The European Physical Journal B, vol. 30, no. 2, pp. 275–281, 2002. View at: Publisher Site  Google Scholar
 S. Pincus and R. E. Kalman, “Irregularity, volatility, risk, and financial market time series,” Proceedings of the National Academy of Sciences of the United States of America, vol. 101, no. 38, pp. 13709–13714, 2004. View at: Publisher Site  Google Scholar
 O. Kwon and J.S. Yang, “Information flow between stock indices,” EPL (Europhysics Letters), vol. 82, no. 6, article 68003, 2008. View at: Publisher Site  Google Scholar
 T. Dimpfl and F. J. Peter, “The impact of the financial crisis on transatlantic information flows: an intraday analysis,” Journal of International Financial Markets, Institutions and Money, vol. 31, no. 1, pp. 1–13, 2014. View at: Publisher Site  Google Scholar
 L. Efremidze, J. A. DiLellio, and D. J. Stanley, “Using VIX entropy indicators for style rotation timing,” The Journal of Investing, vol. 23, no. 3, pp. 130–143, 2014. View at: Publisher Site  Google Scholar
 Z. Kostanjčar, S. Begušić, H. E. Stanley, and B. Podobnik, “Estimating tipping points in feedbackdriven financial networks,” IEEE Journal on Selected Topics in Signal Processing, vol. 10, no. 6, pp. 1040–1052, 2016. View at: Publisher Site  Google Scholar
 S. Battiston, M. Puliga, R. Kaushik, P. Tasca, and G. Caldarelli, “DebtRank: too central to fail? Financial networks, the FED and systemic risk,” Scientific Reports, vol. 2, no. 1, p. 541, 2012. View at: Publisher Site  Google Scholar
 US Federal Housing Finance Agency, AllTransactions House Price Index, Retrieved from FRED, Federal Reserve Bank of St. Louis, 2017.
 C. E. Shannon, “A mathematical theory of communication,” Bell System Technical Journal, vol. 27, no. 3, pp. 379–423, 1948. View at: Publisher Site  Google Scholar
 T. M. Cover and J. A. Thomas, Elements of Information Theory, WileyInterscience, 2005. View at: Publisher Site
 C. W. J. Granger, Investigating Causal Relations by Econometric Models and CrossSpectral Methods, Econometrica, 1969.
 A. Papana, C. Kyrtsou, D. Kugiumtzis, and C. Diks, “Simulation study of direct causality measures in multivariate time series,” Entropy, vol. 15, no. 12, pp. 2635–2661, 2013. View at: Publisher Site  Google Scholar
 L. Barnett, A. B. Barrett, and A. K. Seth, “Granger causality and transfer entropy are equivalent for Gaussian variables,” Physical Review Letters, vol. 103, no. 23, article 238701, 2009. View at: Publisher Site  Google Scholar
 B. Gourevitch and J. J. Eggermont, “Evaluating information transfer between auditory cortical neurons,” Journal of Neurophysiology, vol. 97, no. 3, pp. 2533–2543, 2007. View at: Publisher Site  Google Scholar
 S. A. Neymotin, K. M. Jacobs, A. A. Fenton, and W. W. Lytton, “Synaptic information transfer in computer models of neocortical columns,” Journal of Computational Neuroscience, vol. 30, no. 1, pp. 69–84, 2011. View at: Publisher Site  Google Scholar
 L. A. Zadeh, “Fuzzy sets,” Information and Control, vol. 8, no. 3, pp. 338–353, 1965. View at: Publisher Site  Google Scholar
 M. Prokopenko, J. Lizier, and D. Price, “On thermodynamic interpretation of transfer entropy,” Entropy, vol. 15, no. 2, pp. 524–543, 2013. View at: Publisher Site  Google Scholar
 P. Shannon, A. Markiel, O. Ozier et al., “Cytoscape: a software environment for integrated models of biomolecular interaction networks,” Genome Research, vol. 13, no. 11, pp. 2498–2504, 2003. View at: Publisher Site  Google Scholar
 R. Tarjan, “Depthfirst search and linear graph algorithms,” SIAM Journal on Computing, vol. 1, no. 2, pp. 146–160, 1972. View at: Publisher Site  Google Scholar
 E. F. Fama, “Efficient capital markets: a review of theory and empirical work,” The Journal of Finance, vol. 25, no. 2, p. 383, 1970. View at: Publisher Site  Google Scholar
 R. J. Shiller, “From efficient markets theory to behavioral finance,” Journal of Economic Perspectives, vol. 17, no. 1, pp. 83–104, 2003. View at: Publisher Site  Google Scholar
 C. M. Jones, “A century of stock market liquidity and trading costs,” 2002, https://ssrn.com/abstract=313681. View at: Publisher Site  Google Scholar
 I. Dobson, B. A. Carreras, V. E. Lynch, and D. E. Newman, “Complex systems analysis of series of blackouts: cascading failure, critical points, and selforganization,” Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 17, no. 2, article 026103, 2007. View at: Publisher Site  Google Scholar
 J. R. Nofsinger and R. W. Sias, “Herding and feedback trading by institutional and individual investors,” The Journal of Finance, vol. 54, no. 6, pp. 2263–2295, 1999. View at: Publisher Site  Google Scholar
 V. M. Eguíluz and M. G. Zimmermann, “Transmission of information and herd behavior: an application to financial markets,” Physical Review Letters, vol. 85, no. 26, pp. 5659–5662, 2000. View at: Publisher Site  Google Scholar
 L. Feng, B. Li, B. Podobnik, T. Preis, and H. E. Stanley, “Linking agentbased models and stochastic models of financial markets,” Proceedings of the National Academy of Sciences of the United States of America, vol. 109, no. 22, pp. 8388–8393, 2012. View at: Publisher Site  Google Scholar
 M. Harré and T. Bossomaier, “Phasetransitionlike behaviour of information measures in financial markets,” EPL (Europhysics Letters), vol. 87, no. 1, article 18009, 2009. View at: Publisher Site  Google Scholar
 I. Goldstein, “Strategic complementarities and the Twin Crises,” The Economic Journal, vol. 115, no. 503, pp. 368–390, 2005. View at: Publisher Site  Google Scholar
 J. DickNielsen, P. Feldhütter, and D. Lando, “Corporate bond liquidity before and after the onset of the subprime crisis,” Journal of Financial Economics, vol. 103, no. 3, pp. 471–492, 2012. View at: Publisher Site  Google Scholar
 M. Kolanović, Price Patterns and Chaos Theory in Volatile Markets, J. P. Morgan Global Equity Derivatives and Delta One Strategy, 2009.
 K. P. Burnham and D. R. Anderson, “Multimodel inference: understanding AIC and BIC in model selection,” Sociological Methods & Research, vol. 33, no. 2, pp. 261–304, 2004. View at: Publisher Site  Google Scholar
 J. Campbell and R. Shiller, “Valuation ratios and the longrun stock market outlook: an update,” Tech. Rep., Tech. Rep., National Bureau of Economic Research, Cambridge, MA, USA, 2001. View at: Google Scholar
Copyright
Copyright © 2018 Stjepan Begušić et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.