Systemic risk refers to the uncertainty that arises due to the breakdown of a financial system. The concept of “too connected to fail” suggests that network connectedness plays an important role in measuring systemic risk. In this paper, we first recover a time series of Bayesian networks for stock returns, which allow the direction of links among stock returns to be formed with Markov properties in directed graphs. We rank the stocks in the time series of Bayesian networks based on the topological orders of the stocks in the learned Bayesian networks and develop an order distance, a new measure with which to assess the changes in the topological orders of the stocks. In an empirical study using stock data from the Hang Seng Index in Hong Kong and the Dow Jones Industrial Average, we use the order distance to predict the extreme absolute return, which is a proxy of extreme market risks, or a signal of systemic risks, using the LASSO regression model. Our results indicate that the network statistics of the time series of Bayesian networks and the order distance substantially improve the predictability of extreme absolute returns and provide insights into the assessment of systemic risk.