Research Article | Open Access
Jin Huang, Tianchuang Meng, Yangdong Deng, Fanling Huang, "Catching Critical Transition in Engineered Systems", Mathematical Problems in Engineering, vol. 2021, Article ID 5589429, 10 pages, 2021. https://doi.org/10.1155/2021/5589429
Catching Critical Transition in Engineered Systems
A variety of engineered systems can encounter critical transitions where the system suddenly shifts from one stable state to another at a critical threshold. The critical transition has aroused vital concerns for its potentially disastrous impacts. We validate an often taken-for-granted hypothesis that the failure of engineered systems can be attributed to the respective critical transitions and show how early warning signals are closely associated with critical transitions. We demonstrate that it is feasible to use early warning signals to predict system failures. Our findings open a new path to forecast failures of engineered systems with a generic method and provide supporting evidence for the universal existence of critical transition in dynamical systems at multiple scales.
Critical transition, i.e., the dramatic shift of states in complex dynamical systems, is increasingly recognized as a vital concern for its potentially disastrous impacts in many social-ecological systems [1, 2]. Despite the difficulty in predicting such transitions, recent years witnessed significant progresses in identifying early warning signals [3–9] by analyzing the observed time series [10–12]. For example, critical slowing down (CSD)  as well as other indicators like the changing skewness  have been found to be present in a wide spectrum of complex systems ranging from ecosystems [14–16], neurons in mammalian cortices , and climates  to financial markets  when approaching the tipping point. A detailed review of past research dedicated to CSD indicators and associated tipping points and promising research directions for future research has been conducted by Nazarimehr et.al. . Besides, some researchers have explored the approaches of predicting the tipping points  and discussed the new scientific understanding of social problems through a complex systems perspective, such as crowd disasters, crime, terrorism, wars, and epidemics . It is thus intriguing to explore the viability of exploiting the early warning signals to detect the tendency toward failure in engineered systems, which also exhibits intricate stochastic behavior under complex working conditions. However, it is still an open problem to establish the universality of the above early warning indicators in both natural and engineered systems. Here we demonstrate the feasibility of using early warning signals to predict system failures in a variety of engineered systems from various domains. We show how early warning signals, i.e., CSD and deviating skewness, which can be extracted by performing a Fluctuation Mining (FM) procedure to capture the inherent stochastic behaviors, are closely associated with critical transitions at the points of systems approaching failures. Our results suggest that early warning signals are prevalent in dynamic systems. We anticipate that finding early warning signals through critical transition analysis will open a new path to predict the failures of engineered systems by offering a generic method.
Complex dynamical systems can undergo critical transitions when arriving at a specific threshold [23, 24]. The existence of such tipping points is the result of the inherent nonlinearity and stochasticity in the dynamical systems . Due to the global concern on the sustainability of the complex social-ecological systems, intensive research efforts have been dedicated to identifying early warning signals for critical transitions . It is increasingly recognized that a wide range of systems exhibit CSD and deviating skewness, which are caused by the fact that it is harder for a system approaching the critical transition to return to the equilibrium upon perturbations. Various studies suggest that these early warning signals can be recognized in the intrinsic stochastic fluctuations of many social-ecological systems and these signals provide an essential solution to predict potential natural disasters .
Despite their seemingly vast difference from social-ecological systems, engineered systems such as jet engines, locomotives, and bearings are also dynamical systems demonstrating nonlinear behaviors and stochastic fluctuations under the complex interplay of internal and environmental factors [27, 28]. The failure of engineered systems may incur disastrous impacts since the operation of modern society hinges on their smooth functioning. One example is the tragic high-speed train accident  happening in Eschede (Germany) in 1998, which was caused by the fatigue-induced crack of a wheel. Intuitively, the process from the suddenly accelerated worsening of cracking to the final derailment bears significant similarity to the critical transition in natural systems. Here, we explore the universality of early warning signals in engineered systems.
Discovering potential failures in engineered systems is extremely challenging. Although these systems are designed to offer well-defined behaviors, the complex interactions within their components and with the working environment tend to be too complex for exhaustive analytical modeling . The problem can be more involved if a positive loop of feedback exists in the system. Even if the system dynamics approaching failure can be derived through physics-of-failure or reliability analysis , the working conditions and the environment cannot be fully reproduced for a complete treatment of various idiosyncrasies in the system. The globalization of the manufacturing process also hinders a comprehensive understanding of the domain knowledge. Precise prediction of failures in engineered systems in a timely fashion is still a worldwide challenge. It is thus appealing to devise effective generic early warning indicators that require less or even no domain knowledge.
2. Methods and Results
Hypothesizing that the critical transition is strongly correlated with the failure of engineered systems, we examine four datasets from different engineered systems, that is, an airbrake system of diesel locomotive (a pneumatic system), a turbofan engine (a mechatronic system), an IGBT (a power electronic system), and a rolling bearing (a mechanic system), to investigate whether early warning signals can be identified. The airbrake dataset is gathered from a commercially operating locomotive, while the remaining three datasets are public prognostics benchmarks available by NASA Prognostics Center of Excellence (PCoE) . In the NASA PCoE Datasets, the turbofan engine data are generated in an industry-strength simulation environment , whereas the IGBT and bearing datasets are produced through aging experiments [34, 35]. All the datasets are univariate or multivariate time series collected by sensors during the process from normal operating to running into failure. With respect to data availability, the airbrake dataset is gathered from a commercially operating locomotive, while the remaining three are public prognostics benchmarks made available by NASA Prognostics Center of Excellence (PCoE) at the website: https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/.
With proper preprocessing, we derive the variance, autocorrelation, and skewness characteristics of the time series. Although they are from considerably different domains, all the four systems unanimously exhibit the typical symptoms of CSD and deviating skewness (Figure 1 and Supplementary Figure S1). Such an observation seems to suggest that early warning indicators can serve as the precursor of system failure.
The dynamic behaviors of an engineered system are generally reflected by one or more observable signals, which can be discretely sampled into time series. The values in a time series are determined by both an operational trend (i.e., main trend) and stochastic fluctuations. In the case of the complex dynamic social-ecological system, a detrending  procedure is often necessary to extract the stochastic components for analyzing early warning signals . As rather obvious variations can be observed in the curves of variance, autocorrelation, and skewness (Figure 1), we devise a Fluctuation Mining (FM) framework to ascertain stochastic fluctuations that is not directly associated with the designed operation of engineered systems (Figures 2(a)–2(c)). The framework consists of a data cleansing step that removes the failure-insensitive components in the observed signals and a detrending step that eliminates the dominant trend, i.e., the overall tendency of change, in the time series. For instance, the application of the FM on the IGBT dataset successfully reveals a much more obvious propensity of increasing variance and autocorrelation as well as deviating skewness (Figures 2(f)–2(h) and Supplementary Figure S2). In addition, although early warning signals can be consistently identified in all the four engineering systems from different domains, we still need to verify that the observations with a 50% window size are not a coincidence. Thus, the sensitive test is implemented that analyzed the indicators with different window sizes (Figure S3).
The findings so far have validated the existence of early warning signals in engineered systems with forthcoming failures. The correspondence between the critical transition and the system failure, however, is still an open problem. We endeavored Student’s t-test , the Gaussian kernel-based probability density test , the Akaike Information Criterion- (AIC-) based ARIMA model analysis , and the phase space analysis  on the four engineered systems before and after they reach their failures (Figure 3 and Supplementary Figure S4). The analysis results consistently suggest that the systems undergo an abrupt change of state. For example, the bearing system remains stable under normal operation and diverges to an unstable state upon failure (Figures 3(b)–3(e)), the turbofan engine witnesses a complete change of the underlying dynamical function (Figure 3(g)), and in the case of the IGBT system, the normal functioning stage and failure stage reveal significant varying limit cycles in the phase portrait (Figures 3(i) and 3(k)). The above analysis shows strong evidence on the equivalence between the critical transition and the system failure in the engineered systems. Such correspondence further demonstrates the applicability of the early warning signals in predicting incoming system failures.
Our findings are the first to recognize the critical transition as a common property in engineered systems, and early warning signals can be effectively used in predicting failures in such systems. The discoveries have implications in several aspects. First, we offer evidence that the phenomenon of early warning signals is prevalent in both natural and engineered systems. It is probably not surprising that there are no absolute boundaries between the two as the complex dynamics are fundamentally universal. Second, we validate an often taken-for-granted hypothesis that the failure of engineered systems can be attributed to the respective critical transitions. Third, it is feasible to catch disastrous bifurcations with early warning indicators, which can be identified by investigating the fluctuations in an engineered system. Such a discovery paves the way toward a generic methodology to predict and prevent potential disasters caused by the failure of engineered systems.
Critical transition, as shown to have a strong correlation with system failure, is likely to be the aftermath of a catastrophic bifurcation . Taking the bearing system and the IGBT system as examples, the sudden shift in the fluctuation signals exhibits the features of bifurcations (Figures 4(a) and 4(b)). In fact, nonlinear phenomena like hysteresis, which are closely related to bifurcations, can be found in many engineered systems, e.g., hysteretic actuators in control systems, positive feedback-based circuits in electronics, airstream in aerodynamics, elastic deformation of materials, and magnetic and electrical hysteresis in ferromagnetic materials . Hence, we anticipate that the catastrophic bifurcation, which can be triggered by a small perturbation of a latent parameter, to be a common phenomenon in engineered systems approaching failures (Figure 4(c)). We propose that the engineered systems with dynamical behaviors can be abstracted to have three phases: a nominal design phase that is equivalent to the basin of attraction, a predefined safety-oriented phase when the system initializes the self-protection after certain faults happened, and an unstable failure phase exhibiting out-of-control performance (Figure 4(d)). The critical transition occurs when the system departs from the basin of attraction and loses its resilience  as the system fails.
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
J.H. and Y.D. proposed the idea and wrote the manuscript. T.M. and F.H. performed the analysis.
This research was sponsored in part by the NSFC Program (nos. 61872217 and U20A200090).
This supplementary file mainly includes some necessary information related to data source descriptions, as well as additional analysis on early warning signals in the systems, additional validation of the FM process, sensitivity analysis results, and additional verification of critical transition in the engineered systems. (Supplementary Materials)
- M. Scheffer, Critical Transitions in Nature and Society, Princeton Studies, Princeton, NJ, USA, 2009.
- M. Scheffer, S. R Carpenter, T. M Lenton et al., “Anticipating critical transitions,” Science (New York, N.Y.), vol. 338, pp. 344–8, 2012.
- V. Dakos, S. R. Carpenter, W. A. Brock et al., “Methods for detecting early warnings of critical transitions in time series illustrated using simulated ecological data,” PloS One, vol. 7, no. 7, Article ID e41010, 2012.
- S. M. O’Regan and J. M. Drake, “Theory of early warning signals of disease emergence and leading indicators of elimination,” National Public Health Emergency Collection, vol. 6, 2013.
- A. Ghadami, C. E. S. Cesnik, and B. I. Epureanu, “Model-less forecasting of hopf bifurcations in fluid-structural systems,” Journal of Fluids and Structures, vol. 76, pp. 1–13, 2018.
- D. Kiran, “Forecasting bifurcations from large perturbation recoveries in feedback ecosystems,” PloS One, vol. 46, 2015.
- S. Chen and B. Epureanu, “Forecasting bifurcations in parametrically excited systems,” Nonlinear Dynamics, vol. 91, 2017.
- O. Eamon, “Estimating the distance to an epidemic threshold,” The Royal Society, vol. 15, 2018.
- T. Squartini, I. Van Lelyveld, and D. Garlaschelli, “Early-warning signals of topological collapse in interbank networks,” Scientific Reports, vol. 3, no. 1, p. 3357, 2013.
- M. Scheffer, J. Bascompte, W. A. Brock et al., “Early-warning signals for critical transitions,” Nature, vol. 461, no. 7260, pp. 53–59, 2009.
- R. Wang, J. A. Dearing, P. G. Langdon et al., “Flickering gives early warning signals of a critical transition to a eutrophic lake state,” Nature, vol. 492, no. 7429, pp. 419–422, 2012.
- C. Boettiger and A. Hastings, “Quantifying limits to detection of early warning for critical transitions,” Journal of The Royal Society Interface, vol. 9, no. 75, pp. 2527–2539, 2012.
- V. Guttal and C. Jayaprakash, “Changing skewness: an early warning signal of regime shifts in ecosystems,” Ecological Letters, vol. 11, 2010.
- M. Scheffer, S. Carpenter, J. A. Foley, C. Folke, and B. Walker, “Catastrophic shifts in ecosystems,” Nature, vol. 413, no. 6856, pp. 591–596, 2001.
- M. Rietkerk, S. C. Dekker, P. C. de Ruiter, and d. K. J. Van, “Self-organized patchiness and catastrophic shifts in ecosystems,” Science, vol. 305, no. 5692, pp. 1926–1929, 2004.
- S. R. Carpenter, “Early warnings of regime shifts: a whole-ecosystem experiment,” Science, vol. 332, 2011.
- C. Meisel, A. Klaus, C. Kuehn, and D. Plenz, “Critical slowing down governs the transition to neuron spiking,” PLOS Computational Biology, vol. 11, no. 2, Article ID e1004097, 2015.
- M. Timothy, “Tipping elements in the earth’s climate system,” Proceedings of the National Academy of Sciences of the United States of America., vol. 105, 2008.
- R. M. May, S. A. Levin, and G. Sugihara, “Ecology for bankers,” Nature, vol. 451, no. 7181, pp. 893-894, 2008.
- F. Nazarimehr, S. Jafari, M. Perc, and J. C. Sprott, “Critical slowing down indicators,” EPL (Europhysics Letters), vol. 132, no. 1, p. 18001, 2020.
- F. Nazarimehr, S. Jafari, S. M. R. Hashemi Golpayegani, M. Perc, and J. C. Sprott, “Predicting tipping points of dynamical systems during a period-doubling route to chaos,” Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 28, no. 7, Article ID 073102, 2018.
- D. Helbing, D. Brockmann, T. Chadefaux et al., “Saving human lives: what complexity science and information systems can contribute,” Journal of Statistical Physics, vol. 158, no. 3, pp. 735–781, 2015.
- Bar-Yam, Y. Dynamics of Complex Systems (1997).
- E. A. Gopalakrishnan, Y. Sharma, T. John, P. S. Dutta, and R. I. Sujith, “Early warning signals for critical transitions in a thermoacoustic system,” Scientific Reports, vol. 6, no. 1, p. 35310, 2016.
- J. Guckenheimer and J. M. Ottino, “Foundations for complex systems research in the physical sciences and engineering,” NSF Workshop, 2008.
- V. Dakos, S. R. Carpenter, E. H. Van Nes, and M. Scheffer, “Resilience indicators: prospects and limitations for early warnings of regime shifts,” Transactions Royal Society, vol. 370, Article ID 20130263, 2014.
- S. H. Strogatz, “Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering,” Computer Physics, vol. 8, p. 532, 2015.
- E. Cotilla-Sanchez, P. D. H. Hines, and C. M. Danforth, “Predicting critical transitions from time series synchrophasor data,” IEEE Transactions on Smart Grid, vol. 3, no. 4, pp. 1832–1840, 2012.
- H. J. Oestern, B. Huels, W. Quirini, and T. Pohlemann, “Facts about the disaster at eschede,” Journal of Orthopaedic Trauma, vol. 14, no. 4, pp. 287–290, 2000.
- N. H. Chan and H. Y. Wong, “Data mining of resilience indicators,” Iie Transactions, vol. 39, no. 6, pp. 617–627, 2007.
- J. Sheppard, M. Kaufman, and T. Wilmer, “Ieee standards for prognostics and health management,” IEEE Aerospace and Electronic Systems Magazine, vol. 24, no. 9, pp. 34–41, 2009.
- R. May, J. Csank, T. Lavelle, J. Litt, and T.-H. Guo, “A high-fidelity simulation of a generic commercial aircraft engine and controller,” in Proceedings of the 46th AIAA/ASME/SAE/ASEE Joint Propulsion Conference & Exhibit, p. 6630, Nashville, Tennessee, July 2010.
- G. Sonnenfeld, K. Goebel, and J. R. Celaya, “An agile accelerated aging, characterization and scenario simulation system for gate-controlled power transistors,” Autotestcon, vol. 25, 2008.
- O. F. Eker, F. Camci, and I. K. Jennions, “Major challenges in prognostics: study on benchmarking prognostics datasets,” European Conference of the Prognostics and Health Management, vol. 10, 2012.
- R. Wilcox, Introduction to Robust Estimation and Hypothesis Testing, Academic Press, Cambridge, MA, USA, 4th Edition edition, 2012.
- S. Bisgaard and M. Kulahci, Time Series Analysis and Forecasting by Example, Wiley, Hoboken, NJ, USA, 2011.
- S. L. Brunton, J. L. Proctor, and J. N. Kutz, “Discovering governing equations from data: sparse identification of nonlinear dynamical systems,” Proceedings of the National Academy of Sciences of the United States of America., vol. 113, p. 3932, 2015.
- Y. A. Kuznetsov, “Elements of applied bifurcation theory,” Springer Science Bus Media, vol. 112, 2013.
- Bertotti, G. & Mayergoyz, I. The Science of Hysteresis (2006).
- J. Gao, B. Barzel, and A.-L. Barabási, “Universal resilience patterns in complex networks,” Nature, vol. 530, no. 7590, pp. 307–312, 2016.
Copyright © 2021 Jin Huang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.