Earth's weather and climate vary on a wide range of spatio-temporal scales. Whereas external orbital variations are believed to be the dominant driving force for macro-climate (on millennial time scales), weather, macro-weather (Lovejoy, 2018) and climate variations (on shorter time scales) are mainly the result of complex nonlinear interactions between very many degrees-of-freedom (Sura and Hannachi, 2015) and also due to many climate sub-components with different time scales The atmospheric (and climate) system is an excellent example of high-dimensional and highly complex dynamical system. One outstanding and ubiquitous feature of the large scale (and low frequency) atmospheric (and climate) variability is non-Gaussianity (Franzke et al., 2007; Proistosescu et al., 2016; Pires and Hannachi, 2017; Hannachi and Iqbal, 2019). For instance, Sura and Sardeshmukh (2008) show that sea surface temperature (SST) has non-Gaussian probability distribution function (PDF) with particular tail extrema. Many processes, e.g. subgrid scales, large-scale teleconnections and nonlinearity can lead to various kinds of uncertainties, which can affect the accuracy of our understanding, such as forecasts. Stochastic modelling can help overcome some of the previous problems and improve accuracies (Berner et al., 2017).
Although non-Gaussianity and nonlinearity can be considered as two distinct aspects of weather, macro-weather and climate (e.g., Sura and Sardeshmukh, 2008; Sura and Hannachi, 2015), observations do suggest that these are two inter-related characteristic features of the system (e.g., Woollings et al., 2010; Hannachi et al., 2017; and references therein). Some systems can exhibit weak (deterministic) nonlinearity, but with strong non-Gaussian statistics, which may be explained by a multiplicative or state-dependent noise as detailed, e.g. in Sura and Sardeshmukh (2008), Sardeshmukh and Sura 2009, see also Hannachi et al. (2017) for a review. In contrast, non-Gaussianity can also result from systems with strong nonlinearity and additive noise, see e.g., Hannachi et al. (2017) for a review and further references. Notwithstanding this link between nonlinearity and non-Gaussianity, it is sometimes helpful to disentangle the contributions of nonlinearity and stochastic noise to the system PDF. There is a general consensus that understanding non-Gaussian statistics of weather and climate is important for a number of reasons, not least for weather and climate prediction, planning and risk assessment. Extreme events, for instance, which are important in planning and risk assessment, depend closely on the structure of the non-Gaussian PDF. Various sources exist, which contribute to the non-Gaussianity. Sura and Hannachi (2015) provide a detailed account of the different sources and mechanisms contributing to the observed non-Gaussianity of the atmospheric large-scale and low-frequency variability. They discussed, in particular, nonlinear regime dynamics, multiplicative noise, cross-frequency coupling, jet stream meandering and nonlinear boundary layer drags. They investigated specifically non-Gaussianity in geopotential heights, jet stream latitude and SST fields, with particular focus on skewness and kurtosis. Skewness and kurtosis are simple measures of non-Gaussianity, in the time domain, that does not directly reflect frequencies. A convenient way to examine nonlinearity and/or non-Gaussianity is to use high (e.g., third and fourth) order statistics in the frequency domain, namely, e.g. bispectrum and trispectrum (e.g. Brillinger and Rosenblatt, 1967; Nikias and Raghuveer, 1987). Spectral analysis of stationary time series is well rooted in the study of time series (supposed to be zero-mean and unit variance for simplicity) from weather and climate and other fields. The duality between the time and spectral domains allows to investigate the distribution of, e.g. variance and skewness, as a function of spectral bins. For example, the duality between the second-order cumulant, or autocovariance function and the power spectrum reveals that the integral of the latter is precisely the variance of the time series, i.e.,
This means, in particular, that the power spectrum can be viewed as a decomposition of the variance by frequency bins. Likewise, the duality between the bispectrum and the third-order moment or bicovariance means that the skewness is the integral of the bispectrum,
This also implies that the bispectrum can be viewed as a decomposition of the skewness by bins of frequency pairs. This can be used to identify nonlinearly interacting pairs of spectral bins contributing to the skewness which are often attributed to phase locking between components at frequency triplets producing triadic resonance (Pires and Perdigão, 2015).
Bispectral analysis has been used in signal processing to study nonlinearity detection and bicoherency in a number of different fields including econometry (Ashley et al., 1986; Rusticelli et al., 2008), acoustics (Richardson and Hodgkiss, 1994), and Earth Sciences (Müller, 1987; Biswas et al., 1995; Hocke and Kämpfer, 2008).
Here we focus on the bispectral analysis of El Niño Southern Oscillation (ENSO), the main atmosphere–ocean interannual mode (Neelin et al., 1998; Wang et al., 2016). ENSO aspects, like nonlinearity and complexity (Timmermann, 2003; Frauen et al., 2014; Berner et al., 2018; Bianucci et al., 2018), non-Gaussianity (Burgers and Stephenson, 1999; Chunzai, 2018; Boucharel et al., 2009; Hannachi et al., 2017) and also its modelling (Kondrashov et al., 2005) have been extensively studied, both from a physical and signal-processing perspective. In particular, some ENSO bispectral analysis was performed by Timmermann et al. (2001, 2018), to fit a low-order nonlinear dynamical model of El Niño index and by Schulte et al. (2020) to compute the cross-bi-coherency and synchronization with the Indian Monsoon.
The present study aims to perform a systematic and thorough analysis of third-order statistics, both in the time and spectral domains to infer and improve the understanding of ENSO non-Gaussianity through skewness, nonlinearity (e.g. Hinich, 1982; Cox, 1991), and nonlinear predictability on time scales ranging from seasons to years. We will emphasize, in particular, the role of nonlinear lagged correlation with the intra-annual time scale in overcoming of the Spring predictability barrier of ENSO (Duan and Wei, 2013). The bispectrum of El Niño index and its statistical significance are thus computed, looking for the most relevant wave-triad contributing to the skewness, which are associated with ENSO extremes by a phase synchronization, see e.g. Jajcay et al. (2018). Then, we check how simple stochastic models driven by lagged correlated additive multiplicative (CAM) noise (Monahan, 2020) can produce the main bispectral features of ENSO and El Niño/La-Niña asymmetry (Martinez-Villalobos et al., 2019).
The manuscript starts with data description with a synthesis of exploratory statistics (Section 2). Then the autocorrelation function and spectrum (Section 3) are shown. In Section 4, we present the tests of nonlinearity and non-Gaussianity based on the bicovariance function. Section 5 details the bispectrum properties and its estimation and statistical significance applied to ENSO. Section 6 develops a minimal bilinear stochastic model fitting data. A summary and conclusion are given in the last section. Most of the technical details and symbols are put in appendices. The details presented in the main text and appendices, some of them conventional, make the paper convenient particularly for didactive purposes and ready to apply to other time-series beyond ENSO.
The raw data used are monthly anomalies (with respect to the 1981–2010 period) of El Niño 3.4 sea surface temperature (SST) Index, obtained by area averaged SST in the geographical region 5S–5N by 170–120 W, taken in the 119-year period 1870–2018 and extracted from the periodically updated website https://www.esrl.noaa.gov/psd/gcos_wgsp/Timeseries/Data/nino34.long.anom.data (Rayner et al., 2003). Raw data exhibit a positive trend of 0.19 °C/century, associated to oceanic global warming. It reveals also a decadal-scale variability (observed in the 50 yr running means) in phase with the Pacific Decadal Oscillation (PDO), also known as a long-lived El Niño pattern (Zhang et al., 1997). After the removal of the linear trend, we get a detrended zero-centred time-series of the index, with a standard deviation The skewness is associated to the prevalence of El Niños to La Niñas (Burgers and Stephenson, 1999) and an excess kurtosis (ekurt) of The monthly dependence of statistics is particularly striking in the skewness and excess kurtosis, ranging from a positively skewed leptokurtic probability distribution function (PDF) in NH winter ( in January), favouring extreme El Niños, up to a platykurtic, nearly unskewed PDF in the NH Spring ( in May). Spring has weaker extreme El Niños compared to Winter, and the extrapolation of the Spring’s El Niño state to the next Winter is rather unskilful i.e. the Spring predictability barrier (Duan and Wei, 2013). The intra-seasonal variability is quite small, compared to the inter-seasonal and interannual variability. Short-range persistence is quite high leading to 1- and 2-month lag-correlations of 0.92 and 0.85. Three-monthly seasonal averages (JFM, AMJ, JAS, OND) are constructed with an overall std and peaking again during the NH or Boreal Winter’s ( in JFM) (Stuecker et al., 2013; Stein et al., 2014). The statistics are quite similar to those obtained with more commonly used trimesters (e.g. for DJF, we get The remaining three seasons are much less skewed with and a rather small except for the platykurtic behaviour in Boreal Spring (AMJ), with All the analysis that follows is performed on the standardized time series, hereafter denoted as with sample size trimesters (trm), being shown in Fig. 1.
Autocorrelation and spectrum
We start by evaluating second-order lagged moments of the time series. The autocorrelation function is shown in Fig. 2. It has oscillatory behaviour with typical ENSO timescales (3–4 years). In order to test the null hypothesis of a vanishing autocorrelation, taking into account the serial correlation, we use an approximate effective sample size (Wilks, 2011). Then, is rejected if (von Storch and Zwiers, 1999) where is the -th quantile of a t-Student PDF with degrees of freedom. From Fig. 2, some local extremes and significant correlations appear also at decadal lags.
The spectrum and its estimation
A regularly sampled stationary time-series can be decomposed using discrete Fourier transform (DFT) as: for every frequency in cycles per sampling period and can be reconstructed through the inverse Fourier transform (FT) as (for even). The sample spectrum or periodogram is the DFT of the autovariance function:
where is the expectation operator over realizations of the stochastic process. According to the Wiener–Khintchine theorem (2) is the FT of the autocovariance function i.e.:
Equation (3) yields, in particular, the variance of the time series
For a stationary process, the DFTs estimated at different frequencies are nearly uncorrelated (von Storch and Zwiers, 1999), and the periodogram (1), is known to be inconsistent, and hence a smoothed estimator is often used:
We have also computed, the maximum entropy estimator of the spectrum by fitting an autoregressive (AR) model of generic order via the Yule–Walker equations. The order is chosen by minimizing the Akaike Information Criterion, AIC (Akaike, 1974). The goal of computing the theoretical maximum entropy spectrum is to build a null hypothesis spectrum Therefore, in order to objectively check if the spectral peaks of (1) and (5) are truly distinguishable and significantly larger than those of at a significance level the estimated spectra (1,5) have to be compared to the threshold (Wilks, 2011) with for (5) and for (1) corresponding to and a standardized bandwidth equal to the Nyquist frequency.
El Niño index spectrum
Periodogram and smoothed spectrum
The periodogram (1) of the time series is shown in Fig. 3. There is evidence of sharp and well separated peaks near the frequencies 0.021, 0.045, 0.071, 0.087, 0.105, and 0.168 cycles per trimester (cpt), corresponding (in the same order) to periods of 12.2 years, linked to decadal variability (Sun and Yu, 2009; Kravtsov, 2012), 5.62 years (Kim, 2002), and 3.53, 2.87, 2.38 and 1.49 years in the range of the ‘Quasi-quadrennial and quasi-biennial variability’ (Jiang et al., 1995). These peaks are also found by Deser et al. (2010) that are responsible for variations in the ENSO frequency, intensity, propagation, and predictability (e.g., An and Wang, 2000; Fedorov and Philander, 2000; Timmermann, 2003; An and Jin, 2004; Yeh and Kirtman, 2004; Wang, 2018).
For the smoothed spectrum (5), we chose the Bartlett–Priestley window-lag function: (Priestley, 1981) for which=0.855 and In order to resolve the main spectral peaks, the bandwidth must be smaller than the minimum difference between consecutive leading frequencies, i.e. cpt, hence trimesters. To further increase spectral resolution, we show in Fig. 3 the estimator (5) using (20 years), corresponding to In this case, the standard deviation of the filtered estimator is about 39% of the true spectrum. The 90% confidence interval for is which is quite large, a consequence of the high window length The local maxima of the filtered estimator lie close to the high spikes. Moreover, the periodogram lies well within the 95% confidence interval of the true spectrum (see thin black lines of Fig. 3).
Maximum entropy spectrum
An AR(5) model (see the AIC in Table 1) is fitted here:
The peaks with periods 5.62, 3.53, and 1.49 years are significant, both in the periodogram (1) and the smoothed spectrum (5) whereas the peak 2.87 years is significant in the periodogram (1) but only marginally significant in the smoothed spectrum (5).
Bicovariance, non-Gaussianity and nonlinearity
The bicovariance function is a generalization of the autocovariance function, given by third-order cumulants between lagged values of which for a zero mean stationary process writes as and is estimated here, for as:
Stationarity implies time invariance of lagged statistics leading to several identities reflecting the symmetry of the bicovariance (Rao and Gabr, 1984), namely:
For a nonvanishing third-order cumulant, the bicorrelation provides a measure of predictability (for lags ), coming from nonlinear correlation:
Local maxima and minima of bicorrelation can thus provide sources of predictability due to non-Gaussianity and/or nonlinearity. However, we must note that part of the nonlinear correlation (9), in particular at is due to skewness, and hence to eliminate that contribution, we must consider the nonlinear component or residual of the predictor after removing the linear regression with where is a regression constant equal to the skewness of
Another useful advantage of bicorrelation is the Cox (1991) test of nonlinearity, that we will apply bellow, also based on skewness. More general tests exist, which analyse nonlinear predictability originating from a set of past values (Granger and Anderson, 1978). Under the null hypothesis of linearity, the test must vanish for all lags. Threshold values of under an inexistent predictability hypothesis are obtained by randomly shuffling and (10,000 times) and then computing the 95% quantile (denoted as ) of the sorted values of Nonlinearity of El Niño is thus accepted if at a 5% significance level.
Results for El Niño index
In order to test the departure of the bicorrelation from the Gaussian hypothesis, we have generated 10,000, -sized simulations with the AR(5) and computed uncertainties. The 90% (95%) quantiles of are equal to 0.24 (0.29), which are both below the observed skewness 0.46, hence the null hypothesis of Gaussianity is rejected at the 5% significance level. For (diagonals of the bicovariance graph) or ( and/or ), the 95% (90%) quantiles are ∼0.14 (0.16) and 0.10 (0.12) elsewhere. The rejection regions rejecting of the null hypothesis (at the 5% significance level) appear within thick black contours in Fig. 4b.
From inspection of Fig. 4b, we verify that the deepest bicovariance minimum is significant at the 5% significance level, corresponding to a nonlinear correlation (Eq. (9)) of with This implies that an extreme El Niño or La Niña (high than average) favours the occurrence of La Niña occurrence four trimesters later (negative whereas mild conditions favour El Niño. Another local bicorrelation minimum (10% significance level) implies that La Niña event favours a strong El Niño or La Niña 2 years later (8 trm).
Linear and nonlinear predictability
As regards El Niño predictability skill, Fig. 5a shows the linear and nonlinear correlations: and with defined in Section 4.1 and for forecast lags up to 20 trm. The linear correlations of El Niño 3.4 are significant at 10% level for lags (Fig. 5a thick black line) whereas the nonlinear correlations show significant values for lags (Fig. 5a thick red line). Those correlations are also evaluated for the stronger El Niño season i.e., the JFM trimester ( in JFM) (Fig. 5a thin black line for linear and thin red line for nonlinear correlations respectively). We note here the presence of the Spring predictability barrier of El Niño (Duan and Wei, 2013) i.e., the barely weak linear extrapolation (i.e. persistence) of El Niño index from current Spring (AMJ) to the next Winter (JFM), as shown by the small value (∼0.05) of where | means 'conditionated to' and However, the Spring barrier is reduced if we include the nonlinear term in the forecast. In fact, the nonlinear correlation evaluated at (Fig. 5a thin red line) for forecast lags (–0.25 to −0.4) is statistically significant, e.g. a negative value of between in Spring and in next Winter (see Fig. 5b).
This is corroborated by the conditional expectations of the Winter signal conditioned to the previous Spring signal. First, we have (see left sector of Fig. 5b). We argue that strong trade-winds (or persistent eastern wind bursts in the Eastern Pacific), favouring strong La Niña Spring conditions tend to persist over some trimesters eventually reaching the next Winter season (e.g. JFM of years 1989, 1974, and 2011).
On the other hand, we have (central sector of Fig. 5b) corresponding to (Spring) near climatological conditions in the Eastern Pacific. Here, the tendency is to favour a Winter with El Niño predominance in agreement with Boreal Winter phase-locking. In particular, strong Winter El Niños (e.g. 1983, 1998, and 2016) were preceded by quite mild Spring conditions. Finally, from strong El Niño Spring conditions (associated with westerly winds anomalies) tend to reverse in the next trimesters. This suggests that the nonlinear predictability is a consequence of the asymmetric persistence of El Niño signal and Pacific trade winds in Spring, as a function of their intensity and phase. A possible mechanism for this is seasonal growth rate dependence on the ENSO regime and feedbacks controlling SST (Yishuai et al., 2020), and the seasonal dependence of easterly wind bursts from Spring to Autumn (Fan et al., 2019).
Finally, we compute the nonlinear forecast score for lags up to 80 trm (Fig. 5c). Clearly, the nonlinearity is especially significant at certain lags (4–8, 28, 36, 52, 72, 80 trm) where is even larger than the quantile of nonrejection of the linearity hypothesis. Those lags are related to phase synchronization between Fourier frequencies, namely those with periods and Lags are generally close to multiples of the half-period of the shorter oscillation, i.e. For instance, from Fig. 3, the Fourier spectral peaks at periods and justify the peak of at lag This frequency relationship is known as quadratic phase coupling (Biswas et al., 1995) and examples in relation to decadal variability of ENSO are given in Timmermann (2003).
The bicovariance of El Niño time series (Fig. 4b) exhibits certain features and periodicities in the lag-time domain. Therefore, the two-dimensional Fourier transform of the bicovariance, i.e. bispectrum (Brillinger and Rosenblatt, 1967), can provide a dual complementary information about the most relevant spectral interactions contributing to the bicovariance and skewness of the time series making easier the physical interpretation of such interactions.
The bispectrum is the two-dimensional version of polyspectra (Brillinger, 1965), providing relevant information on non-Gaussian processes. The bispectrum is given by:
For the simplest case of a purely random noise the bicovariance is a spike at the origin i.e. where is the Kronecker delta, yielding a flat, constant and real bispectrum
Bispectrum and spectral components
The asymptotic bispectrum of a N-sized time series writes in terms of DFTs of the time series, taken at triplets of frequencies (multiples of the minimum frequency ) (Hinich, 1982) at and as:
Equation (11) can still be interpreted in terms of the amplitude and phase of the DFT in polar form, i.e. By denoting and and applying the product expectation decomposition to (11), we get (Kovach et al., 2018):
Properties of the bispectrum
Like the spectrum, the bispectrum of a real signal satisfies and (11) leads to 5 identities of symmetry, namely:
This allows for a partition of the bispectrum domain (BD) into 12 polygonal regions in which the bispectrum can be reproduced from the Principal Domain (PD): the triangle of vertices (0,0), (0,1/2) and (1/3,1/3) (shown by triangle 1 in Fig. 6a). The periodicities are evident in the theoretical bispectrum in Fig. 6b (real part) and Fig. 6c (imaginary part) of a non-Gaussian AR(5) model of El Niño (presented later in Section 5.3.1).
The reconstruction of bicovariance is obtained through the inverse FT of (10):
Finally, since the square correlation is a predictability measure coming from third-order moments (see Eq. (9)), its overall sum can be distributed over the bispectral domain through the Parseval relationship:
The estimation of bispectrum has been addressed by many authors (e.g. Brillinger and Rosenblatt, 1967; Raghuvver and Nikias, 1986; Nikias and Raghuveer, 1987). The empirical bispectrum or biperiodogram of a finite sample of length is the two-dimensional DFT of the sampled bicovariance, which can also be expressed in terms of DFTs of the signal (see Section 3.1):
Like the periodogram (1), the estimator (17) is not consistent, which can be overcome by (i) smoothing the sample bispectrum (Hinich, 1982) or dividing the sample into pieces and then averaging and smoothing bispectra (Lii and Rosenblatt, 1982); (ii) using multi-tapers (Birkelund and Hanssen, 1999, 2000) or (iii) smoothing the bicovariance function (indirect-method) (Rao and Gabr, 1984), which we use here.
The smoothed bispectrum is:
Bispectrum estimation of El Niño index
Null hypothesis bispectrum
To reproduce the observed skewness, we can construct an AR process driven by a non-Gaussian noise as a null hypothesis
By using the coefficients of the AR(5) model (6), we get the approximations and hence This null is hereafter designated NGAR(5).
Figure 6 shows (Fig. 6b) and imaginary (Fig. 6c) parts of the bispectrum (20) of the NGAR(5) model over the global bifrequency domain. The real part is mostly positive whereas the imaginary part is formed by dipolar structures. Both parts reflect the symmetry shown in (13) and exhibit a positive band of maximum absolute values in the region near cpt and cpt, coinciding with the frequency range where the power of the AR(5) model (6) exceeds 3 (°C)2/cpt as seen in Fig. 3.
Empirical smoothed bispectrum
To estimate the empirical bispectrum using the smoothed estimator (19), we start by identifying the ideal window function according to (A4) in Appendix A. The values of the bispectral fluctuations and the average confidence interval half-size (cihs) of the bispectrum (given by the square root of the l.h.s. of (A4)) are given in Table 2 for several values of In order to separate peaks, the condition must be satisfied. As expected, smaller bandwidths (larger ) lead to larger bispectral fluctuations and larger bispectrum estimation errors via cish. From Table 2, the largest around which is which is used below.
Both parts show several peaks. In particular, both present high absolute values for cpt, as for null NGAR(5) model (Fig. 6) but with much larger amplitude. As expected, the average diameter of peaks is of the order of The integral of ) (Fig. 7a) is the estimated skewness as Eq. (15). According to Eq. (11), the superposition of Fourier components along the triplet of frequencies where is positive (negative), will mostly generate extreme positive (negative) values, i.e. El Niño (La Niña) events. The integral of positive and negative values of ) over the frequency domain is 0.54 and −0.08 respectively (adding up to the observed skewness 0.46). The local maxima of the real part, mostly contributing to El Niño extremes, lie near the frequency triplet and the band corresponding to local maxima of the power spectrum (Fig. 3), (e.g. quadratic phase synchronization Jajcay et al., 2018). On the other hand, the local minima of the real part, mostly contributing to La Niña extremes, lie near the frequency triplets and which are again close to relative power maxima (see Fig. 3).
Figure 7c shows the squared bispectrum amplitude, providing the bispectral contribution to the predictability through (16), which agree quite well with Timmermann (2003). Its maxima occur near the local extremes of the real or imaginary parts of (Fig. 7a,b). The most relevant region for nonlinear predictability occurs for frequencies satisfying cpt. Another maximum is observed for cpt, producing oscillations with periods of 5–6 trimesters, and suggests possible source of the high nonlinear predictability for lags 5–6 trm, as diagnosed by Cox test in Fig. 5c.
Bispectrum and bicovariance near the origin
The bispectrum is relevant for the bicovariance behaviour near the origin. In fact, can be approximated by a Taylor expansion:
The partial derivatives at the origin, estimated with the smoothed El Niño bispectrum yield which explains most of the symmetric decrease of near the origin (see Fig. 4b). The term however explains the asymmetry of that decrease, which is stronger for positive than negative lags yielding the bicovariance minimum
Bispectrum from frequency-band partitions
A coarse-grained description of the bispectrum can be achieved by classifying the triplets into sets of frequencies forming a partition of Each triplet is then characterized by the number of frequencies in each set. We consider the simple partition of the frequency interval using a cutoff frequency 0<<1/2, separating low (S) and high (F) frequencies, with the corresponding decomposition (see Fig. 1). Figure 8a shows the 4 obtained subdomains namely, SSS, SSF, SFF and FFF, yielding an expansion into 4 terms of third-order statistics, e.g.,
Figure 8b shows the terms in the r.h.s. of Eq. (26) as a function of A reasonable criterion of discrimination among the different components is to choose that maximizes the sum |, which takes place at (3.04 years). This yields inter- (slow S) and intra-triennial (fast F) variations with respective 82% and 38% explained variance, with a well-marked scale separation lying at a local minimum of the smoothed power spectrum (see Fig. 3), and a minimum value of (–0.066).
To see the impact of spectral decomposition on the different terms of skewness, we compare in Table 3 the terms of Eq. (26), derived directly from the time series to those obtained from the partial integrals of the smoothed bispectrum (Fig. 7a). Table 3 shows that the values are quite close, except for the negative value of The underestimation obtained from the smoothed bispectrum is suggested to be due to the weak resolution of low frequencies.
Extremes are classified according to the dominant term (SSS, SSF, SFF or FFF). From Table 3, extreme events of La Niña must be explained by the slow component (e.g. 1887, 1917, 1956, 2000) or by phase synchronization of and (mostly of SFF type, e.g. 1973, 1988, 2008, and 2011) (Fig. 1). On the other hand, extreme events of El Niño, are mainly due to slow-fast component interactions, namely of SSF type (e.g. 1877, 1918, 1930, 1958, 2015) and SFF type (e.g. 1926, 1951, 1965, 1972, 1982–83, 1992, 1997, 2002) or from fast components only (FFF type) (e.g. 1923, 1977, 2006, 2009). However, some El Niño events (e.g. 1905, 1940, 1986–87), have occurred due to long persistence of the slow component (SSS type) (Fig. 1). Note also that there are few cases of phase polarity between fast and slow components (e.g. 1974) that lead to weak El Niño index.
In order to determine temporal changes of the bispectrum, we assess the third moment and its decomposition, Eq. (26), both in the full period (FULL) and along the three half-centuries: 1870–1919 (HC1), 1920–1969 (HC2 and 1970–2018 (HC3) (Fig. 1). Moreover, we evaluate the above statistics during El Niños and La Niñas to examine the variability of extremes and corresponding spectral contributions. For a given term in Eq. (26), for instance, SSS, its average decomposes as: where and giving the contributions to during El Niños and La Niñas, respectively. Table 4 summarizes the results.
First, the most recent half century (HC3) has on average, the most extreme episodes of La Niña and El Niño, as observed from the high absolute values of and The amplification of La Ninãs comes mostly from a clear increase of self-slow interaction SSS=–0.06 and cross interaction SFF=–0.4 whereas amplification of El Niños comes from the enhancement of the SFF term (0.6), as compared to the previous two half centuries. This suggests changes and decadal variability of the ENSO skewness, its bicovariance and bispectrum (Wu and Hsieh, 2003), associated to changes in the preferential Fourier phase couplings (Schulte et al., 2019). This was accompanied by an ENSO regime shift, near 1970 towards more nonlinearity (An and Wang, 2000; An and Jin, 2004; An, 2009).
Statistical significance of the empirical bispectrum
It is important to check the acceptance or rejection of the null bispectrum of NGAR(5) (Fig. 6b,c). The spectral method used here is based on a variation of the Hinich (1982) test of linearity. We anticipate that both the local (A6) and the integrated (A7) spectral-based tests of nonlinearity in the bi-frequency domain reject the null in consistency with the nonlinearity Cox test in the time domain (see Section 4.2.2) and hence other sources of non-Gaussianity (e.g. deterministic nonlinearity and multiplicative noise) shall be necessary. Furthermore, as shown in Appendix A the asymptotic bias (A2), variance (A3) as well as the asymptotic Gaussian PDF (Rao and Gabr, 1984) of the smoothed estimator are not good approximations because of the small number of degrees freedom of the time series and hence cannot be used to test the null This could be alleviated by using, e.g. a very long run of a climate model simulation. We use a Monte-Carlo strategy by computing the statistics of bispectrum by generating 10,000 surrogates of the NGAR(5) model forced by a noise prescribed by its first three moments. In order to easily obtain noise realizations, we consider noises produced by polynomial independent standard Gaussian noises, by relating the coefficients of monomial expectations to the imposed noise moments. For instance, the first trial noise: where is a standard Gaussian white noise, leads to and yielding and and its excess kurtosis is 1.073.
Here, we choose: where are independent standard Gaussians with and yielding and and a excess kurtosis of 2.475. The results are quite robust to changes in the noise model. Other possible, though less practical, noises are generated by maximum entropy constrained by the four first moments (Pires et al., 2010). We then compute the Monte-Carlo ensemble average and variance of the real and imaginary parts of the smoothed bispectrum. Noise high-order moments (greater than 2) appear only to influence the high-order moments of the smoothed spectrum (e.g. skewness and kurtosis) which are not relevant for the linearity test devised here.
The deviation of El Niño smoothed bispectrum (Fig. 7a,b) from that of NGAR(5) model is assessed by the test statistic (standardized deviation) (Eq. (A6)): Under its real and imaginary parts are approximately standard Gaussian. We also limited the tests to frequencies with higher bispectrum amplitude, roughly corresponding to (as in Fig. 7a,c). Figure 7 shows the real (Fig. 7d) and imaginary (Fig. 7e) parts of where significant regions (at significance level). are color-shaded. Fig. 7d shows that most peaks of (Fig. 7a) are significant. In particular, the low-frequency region (SSS type), producing La Niña events for cpt, is significant (i.e. rejecting ). The other positive and negative bispectrum extremes discussed in Section 5.3.2 are also significant at %. The imaginary part of the test (Fig. 7e) and the squared amplitude (Fig. 7f) are also highly significant in most of the relevant regions of the bispectrum with significance levels reaching 5%. The most significant region of nonlinear predictability holds approximately for within cpt where bispectrum is significant at producing oscillations with periods of the order 5–6 trimesters. This suggests a possible source of the high nonlinear predictability for lags 3–6 trm, as diagnosed by Cox test (Fig. 5c), and for the nonlinear curtailing of El Niño Spring barrier (see Fig. 5a).
The local test computed on a frequency basis may lead, ambiguously, either to the rejection or to the acceptance of linearity, depending on (see Fig. 7d–e). This is suggested by the fact that finite N-sized samples generated by the non-Gaussian NGAR(5) model led to local frequency tests where linearity is falsely rejected (not shown). Therefore, in order to overcome this difficulty and enhance test robustness, we propose the integrated test of nonlinearity (A7) given by over a representative lattice (Fig. A3). We found that nonlinearity cannot be rejected (at 5% level), thanks to the highly significant regions of El Niño bispectrum (Fig. 7d–e and 7a–c).
Normalized bispectrum and bicoherency
An independent test of linearity, beyond that of previous section and diagnostic of phase synchronization comes from the normalized bispectrum or bicoherence spectrum (Kim and Powers, 1979; Nikias and Raghuveer, 1987; Hinich and Wolinsky, 2005; Rao et al., 2012). It is obtained by prewhitening to yield a non-Gaussian white noise and reconstructed by inverse FT of The test is then:
We stress that the phases of and are the same (i.e. ), leading to a nonvanishing correlation
A linear process i.e. where is a white noise yields By using the result of Section 5.1.2, the normalized bispectrum (27) becomes where is the phase of the DFT of sequence Therefore, the amplitude of is uniform, i.e. which is precisely the Hinich (1982) null hypothesis of linearity.
In the case of El Niño, we get an estimated prewhitened non-Gaussian noise by using the more reliable theoretical maximum entropy NGAR(5) spectrum for the normalization in (27), instead of the empirical smoothed spectrum. The lag correlation of the resulting noise is very close to zero and thus can be considered a white noise. Its skewness is and the excess kurtosis is The correlation with the signal is quite high: 0.75, coming mainly from extreme events.
The smoothed normalized bispectrum, using the same window length is hereby denoted Significant peaks (at 20% significance level) of both of the real (Fig. 9a) and imaginary (Fig. 9b) parts are located nearly at the same bifrequencies as the non-normalized bispectrum (Fig. 7a,b) though peaks are attenuated by normalization and a new peak appears at higher frequencies (2.5 years), cpts (2.8 years). The squared bicoherency (Fig. 9c) is clearly nonuniform, showing regions of nonacceptance of the null bispectrum of NGAR(5) and hence rejecting the linearity hypothesis.
ENSO has been extensively studied to look for a deeper understanding of the underlying physics and complexity (see recent reviews of Chunzai, 2018; Timmermann et al., 2018 and references therein), improve predictability (see the review of Tang et al., 2018), as well as to get accurate statistics (e.g. pdf, extremes etc.). This was done through different dynamical models (physical-based deterministic models), statistical models (e.g. linear inverse modelling by Penland (1996) and Privalsky and Muzylev, 2013) and models based on machine learning (Dijkstra et al., 2019).
However, even complex models may exhibit biases of various statistics. The present top-down approach of fitting simple stochastic models to observations, attempts learn signal-noise relationships from models, enabling parametrizations of the nonlinear and complex effects of nonobserved variables and hence reproducing a set of relevant stochastic properties (e.g. spectrum, bispectrum).
A number of stochastic univariate models of ENSO have been fitted such as: smooth transition autoregressive (STAR) models (Hall et al., 2001; Ubilava and Helmers, 2013), autoregressive conditional heteroscedasticity type models (ARCH) (Ahn and Kim, 2005), and threshold AR models (De Gooijer, 2017). This section aims at fitting a minimal univariate stochastic model for El Niño 3.4. index driven by a multiplicative Gaussian delayed noise, able to reproduce the observed empirical spectrum, skewness and bispectrum as well as assess the impact it has on predictability, compared to benchmark linear models.
The model formulation
The models fitted here, belong to a class in which the simulated scalar state at integer is driven by a noise where is a standard Gaussian white noise and is a positive constant. The simulated state depends (through a function F) on: a) the simulated previous state values at represented in delay coordinate (Takens et al., 1981) by b) the previous noise values at and c) a parameter vector Throughout this section bold letters refer to vectors and italic to scalars. The model writes thus as:
The model (28) will also be used in forecast mode, and the -lag forecast valid at time at is given by:
The models of form (28) include AR linear models, fitted in Section 3.3.2. However, in order to reproduce nonlinear and non-Gaussian ENSO behaviour, we have considered bilinear models (Haggan and Oyetunji, 1980; Rao and Gabr, 1984; Rao 1981), which differ from AR processes by the addition to them of lagged bilinear (BL) terms, denoted ARBL(p1, p2):
In order to optimize predictability and reproduce data statistics, we apply a hybrid fitting algorithm that minimizes a cost function which is the weighted sum of the normalized one-step forecast residuals and the normalized squared distance between a set of observed and simulated statistics (average, autocovariance and bi-covariance)
The term is given by the one-step forecast error:
Iterative minimization algorithms of for general bilinear models are discussed in Pham and Tran (1981), (Rao and Gabr 1984), Grahn 1995, Guegan and Pham (1989), Gabr 1998 and Falguerolles and Francis (1992). Traditionally, the method of moments is used to obtain implicit relationships between the parameters and lagged moments (e.g. Sesay and Rao, 1988; Tang and Mohler, 1988; Kim et al., 1990), where, in most cases parameters are difficult to be expressed as a function of moments. Here we apply a method where statistics are estimated from a long simulation of (Eq. (28)) with initial conditions: and …, Statistics are computed for with and the initial values are discarded from statistics as spin-up.
The term involving the mean, autocovariance and bicovariance from observations, ( and ), and simulations ( and is
The used window lag functions and are scaled by The Parseval Theorem applied to (35–36), shows that minimizing leads also to minimizing errors in the spectral domain.
In the analysis we compare two situations: (simple fitting) and the hybrid fitting where / given by the ratio of typical variations of and (hybrid fitting). The optimal parameters issued from simple and hybrid fittings are hereby denoted and respectively. Note that the term reduces overfitting and the domination of one term over the other, see Appendix B for the description of the minimization of We compare both fittings in terms of and for the AR(p1) model and several ARBL(p1, p2) models. The statistical significance is given through the normalized Akaike Information Criterion: that penalizes the number of model terms.
Results for El Niño index
Table 5 shows that the mean residual squares decreases with increasing model complexity. For hybrid, NAIC decreases with increasing complexity (i.e., no overfitting). Moreover, the hybrid fitting is able to get improved statistics compared to that from the simple fitting with reductions up to about one fifth for the ARBL(5,5) model. That reduction entails very tiny increments in the sum of residuals i.e. of the order of 1%, but still keeping significant NAIC values.
The estimated of the ARBL(5,5) model are shown in Table 6 and
Simulated autocovariance and spectrum
We note that the autoregressive part of the ARBL(5,5) model is quite similar to that of AR(5) model (Eq. (6)). The bilinear coefficients have smaller amplitude than the autoregressive coefficients. ARBL(5,5) contains two feedback terms corresponding to whose nonzero mean values come from white noise squares and leading to a nonvanishing constant This parametrizes partially the bicovariance at the interseasonal scales which is at the origin of the nonlinear reduction of the Spring Predictability Barrier (see Section 4.2.2). The model recovers quite well the empirical autocovariance function (not shown), and also the smoothed spectrum (Fig. 10) using the window lag with particularly similar peak in the band cpt.
Simulated bicovariance and bispectrum
Most (∼80%) uncertainty in comes from the bicovariance uncertainty through The simulated bicovariance (Fig. 11) reproduces very well the same pattern of the bicovariance inferred from observations (Fig. 4b), at least up to lags 12 trimesters. The simulation yields a skewness equal to 0.26, which is comparable with the observed skewness (0.46). Any simpler model with only one bilinear term is unable to yield positive skewness and negative bicovariances which are fundamental to get skillful El Niño predictions from Spring to the next Winter.
The smoothed bispectrum of the ARBL(5,5) simulation, using a window lag is shown in Fig. 12a (real part) and Fig. 12b (imaginary part), to be compared with the empirical one (Fig. 7a,b). The real part (Fig. 7a) is quite well reproduced, with negative values in the low-frequency band and positive local maxima near and (Fig. 12a). The decomposition of skewness (Eq. (26)), (with ) yields the values −0.036, 0.062, 0.154 and 0.082 respectively for the SSS, SSF, SFF and SSS contributions, which agree approximately with observations (Table 3). The imaginary part of the simulated bispectrum (Fig. 12b) is also roughly well reproduced, showing negative values within the region (Fig. 7b) and positive elsewhere. The maximum is near cpts. Note that the existence of a single peak is related to the simulated single-peak spectrum.
We shall remark that the bilinear models chosen here, have a linear deterministic part with nonlinearity coming indirectly through the CAM noise. However, other type of models could be fitted, e.g. adding quadratic terms in the deterministic forcing but which can lead to other difficulties like instabilities and chaotic behaviour in simulations.
In order to assess the predictability impact of the inclusion of bilinear terms in ARBL models, compared to the AR(5) model, we compute the correlation skill (Table 5) between observations and predictions for lags for trimesters. Models are optimized by hybrid fitting in the training period 1870–1969 (100 years) and predictions are evaluated in the validation period 1970–2018 (49 years), where the most intense La Niñas and El Niños have been observed (see Section 5.3.4). All the tested models’ predictions are skillful (>0.5) for lags up to two trimesters.
Table 5 shows that, in general correlation skills increase with increasing complexity. For instance, the correlation skill of model ARBL(5,5) is about 2%, 7% and 9% larger than AR(5), respectively for lags of 1, 2 and 3 trimesters. The presence of at least two bilinear terms suggests the reason behind the improvement of the 2-trimester forecasts by ARBL(5,5), with respect to AR(5), for which some extreme El Niños (e.g. 1973, 1983, 1998, 2016) are more accurately predicted. The ARBL(5,5) model has no explicit deterministic nonlinearities, which are common to physically-based models. Here, nonlinearities are parametrized through the bilinear terms. Despite the simplicity of the ARBL(5,5) model, its correlation skills are not dramatically smaller, in the same period than those of physically-based models and to those of a much more complex neural-network based model as observed in Fig. 2a of (Ham et al., 2019).
Discussion and conclusion
El Niño Southern Oscillation (ENSO) is one of the most important coupled atmosphere–ocean system, exhibiting time scales ranging from seasons to decades and beyond, with a particularly worldwide teleconnection. Using different stochastic and/or dynamic approaches, most studies have emphasized and shown its intrinsic complexity, nonlinearity and non-Gaussianity. Most of those studies limited their investigations to the second order statistics in addition to skewness and/or kurtosis.
Here, we follow the same line of research by performing a data-driven systematic study of the third-order stochastic moments, both in the time and spectral domains, applied to the standardized trimonthly-average El Niño 3.4 index with a trimester sampling. Within the time domain, this comprises the bicovariance in addition to nonlinear correlations for testing nonlinearity and nonlinear predictability for forecasting horizons from seasons up to a few years. The study uses a 149-year period (1870–2018) time series with its statistically significant skewness of 0.46, peaking mostly at the boreal winter (1.04). The analysis of bicovariance maxima reveals high negative nonlinear correlation, implying that El Niño or La Niña extremes are likely to be followed by La Niña one year later, whereas mild conditions, on the other hand, favour El Niño occurrence.
The analysis of the nonlinear predictability, on seasonal time scales, shows that such nonlinear correlation is enhanced further when forecasts are issued at the NH Spring season (AMJ). This is linked to the persistence of many La Niñas starting in Spring up to next Winter and to the fact that strong Winter El Niños have only occurred under close climatological conditions in the previous boreal Spring. This strongly suggests that nonlinearity in the inter-seasonal timescale can contribute significantly to reduce the so-called El Niño Spring predictability barrier. Another equally important aspect is the fact that ENSO nonlinearity allows for the extension of predictability skill even for forecasting time of a few years, particularly when these forecasting time intervals satisfy phase synchronization and quadratic phase locking with certain dominant Fourier frequencies.
Similarly, within the spectral domain the bispectrum and bicoherence have been computed. As with power spectrum and variance, the bispectrum provides, in particular, the contribution of each bi-frequency bin to the observed skewness and squared bicovariance. This warrants the detection of combinations of El Niño Fourier components that mostly contribute to ENSO extremes by phase synchronization. The bispectrum also permits a test of nonlinearity in the spectral domain. The bispectrum has been estimated by a smoothed estimator using a window lag of 30 trimesters = 7.5 years, obtained from a trade-off between bispectrum bias, variance, and spectral resolution. To estimate the statistical significance of peaks, a conservative test has been adopted. The bispectrum of a non-Gaussian autoregressive null-hypothesis model NGAR(5) is tested and rejected at 5% significance level. We first obtained the coarse-grained spectral partition of the skewness by splitting the full signal into a slow component (with periods larger than 3 years) and a fast component The skewness is then decomposed into 4 components, namely and implying, in particular, that most El Niños result from interaction between inter- and intra-triennial timescales. Some decadal tendency towards SFF-type El Niños is apparent from the time series, which is consistent with the observed ENSO decadal variability. Note that if a maximum of the bispectrum real part is observed at then a peak in the power spectrum is observed approximately at In particular, the leading bispectral maxima contributing to El Niño occurs at cpt (periods of 5 and 2.5 years inside the SSF region) and near the band crossing the SFF and FFF regions, with a maximum at (periods of 2.9 and 1.5 years). On the other hand, minima contributing mostly to La Niña extremes, lie near (periods of 14 and 7 years) and (periods of 5, 7 and 4 years), both inside the SSS region.
Lastly, a minimal stochastic model was constructed, which was able to reproduce the main features of the spectrum and bispectrum, and yielded robust improvement of the predictability skill, compared to an autoregressive AR(5) model. The model was selected from a large class of bilinear models with correlated-additive–multiplicative lagged noise. To gain predictability skill with the right stochastic properties, a hybrid fitting approach is used by minimizing a combination of forecasting squared residuals and squared deviations from empirical third-order statistics. The bilinear model yields forecast improvements, particularly at lags of 1, 2 and 3 trimesters with 2%, 7% and 9% of correlation skill increment respectively, suggested to be linked to the attenuation of El Niño predictability Spring barrier and to the more accurate prediction of super El Niños.
This study contributes to the understanding of ENSO predictability and modelling from the perspective of the bispectrum and phase synchronization. In a changing climate, this is especially relevant for the study and predictability of ENSO extremes resulting from resonant-type interaction. The study also provides the possibility to investigate other ENSO indices such as El-Nino Modoki or other Nino indices, and check whether other processes are at play. In particular, forecast skill of ENSO, based on the developed models are of great importance for seasonal (and longer) timescales forecasting. A systematic analysis of these topics is beyond the scope of this manuscript and is left for future research.