Start Submission Become a Reviewer

Reading: Asynchronous data assimilation with the EnKF in presence of additive model error

Download

A- A+
Alt. Display

Original Research Papers

Asynchronous data assimilation with the EnKF in presence of additive model error

Authors:

Pavel Sakov ,

Bureau of Meteorology, Melbourne, AU
X close

Marc Bocquet

CEREA, Joint laboratory Ecole des Ponts ParisTech and EDF R&D, Universite Paris-Est, Champs-sur-Marne, FR
X close

Abstract

The term ‘asynchronous data assimilation’ (ADA) refers to modifications of sequential data assimilation methods that take into consideration the observation time. In Sakov et al. [Tellus A, 62, 24–29 (2010)], a simple rule has been formulated for the ADA with the ensemble Kalman filter (EnKF). To assimilate scattered in time observations, one needs to calculate ensemble forecast observations using the forecast ensemble at observation time. Using then these ensemble observations in the EnKF update matches the optimal analysis in the linear perfect model case. In this note, we generalise this rule for the case of additive model error.

How to Cite: Sakov, P. and Bocquet, M., 2018. Asynchronous data assimilation with the EnKF in presence of additive model error. Tellus A: Dynamic Meteorology and Oceanography, 70(1), p.1414545. DOI: http://doi.org/10.1080/16000870.2017.1414545
6
Citations
  Published on 01 Jan 2018
 Accepted on 20 Nov 2017            Submitted on 20 Jul 2017
1.  

Introduction

The standard sequential data assimilation (DA) framework assumes that the time is discrete, and that observations assimilated at each time step are made at the analysis time. In practice, the time intervals between consecutive analyses can be substantial, and model states within the observation window can be quite different. It is often important in such cases for a DA method to take into account, in one way or another, the timing of observations. The method is then referred to as asynchronous, in contrast to its standard sequential formulation, which is referred to as synchronous.

The ensemble Kalman filter (EnKF, Evensen, 1994) is based on the Kalman filter (KF), which is a sequential method; however, in the linear perfect model case, the EnKF can be easily adapted to accommodate the asynchronous DA (ADA). Consider the associated minimisation problem:

((1a) )
x0=argminJ(x0),
((1b) )
J(x0)=x0-x0a(P0a)-12+i=1kyi-Hi(xi)Ri-12,
((1c) )
xi=Mi-1i(xi-1),i=1,,k.
Here the lower index i refers to time ti, xi is the model state, x0a – the initial state estimate, P0a – the initial state error covariance estimate,1yi – observations, Hi and Ri – the corresponding observation operator and observation error covariance matrix, Mij is the model resolvent that maps the state from time ti to tj; the norm notation xB2xTBx is used.

In order to simplify the notations, we define blkdiag(A1,,Ak) as the block diagonal matrix (or operator) made of the square matrices (or square operators) Aii=1,,k. We also define vec(A1,,Ak) as the matrix (or operator) that stacks the matrices (or operators) Aii=1,,k that are assumed to have the same column number. With these notations, the cost function (1b) can be written as follows:

((2) )
J(x0)=x0-x0a(P0a)-12+y-HM(x0)R-12,

where

((3) )
yvec(y1,,yk),
((4) )
Rblkdiag(R1,,Rk)

are the concatenated observation vector and corresponding observation error covariance matrix, respectively, and the forward map HM(x0) relates the initial state x0 to the observations:

((5) )
HM(x0)vecHiM0i(x0)i=1,,k.

Apart from the forward map (5) that yields forecast observations at times t1,,tk, the cost function (2) has the same form as that for a single DA cycle with synchronous observations. Consequently, in the linear case, when the tangent linear forward operator HM (the sensitivity of observations to the initial state) does not depend on x0, the cost function (2) can be minimised using existing EnKF solutions, provided that the standard (synchronous) observation functions are replaced by the generic forward function (5):

((6) )
H(Ef)vec{HiM0i(E0a)}i=1,,k,

where E is the EnKF ensemble; upper “f” refers to forecast; H(Ef) denotes the forecast ensemble observations and E0a is the initial ensemble. In practice, this means that to assimilate asynchronously with the EnKF one simply needs to calculate ensemble observations using forecast ensemble at observation time (Sakov et al., 2010). There are no specific restrictions on R in (2) – in particular, it does not have to be block-diagonal – therefore in theory observation errors can be correlated in time within a DA cycle.

Before formulated in Sakov et al. (2010), the recipe (6) has been used in a scheme called 4D-LETKF (Hunt et al., 2007), where it was empirically derived from a method called 4D-EnKF (Hunt et al., 2004).

In practical terms, the ADA makes it possible to avoid storing the full ensemble at each observation time, storing only ensemble observations instead. Because in large-scale geophysical systems the model size is typically much larger than the number of observations, this yields a significant economy of resources.

Formulation () of the minimisation problem implies assimilation time t0; however, one interesting feature of the EnKF in the linear perfect model case is the time invariance of the optimising ensemble transform. If the update is conducted at time ti by applying transform X to a forecast ensemble Eif,

((7) )
Eia=EifX,

then, to the same effect, it can be applied at other time tj:

((8) )
Eja=MijEia=Mij(EifX)=(MijEif)X=EjfX.

This time invariance of the ensemble transform has been used in the ensemble Kalman smoother (Evensen, 2003) and made it possible to interpret the ensemble transform as a linear combination of the ensemble trajectories in the 4D-EnKF (Hunt et al., 2004).

The above framework for the ADA with the EnKF is based on two important assumptions: linearity and perfect model. While the KF is a linear method, it can be (and indeed is) successfully applied to weakly nonlinear cases, when the Jacobians M(x)=xM(x) and H(x)=xH(x) do not change much through the DA cycle and over the characteristic uncertainty range of the state. The same principle motivates the applicability of the approach (6) to the ADA with the EnKF. This is why we kept the nonlinear notation for the forward operator.2 In strongly nonlinear cases, the method is, generally, no longer applicable, and iterative minimisation algorithms (e.g. Gu and Oliver, 2007; Bocquet and Sakov, 2014) must be used.

The situation in the case with the model error is somewhat similar. Various aspects of additive deterministic (possibly time-correlated) model error and how formulation () should be generalised have been considered in Lorenc (2003), Trémolet (2006) and Carrassi and Vannitsem (2010). However, because (1c) assumes a lossless transfer of information between DA system states in time by the model, it has not been clear whether the concept of the ADA can still be useful in cases with substantial model error. Recently, an iterative method for strongly nonlinear systems with additive stochastic model error called IEnKF-Q has been proposed (Sakov et al., in press) that successfully employs combining propagated ensemble anomalies and model noise ensemble anomalies into a single ensemble of anomalies to obtain an algebraically simple solution for the Gauss–Newton minimisation. The authors suggested that a similar approach can possibly be used to generalise the concept of the ADA with the EnKF in the case of additive model error. This study proposes such a generalisation.

2.  

The minimisation problem

Below we mainly follow the formulation and approach to the solution of the minimisation problem from Sakov et al. (in press), with the aim to put up an analogue of the recipe (6) that would permit a simultaneous assimilation of observations made at different times in the case of additive model error without loss of optimality. Sakov et al. (in press) considered a single DA cycle starting at time t0 with observations at t1, while we consider a cycle with an arbitrary number of model steps:

((9a) )
{x0,,xk}=argmin{x0,,xk}J(x0,,xk),
((9b) )
J(x0,,xk)=x0-x0a(P0a)-12+i=1kyi-Hi(xi)Ri-12+i=1kxi-Mi-1i(xi-1)Qi-12.
Here x0a is the initial state (the analysis from the previous cycle), P0a – the initial state error covariance, Qi – the model error covariance at ti, and upper star refers to the solution of the minimisation problem.

From a statistical perspective, (9b) relates to the joint probability density function on state and observation vectors since J(x0,,xk) coincides with -2lnp(x0,,xk,y1,,yk) up to a constant. This implies that the model noise, as random variable, is assumed Gaussian, unbiased, of covariance matrix Qi at ti and uncorrelated in time (see Carrassi and Vannitsem, 2010, for a generalisation).

Let the covariances P0a and Qi be factorised by the corresponding ensemble anomalies A0a and Aiq:

((10a) )
A0a(A0a)T=P0a,A0a1=0,
((10b) )
Aiq(Aiq)T=Qi,Aiq1=0,i=1,,k,
where 1 is a vector of entries 1. In many applications, the representation of model errors through the anomalies Aiq is more natural and convenient than through the Qi. A discussion on this specific topic can be found in Section 4 of Sakov et al. (in press). Let us seek the solution of the minimisation problem () in the ensemble space of these anomalies:
((11a) )
x0=x0a+A0aw0,
((11b) )
xi=Mi-1i(xi-1)+Aiqwi,i=1,,k.
The weights wi are similar to the control variable ηi in the ‘forcing’ formulation of the weak-constraint 4D-Var (see Equation (2) in Trémolet, 2006), although using Aiqwi instead of ηi has a convenience of diagonalising Qi.

The problem () becomes equivalent to

((12a) )
{w0,,wk}=argmin{w0,,wk}J~(w0,,wk),
((12b) )
J~(w0,,wk)=i=0kwiTwi+i=1kyi-Hi(xi)Ri-12.
Let us concatenate w0,,wk into w:
((13) )
wvecw0,,wk;

then (12b) becomes

((14) )
J~(w)=wTw+y-H(x)R-12,

where y and R are given by (3) and (4), and

((15) )
xvec(x0,,xk),
((16) )
H(x)vecHi(xi)i=1,,k.

The cost function (14) is similar to the formalism developed by Lorenc (2003) or to Equation (11) of Desroziers et al. (2014), but differs in that it is not incremental and can be obtained directly.

In (14), x is a function of w because of (). Let us expand x in power series of w and retain the linear term only:

((17) )
x=xf+Aw+O(w2),

where3

((18) )
xfvecM0i(x0a)i=0,,k,

and

((19a) )
Avec(A~0,,A~k),
((19b) )
A~i[Ai,0],i=0,,k,
((19c) )
AiA0a,i=0[Mi-1iAi-1,Aiq],i=1,,k.
Here the ensemble anomalies A~i are completed by zeros so that they all have the same number of columns as Ak. Note that the augmentation of the propagated state error anomalies and model error anomalies has also been used in the reduced rank square root filter by Verlaan and Heemink (1997) in their Equation (28). Substituting (17) into (14) yields a form convenient for Gauss–Newton minimisation:
((20) )
J~(w)=wTw+y-H(xf)-Yw+O(w2)R-12,

where

((21) )
Yvec{HiA~i}i=1,,k.

In the nonlinear case, (20) can be minimised by Gauss–Newton iterations. This involves using the approximate Hessian obtained by neglecting nonlinear terms O(w2). In the linear case, the cost function becomes quadratic, and the solution is given by:

((22a) )
x=xf+Aw,
((22b) )
A=AT,T=D-1/2U,
((22c) )
w=D-1YTR-1y-H(xf),
((22d) )
DI+YTR-1Y,
where (·)1/2 denotes the unique positive (semi)definite square root of a positive (semi)definite matrix, and U is an arbitrary mean preserving orthonormal matrix4: UUT=I,U1=1.

These equations provide the update of the ensemble at all time levels. Similarly to the perfect model case, the same coefficients w and the same ensemble transform T are used over the whole assimilation window. However, due to the augmentation of the propagated ensemble anomalies with model error anomalies in (19c), the updated trajectories of the initial ensemble E0 are no longer continuous in time.

3.  

Asynchronous DA

Based on the solution of the minimisation problem in the previous section, we can now formulate a framework (rules) for the ADA with the EnKF in presence of additive model error. According to equations (), to update the system state, one needs to calculate the forecast observations H(xf) and forecast ensemble observation anomalies Y; they in turn allow one to calculate the Hessian 2D (approximate Hessian in the nonlinear case), coefficients w and transform T. Therefore, the essence of the ADA with the EnKF can be formulated as follows:

((23) )
H(xf)=vec{Hi(xif)}i=1,,k,
((21) )
Y=vec{HiA~i}i=1,,k,

where A~i is defined by (19b) and (19c).

Subject to the new evolution equation for ensemble anomalies (19c), the rules (21) and (23) can be interpreted in the same way as in the perfect model case: calculate ensemble observations using the forecast ensemble at observation time.

Figure 1.  

The sequence of the complete analysis cycle in both the linear (upper) and the nonlinear (lower) case. From left to right, the nodes indicate the equation to use as referred to in the paper and the yielded quantities. The second, lower chain in the nonlinear case is needed if the observation operator is nonlinear. Arrows mean that the computation of the target node content requires the content of the origin node.

The sequence of the complete linear analysis cycle is synthesised in Fig. 1 (upper panel).

4.  

Discussion

4.1.  

Increasing ensemble size

The update equations () have the same form as in the perfect model case; however, the propagation of the ensemble anomalies in (19c) is substantially different. According to (19c), in presence of model error, the forecast ensemble of anomalies is not only transformed with the tangent linear model, but is also augmented with the corresponding ensemble of model error anomalies. This procedure implicitly implements the forecast covariance equation of the KF

((24) )
Pi=MiPi-1MiT+Qi,

so that AiAiT=Pi, and manifests an effective increase of the ensemble size at every time step:

((25) )
mi=mi-1+miq,i=1,,k,

where mi is the size of Ai; miq is the size of Aiq and m0m is the size of A0a, i.e. the initial ensemble size. The practical choice for the miq has been discussed in Section 4 of Sakov et al. (in press).

Note that this increase of the ensemble size may not be strictly necessary for implementing (24). For example, if the column space of Aiq is a subspace of the column space of MiAi-1, then adding model error covariance can be done without changing the ensemble size. Yet, the augmentation of the state error and model error ensemble anomalies in (19c) is an essential part of the described minimisation procedure, regardless of whether it is possible to factorise the forecast state error covariance with a smaller ensemble or not. It enables to concatenate the vectors of ensemble weights wi into a single vector w in (13) so that each component wi of this vector acts only on the columns of the augmented ensemble associated with the model error added at time ti (except that w0 is indeed associated with the initial state error). In this way, the minimisation uses the same vector of coefficients w over the whole observation window, similarly to the perfect model case.

4.2.  

Nonlinearity and approximation of M and H

Although the EnKF is a linear method targeting weakly nonlinear systems, it is still desirable to optimise it for strongly nonlinear situations, for two reasons. Firstly, it is quite common for a weakly nonlinear system to become strongly nonlinear during relatively short and infrequent transition periods. Secondly, there are a variety of EnKF-based iterative methods for strongly nonlinear systems that would benefit from such an optimisation.

The EnKF is a derivative-less method: it approximates the Jacobians Mi and Hi based on application of the forward function HiMi to the ensemble of model states Ei-1. In the linear case, the results of these approximations do not depend on the ensemble spread; in the nonlinear case to achieve correct sampling of nonlinear effects, the magnitude of the ensemble anomalies should be of order of the standard deviation of the state error. For a system with additive model error, this means that the forecast error anomalies should have magnitude similar to that of samples from N(0,Pi), where the forecast covariance Pi is given by (24).

Such sampling can be associated with the statistical estimator of the covariance,

((26) )
P=1mA-1AAT,

where A is an ensemble of mA anomalies. Using this factorisation yields the characteristic magnitude of the anomalies of the order of its standard deviation, regardless of the ensemble size.

The minimisation procedure in Section 2 uses a different factorisation,

((27) )
P=AAT,

which simplifies the algebraic side. Using this factorisation reduces the characteristic magnitude of anomalies with increasing ensemble size. To obtain anomalies of physically ‘right’ magnitude, one needs to scale them up with a factor of mA-1, but only if all samples in the ensemble are drawn from the same pool. If, for example, we introduce a new ensemble

B=[A,0],

then we should still scale it with mA-1 rather than with mB-1, where mB is the size of B.

Because the magnitudes of the anomalies MiAi-1 and Aiq in (19c) cannot be assumed to be similar, it seems technically challenging to put up a generic re-scaling procedure for switching between factorisations (26) and (27) in the course of minimisation. This leaves us the following two main options.

  • (1)   Using factorisation (27) over the whole DA cycle, which means no rescaling before or after application of nonlinear functions M and H. This approach underestimates the ensemble spread in approximations and shifts the minimisation towards the Newton method from the more inherent for the EnKF (and generally more robust) secant method.
  • (2)   Scaling components of Ai appended at different time steps according to the size of these components before application of M and H, and scaling back after that. This approach still does not make all anomalies of Ai being sampled from N(0,Pi), but can be a good practical compromise. It is elaborated below.
First, we define the forecast ensembles Ei as
((28) )
Ei=E0a,i=0,Mi-1i(Ei-1),xif1T+miq-1Aiq,i=1,,k,

where E0a is the initial ensemble and

((29) )
xifMi-1i(Ei-1)1/mi-1.

We then define the new anomalies A~i that yield A via (). They are composed of sub-blocks Aij, each of them corresponding to the ensemble appended at time tj:

((30) )
A~i[Ai0,,Aik],

where

((31) )
Aij(Ei0-xif1T)/m0-1,j=0(Eij-xif1T)/mjq-1,1ji0,i<jk.

The submatrix Ei0 corresponds to the first m0 columns of Ei; Eij, for 1jk, corresponds to the submatrix from column mj-1+1 to column mj of Ei.

The forecast observation anomalies (21) are then calculated as

((32) )
Y=vecY1,,Yk,

where

((33) )
Yi[Yi0,,Yik],

and

((34) )
Yij[Hi(Ei0)-Hi(xif)1T]/m0-1,j=0[Hi(Eij)-Hi(xif)1T]/mjq-1,1ji0,i<jk.

To summarise, the sequence of the complete nonlinear analysis cycle is synthesised in Fig. 1 (lower panel).

4.3.  

Observations correlated in time

The formulation of the minimisation problem () assumes that observations at different times are noncorrelated, so that the merged observation error covariance matrix R in (4) is block-diagonal; however, we can see no problem in removing this restriction, that is assuming that the observations within a DA cycle can be time correlated.

4.4.  

Ensemble resizing

One practical implication of the proposed framework for ADA in presence of additive model error is the need for ensemble resizing at the end of a cycle to cut back the increased ensemble size due to (19c). If the augmented ensemble Ak has the same rank as A0, then the ensemble size reduction from mk to m0 can be performed losslessly (that is, without changing the analysed state error covariance). In large-scale geophysical EnKF systems, the ensemble size is always much smaller than the model size, and realistic implementations of model noise can be expected, generally, to project onto the left null-space of the ensemble. In this case, the resizing will involve removing the principal components with the smallest variance (Verlaan and Heemink, 1997; Raanes et al., 2015; Sakov et al., in press).

4.5.  

Observation time binning

The minimisation problem () associates each time step with observations (yi,Ri) and model error Qi. In practice the observations can be distributed in time continuously. They will need then to be binned by some time intervals, and model error estimates will need to be prescribed for each of these intervals. Because of the overhead associated with augmenting the ensembles of model error anomalies into the ensemble anomalies by (19c) one may have to use a rather coarse time binning for the model error. It is then possible to assume that the forward function HiMi in (34) propagates ensemble to the time of each particular observation, as the overhead associated with the time binning of ensemble observations can be much smaller. This is the same observation time binning strategy as the one proposed by Trémolet (2006) with his Equation (9).

4.6.  

ADA: further extending the KF

The EnKF yields a large number of advantages over the KF: scalability, derivative-less formulation, ease of implementing the covariance propagation equation, robustness, and so on. Most of these advantages can be viewed as concerning the technical side of the Kalman filtering. By contrast, the ADA aims at extending the very framework of the sequential DA. While in the perfect model case it is possible to modify the square root formulations of the KF to permit the ADA similarly to that in the EnKF, the technique proposed in this note involves using nonsquare covariance factorisations of varying size within a DA cycle. We see it as yet another step in the evolution of the KF-based methods towards greater universality, well beyond the original scope of the KF.

5.  

Summary

Equations (23), (21) and (19c) provide a framework for the ADA with the EnKF in presence of additive model error. Its derivation in the course of solving the minimisation problem warrants its optimality in the linear case.

The most essential new component of the proposed framework is Equation (19c) for propagation of ensemble anomalies. This equation manifests an effective increase of the ensemble size at each time step by the size of the ensemble of model error anomalies. We argue that this increase is necessary for the optimal ADA in presence of additive model error regardless of whether the model error anomalies project onto the column space of the ensemble or not; in practice, it deems it necessary to resize the ensemble at the end of the cycle.

Disclosure statement

{ label (or @symbol) needed for fn[@id='FN0005'] }No potential conflict of interest was reported by the authors. 


1 The upper label ‘a’ refers to analysis as, later on, these initial state and error covariance matrix will coincide with the outcome of a previous analysis. 

2 Another reason is that in the linear case functions M and H can be affine: M(x)=m+Mx,H(x)=h+Hx. 

3 In the EnKF instead of explicit propagation of state, it is common to use the average of the propagated ensemble: M(x)M(E)1/m, where m is the size of ensemble E. 

4 The presence of U here symbolically accounts for the variety of the deterministic EnKF schemes. 

References

  1. Bocquet, M. and Sakov, P.2014. An iterative ensemble Kalman smoother. Q. J. R. Meteorol. Soc.140, 1521–1535. 

  2. Carrassi, A. and Vannitsem, S.2010. Accounting for model error in variational data assimilation: a deterministic formulation. Mon. Wea. Rev.138, 3369–3386. 

  3. Desroziers, G., Camino, J.-T. and Berre, L.2014. 4DEnVar: link with 4D state formulation of variational assimilation and different possible implementations. Q. J. R. Meteorol. Soc.140, 2097–2110. 

  4. Evensen, G.1994. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte-Carlo methods to forecast error statistics. J. Geophys. Res.99, 10143–10162. 

  5. Evensen, G.2003. The Ensemble Kalman Filter: theoretical formulation and practical implementation. Ocean Dyn.53, 343–367. 

  6. Gu, Y. and Oliver, D. S.2007. An iterative ensemble Kalman filter for multiphase fluid flow data assimilation. SPE J.12, 438–446. 

  7. Hunt, B. R., Kalnay, E., Kostelich, E. J., Ott, E., Patil, D. J. and co-authors2004. Four-dimensional ensemble Kalman filtering. Tellus56A, 273–277. 

  8. Hunt, B. R., Kostelich, E. J. and Szunyogh, I.2007. Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter. Physica D230, 112–126. 

  9. Lorenc, A. C.2003. Modelling of error covariances by 4D-Var data assimilation. Q. J. R. Meteor. Soc.129, 3167–3182. 

  10. Raanes, P. N., Carrassi, A. and Bertino, L.2015. Extending the square root method to account for additive forecast noise in ensemble methods. Mon. Wea. Rev.143, 3857–38730. 

  11. Sakov, P., Evensen, G. and Bertino, L.2010. Asynchronous data assimilation with the EnKF. Tellus A62, 24–29. 

  12. Sakov, P., Haussaire, J.-M. and Bocquet, M.In press. An iterative ensemble Kalman filter in presence of additive model error. Q. J. R. Meteorol. Soc.. DOI: https://doi.org/10.1002/qj.3213. 

  13. Trémolet, Y.2006. Accounting for an imperfect model in 4D-Var. Q. J. R. Meteorol. Soc.132, 2483–2504. 

  14. Verlaan, M. and Heemink, A. W.1997. Tidal flow forecasting using reduced rank square root filters. Stoch. Hydrol. Hydraul.11, 349–368. 

comments powered by Disqus