464
Views
3
CrossRef citations to date
0
Altmetric
Research Article

Minimax-robust filtering problem for stochastic sequences with stationary increments and cointegrated sequences

ORCID Icon & | (Reviewing Editor)
Article: 1167811 | Received 25 Oct 2015, Accepted 11 Mar 2016, Published online: 06 Apr 2016

Abstract

The problem of optimal estimation of the linear functional Aξ=k=0a(k)ξ(-k) depending on the unknown values of a stochastic sequence ξ(m) with nth stationary increments from observations of the sequence ξ(m)+η(m) at points m=0,-1,-2,, where η(m) is a stationary sequence uncorrelated with ξ(m), is considered. Formulas for calculating the mean square error and the spectral characteristic of the optimal linear estimate of the functional are derived in the case where spectral densities of stochastic sequences are exactly known and admit the canonical factorizations. In the case of spectral uncertainty, where spectral densities are not known exactly, but sets of admissible spectral densities are specified, the minimax-robust method is applied. Formulas and relations that determine the least favourable spectral densities and the minimax-robust spectral characteristics are proposed for the given sets of admissible spectral densities. The filtering problem for a class of cointegrated sequences is investigated.

Public Interest Statement

The crucial assumption of application of traditional methods of finding solution to the filtering problem for random processes is that spectral densities of the processes are exactly known. However, in practical situations complete information on spectral densities is impossible and the established results cannot be directly applied to practical filtering problems. This is a reason to apply the minimax-robust method of filtering and derive the minimax estimates since they minimize the maximum value of the mean-square errors for all spectral densities from a given set of admissible densities simultaneously. In this article, we deal with the problem of optimal estimation of functionals depending on the unknown values of a random process with stationary increments based on observations of the process and a noise. In the case where spectral densities of the processes are not exactly known, relations for determining least favourable spectral densities and minimax-robust spectral characteristics are proposed.

1. Introduction

Basic results of the theory of wide sense stationary and related stochastic processes found their applications in analysis of models of economic and financial time series. The most simple examples are linear stationary models such as moving average (MA), autoregressive (AR) and autoregressive-moving average (ARMA) sequences, all of which refer to stationary sequences with rational spectral densities without unit AR-roots. Time series with trends and seasonal components are modelled by integrated ARMA (ARIMA) sequences which have unit roots in their autoregressive parts and are the examples of sequences with stationary increments. Such models are investigated during the last 30 years. The main points concerning model definition, parameter estimation, forecasting and further investigation of the models are discussed in the well-known book by Box, Jenkins, and Reinsel (Citation1994). While analysing financial data economists noticed that in some special cases linear combinations of integrated sequences become stationary. Granger (Citation1983) called this phenomenon cointegration. Cointegrated sequences found their application in applied and theoretical econometrics and financial time series analysis (see Engle & Granger, Citation1987).

The problem of estimation of unknown values of stochastic processes (extrapolation, interpolation and filtering problems) is an important part of the theory of stochastic processes. Effective methods of solution of the linear extrapolation, interpolation and filtering problems for stationary stochastic processes were developed by A.N. Kolmogorov, N. Wiener and A.M. Yaglom. See selected works by Kolmogorov (Citation1992), books by Wiener (Citation1966) and Yaglom (Citation1987a,Citation1987b). Further results one can find in the book by Rozanov (Citation1967).

Random processes with stationary nth increments are one of generalizations of the notion of stationary process that were introduced by Pinsker and Yaglom (Citation1954), Yaglom (Citation1955,Citation1957), Pinsker (Citation1955). They described the spectral representation of the stationary increment process and the canonical factorization of the spectral density, solved the extrapolation problem for such processes and discussed some examples. See books by Yaglom (Citation1987a,Citation1987b) for more relative results and references.

Traditional methods of finding solutions to extrapolation, interpolation and filtering problems for stationary and related stochastic processes are applied under the basic assumption that the spectral densities of the considered stochastic processes are exactly known. However, in most practical situations complete information on the spectral structure of the processes isn’t available. Investigators can apply the traditional methods considering the estimated spectral densities instead of the true ones. However, as it was shown by Vastola and Poor (Citation1983) with the help of some examples, this approach can result in significant increasing of the value of the error of estimate. Therefore, it is reasonable to derive estimates which are optimal for all densities from a certain class of spectral densities. The introduced estimates are called minimax-robust since they minimize the maximum of the mean-square errors for all spectral densities from a set of admissible spectral densities simultaneously. The minimax-robust method of estimation was proposed by Grenander (Citation1957) and later developed by Franke and Poor (Citation1984), Franke ( franke1985) for investigating the extrapolation and interpolation problems. For more details we refer to the survey paper by Kassam and Poor (Citation1985) who collected results in minimax (robust) methods of data processing till 1984. A wide range of results in minimax-robust extrapolation, interpolation and filtering of stochastic processes and sequences belongs to Moklyachuk (Citation1990,Citation2000,Citation2001,Citation2008a,Citation2015). Later Moklyachuk and Masyutka (Citation2006a,Citation2006b,Citation2007,Citation2008,Citation2011,Citation2012) developed the minimax technique of estimation for vector-valued stationary processes and sequences. Dubovets’ka, Masyutka, and Moklyachuk (Citation2012) investigated the problem of minimax-robust interpolation for another generalization of stationary processes – periodically correlated sequences. In the further papers Dubovetska and Moklyachuk (Citation2013a,Citation2013b,Citation2014a,Citation2014b) investigated the minimax-robust extrapolation, interpolation and filtering problems for periodically correlated processes and sequences. See the book by Golichenko and Moklyachuk (Citation2014) for more relative results and references. The minimax-robust extrapolation, interpolation and filtering problems for stochastic sequences and processes with nth stationary increments were solved by Luz and Moklyachuk (Citation2012,Citation2013a,Citation2013b,Citation2014a,Citation2014b,Citation2015a,Citation2015b,Citation2015c,Citation2016a,Citation2016b) Moklyachuk and Luz (Citation2013). The obtained results are applied to find solution of the extrapolation and filtering problems for cointegrated sequences (Luz and Moklyachuk, Citation2014b,Citation2015c). The problem of extrapolation of stochastic sequences with stationary increments from observations with non-stationary noise was investigated by Bell (Citation1984).

In the present article, we deal with the problem of optimal linear estimation of the functional Aξ=k=0a(k)ξ(-k) which depends on the unknown values of a stochastic sequence ξ(k) with nth stationary increments from observations of the sequence ξ(k)+η(k) at points k=0,-1,-2,, where η(k) is a stationary stochastic sequence uncorrelated with the sequence ξ(k). Solution to this problem based on the Hilbert space projection method is described in the paper by Luz and Moklyachuk (Citation2014b). The derived formulas for calculating the spectral characteristic and the mean square error of the optimal estimate A^ξ of the functional Aξ are complicated for application and need to construct the inverse operator (Pμ)-1 which is also a complicated problem. On the other hand, most of spectral densities of stochastic sequences applied in time series analysis admit factorization. This is a reason to derive formulas for calculating the spectral characteristic and the mean square error of the optimal estimate of the functional which use coefficients of the canonical factorizations of spectral densities. In this article, it is shown that the derived formulas can be simplified under the condition that the spectral densities are such that the canonical factorizations of the functions hold true. The case of spectral certainty as well as the case of spectral uncertainty is considered. Formulas for calculating values of the mean-square errors and the spectral characteristics of the optimal linear estimate of the functional are derived under the condition of spectral certainty, where the spectral densities of the processes are exactly known. In the case of spectral uncertainty, where the spectral densities of the processes are not exactly known, but a class of admissible spectral densities is given, relations that determine the least favourable spectral densities and the minimax spectral characteristics are derived for some classes of spectral densities. The obtained results are applied to investigate the filtering problem for cointegrated sequences.

2. Stationary increment stochastic sequences. Spectral representation

In this section, we present a brief description of the properties of stochastic sequences with nth stationary increments. More detailed description of the properties of such sequences can be found in the books by Yaglom (Citation1987a,Citation1987b).

Definition 2.1

For a given stochastic sequence {ξ(m),mZ} the sequence(1) ξ(n)(m,μ)=(1-Bμ)nξ(m)=l=0n(-1)lnlξ(m-lμ),(1)

where Bμ is a backward shift operator with step μZ, such that Bμξ(m)=ξ(m-μ), is called a stochastic nth increment sequence with step μZ.

For the stochastic nth increment sequence ξ(n)(m,μ) the following relations hold true:(2) ξ(n)(m,-μ)=(-1)nξ(n)(m+nμ,μ),(2) (3) ξ(n)(m,kμ)=l=0(k-1)nAlξ(n)(m-lμ,μ),kN,(3)

where coefficients {Al,l=0,1,2,,(k-1)n} are determined by the representation(1+x++xk-1)n=l=0(k-1)nAlxl.

Definition 2.2

The stochastic nth increment sequence ξ(n)(m,μ) generated by the stochastic sequence {ξ(m),mZ} is wide sense stationary if the mathematical expectationsEξ(n)(m0,μ)=c(n)(μ),Eξ(n)(m0+m,μ1)ξ(n)(m0,μ2)¯=D(n)(m,μ1,μ2)

exist for all m0,μ,m,μ1,μ2 and do not depend on m0. The function c(n)(μ) is called a mean value of the nth increment sequence and the function D(n)(m,μ1,μ2) is called a structural function of the stationary nth increment sequence (or structural function of nth order of the stochastic sequence {ξ(m),mZ}).

The stochastic sequence {ξ(m),mZ} which determines the stationary nth increment sequence ξ(n)(m,μ) by formula (1) is called a sequence with stationary nth increments (or integrated sequence of order n).

Theorem 2.1

The mean value c(n)(μ) and the structural function D(n)(m,μ1,μ2) of the stochastic stationary nth increment sequence ξ(n)(m,μ) can be represented in the following forms:(4) c(n)(μ)=cμn,D(n)(m,μ1,μ2)=-ππeiλm(1-e-iμ1λ)n(1-eiμ2λ)n1λ2ndF(λ),(4)

where c is a constant, F(λ) is a left-continuous nondecreasing bounded function with F(-π)=0. The constant c and the structural function F(λ) are determined uniquely by the increment sequence ξ(n)(m,μ).

On the other hand, a function c(n)(μ) of the form (4) with a constant c and a function D(n)(m,μ1,μ2) of the form (5) with a function F(λ) satisfying the indicated conditions are the mean value and the structural function of some stationary nth increment sequence ξ(n)(m,μ), respectively.

Using representation (5) of the structural function of a stationary nth increment sequence ξ(n)(m,μ) and the Karhunen theorem (see Gikhman & Skorokhod, Citation2004; Karhunen, Citation1947), we obtain the following spectral representation of the stationary nth increment sequence ξ(n)(m,μ):(5) ξ(n)(m,μ)=-ππeimλ(1-e-iμλ)n1(iλ)ndZ(λ),(5)

where Zξ(n)(λ) is a random process with uncorrelated increments on [-π,π) with respect to the spectral function F(λ):(6) E|Zξ(n)(t2)-Zξ(n)(t1)|2=F(t2)-F(t1),-πt1<t2<π.(6)

3. The filtering problem

Consider a stochastic sequence {ξ(m),mZ} which generates the stationary nth increment sequence ξ(n)(m,μ) with absolutely continuous spectral function F(λ) that has spectral density f(λ). Let {η(m),mZ} be uncorrelated with the sequence ξ(m) stationary stochastic sequence with absolutely continuous spectral function G(λ) which has spectral density g(λ). Without loss of generality we will assume that the mean values of the increment sequence ξ(n)(m,μ) and stationary sequence η(m) equal to 0. Let us also assume that the step μ>0.

Consider the problem of mean-square optimal linear estimation of the functionalAξ=k=0a(k)ξ(-k)

which depends on the unknown values of the sequence ξ(m) from observations of the sequence ζ(m)=ξ(m)+η(m) at points m=0,-1,-2,.

We will suppose that coefficients a(k), k0, which determine the functional satisfy the inequalities(7) k=0|a(k)|<,k=0(k+1)|a(k)|2<,(7)

and the spectral densities f(λ) and g(λ) satisfy the minimality condition(8) -ππλ2n|1-eiλμ|2n(f(λ)+λ2ng(λ))dλ<.(8)

This condition (9) is sufficient in order that the mean-square error of the estimate of the functional Aξ is not equal to zero.

Note, thatp(λ)=f(λ)+λ2ng(λ)

is the spectral density of the stochastic sequence ζ(m).

The functional Aξ can be represented in the form Aξ=Aζ-Aη, where Aζ=k=0a(k)ζ(-k) and Aη=k=0a(k)η(-k). In the case where conditions (8), the functional Aη has a finite second moment. To construct an estimate of the functional Aξ it is sufficient to have an estimate of the functional Aη. Since the functional Aζ depends on the values of the stochastic sequence ζ(m), which is observed, we have the following relations:(9) A^ξ=Aζ-A^η,Δ(f,g;A^ξ)=E|Aξ-A^ξ|2=E|Aζ-Aη-Aζ+A^η|2=E|Aη-A^η|2=Δ(f,g;A^η).(9)

It follows from relation (10) that any estimate A^ξ of the functional Aξ can be represented in the form(10) A^ξ=Aζ--ππhμ(λ)dZξ(n)+η(n)(λ),(10)

where hμ(λ) is the spectral characteristic of the estimate A^η.

Denote by H0(ξμ(n)+ημ(n)) the closed linear subspace of the Hilbert space H=L2(Ω,F,P) of random variables γ that have zero first and finite second moment Eγ=0, E|γ|2<, which is generated by values {ξ(n)(k,μ)+η(n)(k,μ):k0}, μ>0. Denote by L20(p) the closed linear subspace of the Hilbert space L2(p) of square integrable on [-π;π) functions with respect to the measure which has the density p(λ), generated by functions eiλk(1-e-iλμ)n(iλ)-n:k0. It follows from the relationξ(n)(k,μ)+η(n)(k,μ)=-ππeiλk(1-e-iλμ)n1(iλ)ndZξ(n)+η(n)(λ)

that there exists a one to one correspondence between elements eiλk(1-e-iλμ)n(iλ)-n from the space L20(p) and elements ξ(n)(k,μ)+η(n)(k,μ) from the space H0(ξμ(n)+ημ(n)) correspondingly.

Let r(m,μ)=max-mμ,0, where by [x] we denote the least integer number among the numbers that are greater than or equal to x.

The mean square optimal estimate A^η is a projection of the element Aη on the subspace H0(ξμ(n)+ημ(n)). This projection is described in the paper by Luz and Moklyachuk (Citation2014b). A solution of the filtering problem is described in the following theorem.

Theorem 3.1

Let {ξ(m),mZ} be a stochastic sequence which defines stationary nth increment sequence ξ(n)(m,μ) with absolutely continuous spectral function F(λ) which has spectral density f(λ). Let {η(m),mZ} be uncorrelated with the sequence ξ(m) stationary stochastic sequence with absolutely continuous spectral function G(λ) which has spectral density g(λ). Let the coefficients {a(k):k0} satisfy conditions (8). Let the spectral densities f(λ) and g(λ) of stochastic sequences ξ(m) and η(m) satisfy the minimality condition (9). The mean square optimal linear estimate A^ξ of the functional Aξ based on observations of values ξ(m)+η(m) based on observations of the sequence ξ(m)+η(m) at points m=0,-1,-2, can be calculated by formula (11). The spectral characteristic hμ(λ) and the mean square error Δ(f,g;A^η) of the optimal estimate A^ξ are calculated by the formulas(11) hμ(λ)=A(e-iλ)(-iλ)ng(λ)f(λ)+λ2ng(λ)-(-iλ)nCμ(eiλ)(1-eiλμ)n(f(λ)+λ2ng(λ)),Cμ(eiλ)=k=0(Pμ-1Sμa~μ)keiλ(k+1),(11)

and(12) Δ(f,g;A^ξ)=Δ(f,g;A^η)=E|Aη-A^η|2=12π-ππA(e-iλ)(1-eiλμ)nf(λ)+λ2nCμ(eiλ)2|1-eiλμ|2n(f(λ)+λ2ng(λ))2g(λ)dλ+12π-ππA(e-iλ)(1-eiλμ)nλ2ng(λ)-λ2nCμ(eiλ)2λ2n|1-eiλμ|2n(f(λ)+λ2ng(λ))2f(λ)dλ=Sμa~μ,Pμ-1Sμa~μ+Qa,a(12)

respectively, where a=(a(0),a(1),a(2),), a~μ=(a~μ(0),a~μ(1),a~μ(2),), coefficients a~μ(k)=a-μ(k-μn), k0, are calculated by the formula(13) a-μ(m)=l=r(m,μ)n(-1)lnla(m+μl),m-μn.(13)

Here Sμ, Pμ, Q are the linear operators in the space 2 determined with the help of matrices with the elements (Sμ)k,j=Sk+1,j-μnμ, (Pμ)k,j=Pk,jμ, (Q)k,j=Qk,j for k,j0,Sk,jμ=12π-ππe-iλ(k+j)λ2ng(λ)|1-eiλμ|2n(f(λ)+λ2ng(λ))dλ,k0,j-μn,Pk,jμ=12π-ππeiλ(j-k)λ2n|1-eiλμ|2n(f(λ)+λ2ng(λ))dλ,k,j0,Qk,j=12π-ππeiλ(j-k)f(λ)g(λ)f(λ)+λ2ng(λ)dλ,k,j0.

This theorem gives us a possibility to find a solution to the filtering problem with the help of the Fourier coefficients of the functionsλ2n|1-eiλμ|2n(f(λ)+λ2ng(λ)),λ2ng(λ)|1-eiλμ|2n(f(λ)+λ2ng(λ)),f(λ)g(λ)f(λ)+λ2ng(λ).

The derived formulas are complicated for application and need to construct the inverse operator (Pμ)-1 which is also a complicated problem. On the other hand, most of spectral densities of stochastic sequences applied in time series analysis admit the factorization. This is a reason to derive formulas for calculating the spectral characteristic and the mean square error of the optimal estimate A^ξ of the functional Aξ which use the canonical factorizations of the spectral densities. In particular, the proposed formulas (12) and (13) can be simplified under the condition that the spectral densities f(λ) and g(λ) are such that the following canonical factorizations of the functions hold true:(14) λ2n|1-eiλμ|2n(f(λ)+λ2ng(λ))=k=0ψμ(k)e-iλk2=j=0θμ(j)e-iλj-2,g(λ)=k=-g(k)eiλk=j=0ϕ(j)e-iλj2.(14)

Denote by G the linear operator in the space 2 which is determined by the matrix with elements (G)l,k=g(l-k), l,k0. The following lemmas from the paper by Luz and Moklyachuk (Citation2015b) give formulas for calculating operators Pμ and G with the help of the coefficients of factorizations (15)–(16).

Lemma 3.1

Let the spectral densities f(λ) and g(λ) be such that the canonical factorizations (15) – (16) hold true. Define linear operators Ψμ and Φ in the space 2 with the help of matrices with elements (Ψμ)k,j=ψμ(k-j) and (Φ)k,j=ϕ(k-j) for 0jk, (Ψμ)k,j=0 and (Φ)k,j=0 for 0k<j. Then

(a)

the following factorization holds true (15) g(λ)λ2n|1-eiλμ|2n(f(λ)+λ2ng(λ))=k=-sμ(k)eiλk=k=0υμ(k)e-iλk2,υμ(k)=j=0kψμ(j)ϕ(k-j)=j=0kϕ(j)ψμ(k-j);(15)

(b)

linear operator Υμ in the space 2 determined by a matrix with elements (Υμ)k,j=υμ(k-j) for 0jk, (Υμ)k,j=0 for 0k<j, admits the representation Υμ=ΨμΦ=ΦΨμ.

Lemma 3.2

Let canonical factorizations (15–16) hold true. Let the linear operators Ψμ and Υμ in the space 2 determined in the same way as in the lemma (3.1) and let the linear operator Θμ in the space 2 determined by the matrix with elements (Θμ)k,j=θμ(k-j) for 0jk, (Θμ)k,j=0 for 0k<j. Define also a linear operator Tμ in the space 2 with the help of matrices with elements (Tμ)l,k=sμ(l-k), l,k0, where the coefficients sμ(k), k0, are determined in (17). Then

(a)

the linear operators Pμ, Tμ and G in the space 2 admit the factorizations Pμ=ΨμΨ¯μ, Tμ=ΥμΥ¯μ and G=ΦΦ¯;

(b)

the inverse operator (Pμ)-1admits the factorization (Pμ)-1=Θ¯μΘμ.

Lemma 3.3

Let the function g(λ) admit the factorization (16) and let the linear operators S and K in the space 2 are determined by matrix with elements (S)k,j=g(k+j) and (K)k,j=ϕ(k+j), k,j0. Then the operators S and K satisfy the relation S=K¯Φ=ΦK¯, where the linear operator Φ is determined in the lemma 3.1.

With the help of the introduced results we show that formulas (12) and (13) can be simplified in the case where the spectral densities f(λ) and g(λ) are such that the canonical factorizations (15) – (16) hold true. Denote eμ=ΘμSμa~μ. With the help of factorization (15) we have the next transformations:λ2nCμ(eiλ)|1-eiλμ|2np(λ)=k=0ψμ(k)e-iλkj=0k=0ψ¯μ(j)(Θ¯μeμ)keiλ(k+j+1)=k=0ψμ(k)e-iλkm=0p=0mk=pmψ¯μ(m-k)θ¯μ(k-p)eμ(p)eiλ(m+1)=k=0ψμ(k)e-iλkm=0eμ(m)eiλ(m+1),

where eμ(m)=(ΘμSμa~μ)m, m0, is the m-th elements of the vector eμ=ΘμSμa~μ. Since(ΘμSμa~μ)m=j=-μnp=mθμ(p-m)sμ(p+j+1)a-μ(j)=j=-μnl=0θμ(l)sμ(m+j+l+1)a-μ(j),

the following equality holds true(16) λ2nCμ(eiλ)|1-eiλμ|2np(λ)=k=0ψμ(k)e-iλkm=1j=-μnl=0θμ(l)sμ(m+j+l)a-μ(j)eiλm.(16)

With the help of factorization (17) and the relation1=k=0ψμ(k)e-iλkj=0θμ(j)e-iλj,

we have the next transformations(17) A(e-iλ)(1-eiλμ)nλ2ng(λ)|1-eiλμ|2np(λ)=k=0ψμ(k)e-iλkl=0θμ(l)e-iλlj=-μnm=-sμ(m+j)a-μ(j)eiλm=k=0ψμ(k)e-iλkm=-j=-μnl=0sμ(m+j+l)θμ(l)a-μ(j)eiλm.(17)

Define coefficients {b~μ(k):k0} in the following way: b~μ(0)=0, b~μ(k)=a-μ(-k) for 1kμn, b~μ(k)=0 for k>μn, where coefficients a-μ(k) are determined by formula (14). Define the vectors a-μ=(a-μ(0),a-μ(1),a-μ(2),) and b~μ=(b~μ(0),b~μ(1),b~μ(2),). Denote by B~μ the linear operator which is determined by the matrix with elements (B~μ)k,j=b~μ(k-j) for 0jk, (B~μ)k,j=0 for 0k<j.

Making use of relations (18), (19) and the relationA(e-iλ)(1-eiλμ)nλ2ng(λ)|1-eiλμ|2np(λ)-λ2nCμ(eiλ)|1-eiλμ|2np(λ)=k=0ψμ(k)e-iλkm=0j=-μnl=0sμ(j+l-m)θμ(l)a-μ(j)e-iλm=k=0ψμ(k)e-iλkm=0j=0l=0s¯μ(m-j-l)θμ(l)a-μ(j)e-iλm+k=0ψμ(k)e-iλkm=0j=1μnl=0s¯μ(m+j-l)θμ(l)a-μ(-j)e-iλm=k=0ψμ(k)e-iλkm=0(T¯μΘμa-μ)me-iλm+m=0(B~μT¯μθμ)me-iλm,

we derive the following formula for calculating the spectral characteristic:(18) hμ(λ)=(1-e-iλμ)n(iλ)nk=0ψμ(k)e-iλkm=0(C-μ+Cμ)ψ¯μme-iλm.(18)

In the last relation (Cμψ¯μ)m, m0, is the mth element of the vectorCμψ¯μ=Ψ¯μS¯b~μ,ψμ=(ψμ(0),ψμ(1),ψμ(2),), Cμ is the linear operator which is determined by the matrix with elements (Cμ)k,j=cμ(k+j), k,j0, cμ=S¯b~μ, S is the linear operator which is determined by the matrix with elements (S)k,j=g(k+j), k,j0.

It is stated in Lemma 3.3 that the operator S admits the representation S=K¯Φ=ΦK¯, where K is the linear operator which is determined by the matrix with elements (K)k,j=ϕ(k+j), k,j0. (C-μψ¯μ)m, m0, is the m-th element of the vector C-μψ¯μ=Ψ¯μG¯a-μ, ψμ=(ψμ(0),ψμ(1),ψμ(2),), C-μ is the linear operator which is determined by the matrix with elements (C-μ)k,j=c-μ(k+j), k,j0, c-μ=G¯a-μ, G is the linear operator which is determined by the matrix with elements (G)k,j=g(k-j), k,j0.

It follows from the Lemma 3.2 that the operator G admits the representation G=ΦΦ¯, where Φ is the linear operator which is determined by the matrix with elements (Φ)k,j=ϕ(k-j), k,j0.

The mean square error is calculated by the formula(19) Δ(f,g;A^ξ)=Δ(f,g;A^η)=E|Aη-A^η|2=12π-ππ|A(e-iλ)|2g(λ)dλ+12π-ππ|hμ(eiλ)|2(f(λ)+λ2ng(λ))dλ-12π-ππhμ(eiλ)A(e-iλ)¯(iλ)ng(λ)dλ-12π-ππhμ(eiλ)¯A(e-iλ)(-iλ)ng(λ)dλ=Ga,a-(Cμ+C-μ)ψ¯μ,(Cμ+C-μ)ψ¯μ.(19)

These observations can be summarized in the form of the theorem.

Theorem 3.2

Let {ξ(m),mZ} be a stochastic sequence which defines the stationary nth increment sequence ξ(n)(m,μ) with an absolutely continuous spectral function F(λ) which has spectral density f(λ). Let {η(m),mZ} be an uncorrelated with the sequence ξ(m) stationary stochastic sequence with an absolutely continuous spectral function G(λ) which has spectral density g(λ). Let the coefficients {a(k):k0} satisfy condition (8), and let the spectral densities f(λ) and g(λ) of the sequences ξ(m) and η(m) admit canonical factorizations (15–16). The spectral characteristic hμ(λ) and the mean square error Δ(f,g;A^ξ) of the optimal estimate A^ξ of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m=0,-1,-2, can be calculated by formulas (20) and (21).

Remark 3.1

Results described in theorem 3.2 can be used for finding the optimal estimate A^Nξ of the functional ANξ=k=0Na(k)ξ(-k) based on observations of the sequence ξ(m)+η(m) at points m=0,-1,-2,. For this purpose it is sufficient to take a(k)=0 for k>N in the formulas (11), (20), (21). In the case where N=0 we have the smoothing problem. Solution of this problem is described in the following corollary.

corollary 3.1

The optimal estimate ξ^(0) of the unknown value ξ(0) based on observations of the sequence ζ(m)=ξ(m)+η(m) at points m=0,-1,-2, is calculated by formulaξ^(0)=ζ(0)--ππhμ,0(λ)dZξ(n)+η(n)(λ).

The spectral characteristic hμ,0(λ) and the mean square error Δ(f,g;ξ^(0)) of the optimal estimate ξ^(0) are calculated by the formulashμ,0(λ)=(1-e-iλμ)n(iλ)nk=0ψμ(k)e-iλkm=0Ψ¯μΦ¯Kaμ,0me-iλm

andΔ(f,g;ξ^(0))=||ϕ||2-||Ψ¯μΦ¯Kaμ,0||2

correspondingly, where ϕ=(ϕ(0),ϕ(1),ϕ(2),), aμ,0=(aμ,0(0),aμ,0(1),aμ,0(2),) is an infinite dimension vector with elements aμ,0(μl)=(-1)lnl for l=0,1,2,,n and aμ,0(k)=0 for k0, kμl, l=0,1,2,,n.

Remark 3.2

Since for all n1 and μ1 the condition-ππln|1-eiλμ|2nλ2ndλ<

holds true, then there is a function wμ(z)=k=0wμ(k)zk such that k=0|wμ(k)|2< and |1-eiλμ|2nλ2n=|wμ(e-iλ)|2 (see Gikhman & Skorokhod, Citation2004). In the case where factorization (15) holds true, the function f(λ)+λ2ng(λ) admits the factorization(20) f(λ)+λ2ng(λ)=k=0θ(k)e-iλk2=j=0ψ(j)e-iλj-2.(20)

The spectral density f(λ) admits the canonical factorization(21) f(λ)=|Φ(e-iλ)|2,Φ(z)=k=0φ(k)zk,(21)

where the function Φ(z) has the radius of convergence r>1 and does not have zeros in the region |z|1.

Introduce the linear operators Θ, Ψ and Wμ in the space 2 with the help of the matrices with elements (Θ)k,j=θ(k-j), (Ψ)k,j=ψ(k-j) and (Wμ)k,j=wμ(k-j) for 0jk, (Θ)k,j=0, (Ψ)k,j=0 and (Wμ)k,j=0 for 0k<j. Denote Uμ=Wμ-1. The following relations hold true:(22) Θμ=ΘWμ=WμΘ,Ψμ=ΨUμ=UμΨ,θμ=Wμθ,ψμ=Uμψ,(22)

where θ=(θ(0),θ(1),θ(2),), ψ=(ψ(0),ψ(1),ψ(2),).

4. Filtering of cointegrated stochastic sequences

Consider two integrated stochastic sequences ξ(n)(m,μ) and ζ(n)(m,μ) with absolutely continuous spectral functions F(λ) and P(λ) which have spectral densities f(λ) and p(λ) correspondingly.

Definition 4.1

Two integrated stochastic sequences {ξ(m),mZ} and {ζ(m),mZ} are called cointegrated (of order 0) if there exists a constant β0 such that the sequence {ζ(m)-βξ(m):mZ} is stationary.

The filtering problem for cointegrated stochastic sequences consists in finding the mean-square optimal linear estimate of the functionalAξ=k=0a(k)ξ(-k)

which depends on the unknown values of the sequence ξ(m) from observations of the sequence ζ(m) at points m=0,-1,-2,. This problem can be solved by using results presented in the preceding section under the condition that sequences ξ(m) and ζ(m)-βξ(m) are uncorrelated.

Suppose that the spectral densities f(λ) and p(λ) are such that the following canonical factorizations hold true(23) |1-eiλμ|2np(λ)λ2n=k=0ψμβ(k)e-iλk-2,p(λ)=k=0ψβ(k)e-iλk-2,p(λ)-β2f(λ)=λ2nk=0ϕβ(k)e-iλk2.(23)

Detemine the linear operators Kβ, Ψβ and Φβ with the help of the canonical factorizations (25–26) in the same way as operators K, Ψ and Φ were defined. By using theorem 3.2, we derive that the spectral characteristic hμβ(λ) of the optimal estimate(24) A^ξ=Aζ--ππhμβ(λ)dZζ(n)(λ)(24)

of the functional Aξ is calculated by the formula(25) hμβ(λ)=(1-e-iλμ)n(iλ)nm=0(Cμβ+C-μβ)ψ¯μβme-iλmk=0ψμβ(k)e-iλk,(25)

whereCμβψ¯μβ=U¯μΨβ¯Φβ¯Kβb~μ,C-μβψ¯μβ=U¯μΨβ¯Φβ¯Φβa-μ,

the operator Uμ is determined in remark 3.2. The value of the mean-square error is calculated by the formula(26) Δ(f,g;A^ξ)=Gβa,a-(Cμβ+C-μβ)ψ¯μβ,(Cμβ+C-μβ)ψ¯μβ.(26)

Theorem 4.1

Let {ξ(m),mZ} and {ζ(m),mZ} be two cointegrated stochastic sequences which have absolutely continuous spectral functions F(λ) and G(λ) with the spectral densities f(λ) and p(λ), respectively. Let coefficients {a(k):k0} satisfy conditions (8). If the spectral densities f(λ) and p(λ) admit canonical factorizations (25–26), and the sequences ξ(m) and ζ(m)-βξ(m) are uncorrelated, then the spectral characteristic hμβ(λ) and the mean-square error Δ(f,g;A^ξ) of the optimal linear estimate A^ξ of the functional Aξ of unknown elements ξ(m), m0, from observations of the sequence ζ(m) at points m=0,-1,-2, is calculated by formulas (28) and (29).

Example 4.1

Consider two random sequences {(ξ(m),ζ(m)),mZ} which are determined by the equationsξ(m)=ξ(m-1)+ε1(m)+φε1(m-1),ζ(m)=ξ(m)+ε2(m),

where {ε1(m),ε2(m):mZ} are two uncorrelated sequences of independent identically distributed random variables with Eεi(m)=0, Eεi2(m)=1, i=1,2. Denotex=12(3+φ2(φ2-1)2+(φ+1)2),y=-12-2φ(3+φ2±(φ2-1)2+(φ+1)2),

and suppose that |φ|<1, |y|<1. In this case the random sequences ξ(m) and ζ(m) are ARIMA(0, 1, 1) sequences with the spectral densitiesf(λ)=λ2|1+φe-iλ|2|1-e-iλ|2,p(λ)=xλ2|1+ye-iλ|2|1-e-iλ|2.

The difference ζ(m)-ξ(m)=ε2(m) is a stationary sequence. That is why the integrated random sequences ξ(m) and ζ(m) are cointegrated with the parameter of cointegration β=1. Since the random sequences ε1(m) and ε2(m) are uncorrelated, then the sequences ξ(m) and ζ(m)-ξ(m) are uncorrelated also.

Consider the problem of filtering of the functional A1ξ=ξ(0)+aξ(-1) from observations of the sequence ζ(m) at points m=0,-1,-2,. Making use of Theorem 4.1 we will haveΦβ=100010001,Kβ=100000000,UμΨβ=1x100y10y2y1,a-μ=(1-a,a,0). Since the first coordinate of the vector b~μ is equal to 0, thenKβb~μ=(0,0,0,),Cμβψ¯μβ=(0,0,0,),

andC-μβψ¯μβ=U¯μΨβ¯Φβ¯Φβa-μ=1x(1+a(y-1),a,0,).

That is why the spectral characteristic hμβ(λ) of the optimal estimate A^1ξ of the functional A1ξ is calculated by the formulahμβ(λ)=(1-e-iλμ)n(iλ)n1x1+a(y-1)+(ay2+y(1-a)-a)k=1yk-1e-iλk,

Denote by s(0)=x-1(1+a(y-1)) and s(k)=x-1(ay2+y(1-a)-a)yk-1, k1. The optimal estimate A^1ξ of the functional A1ξ is calculated by the formulaA^1ξ=ζ(0)+aζ(-1)-k=0s(k)ζ(1)(-k,1)=(1-s(0))ζ(0)+(a+s(0)-s(1))ζ(-1)-k=2(s(k)-s(k-1))ζ(-k)=x-1(x-1-a(y-1))ζ(0)+x-1(1-y-a(y2-2y-x+2))ζ(-1)-x-1(y-1)(y+a(y2-y+1))k=2yk-2ζ(-k).

The value of the mean-square error Δ(f,g;A^1ξ) of the optimal estimate A^1ξ of the functional A1ξ is calculated by the formulaΔ(f,g;A^1ξ)=1+a2-x-1((1+a(y-1))2+a2).

5. Minimax-robust method of filtering

Formulas for calculation of values of the mean-square errors and spectral characteristics of the optimal linear estimates of the functional Aξ based on observations of the stochastic sequence ξ(k)+η(k) are derived under the condition that the spectral densities f(λ) and g(λ) of the stochastic sequences ξ(m) and η(m) are known. In the case where the spectral densities are not exactly known, but a set D=Df×Dg of admissible spectral densities is given, the minimax (robust) approach to estimation of functionals which depend on the unknown values of stochastic sequence with stationary increments is reasonable. In other words, we are interested in finding an estimate that minimizes the maximum of mean-square errors for all spectral densities from a given class D=Df×Dg of admissible spectral densities simultaneously.

Definition 5.1

For a given class of spectral densities D=Df×Dg the spectral densities f0(λ)Df, g0(λ)Dg are called the least favourable densities in the class D for the optimal linear filtering of the functional Aξ if the following relation holds trueΔ(f0,g0)=Δ(h(f0,g0);f0,g0)=max(f,g)Df×DgΔ(h(f,g);f,g).

Definition 5.2

For a given class of spectral densities D=Df×Dg the spectral characteristic h0(λ) of the optimal linear estimate of the functional Aξ is called minimax-robust if there are satisfied conditionsh0(λ)HD=(f,g)Df×DgL20(p),minhHDmax(f,g)Df×DgΔ(h;f,g)=max(f,g)Df×DgΔ(h0;f,g).

The following statements are consequences of the introduced definitions of least favourable spectral densities, minimax-robust spectral characteristic and 3.2.

Lemma 5.1

Spectral densities f0Df, g0Dg which admit canonical factorizations (15) and (16) are least favourable in the class D=Df×Dg for the optimal linear filtering of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0 if coefficients {ψ0(k),ϕ0(k):k0} of the canonical factorizations(27) f0(λ)+λ2ng0(λ)=k=0ψ0(k)e-iλk-2,g0(λ)=k=0ϕ0(k)e-iλk2.(27)

determine a solution of the constrained optimization problem(28) Ga,a-(Cμ+C-μ)ψ¯μ,(Cμ+C-μ)ψ¯μsup,f(λ)=k=0ψ(k)e-iλk-2-λ2nk=0ϕ(k)e-iλk2Df,g(λ)=k=0ϕ(k)e-iλk2Dg.(28)

The minimax spectral characteristic h0=hμ(f0,g0) is calculated by formula (20) if hμ(f,g0)HD.

Lemma 5.2

The spectral density g0Dg which admits the canonical factorizations (15) – (16) with the known spectral density f(λ) is least favourable in the class Dg for the optimal linear filtering of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if coefficients {ψ0(k),ϕ0(k):k0} of the canonical factorizations(29) f(λ)+λ2ng0(λ)=k=0ψ0(k)e-iλk-2,g0(λ)=k=0ϕ0(k)e-iλk2.(29)

determine a solution of the constrained optimization problem(30) Ga,a-(Cμ+C-μ)ψ¯μ,(Cμ+C-μ)ψ¯μsup,g(λ)=k=0ϕ(k)e-iλk2Dg.(30)

The minimax spectral characteristic h0=hμ(f0,g0) is calculated by formula (20) if hμ(f0,g0)HD.

Lemma 5.3

The spectral density f0Df which admit the canonical factorizations (15) with the known spectral density g(λ) is least favourable in the class Df for the optimal linear filtering of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if coefficients {ψ0(k),ϕ0(k):k0} of the canonical factorizations(31) f0(λ)+λ2ng(λ)=k=0ψ0(k)e-iλk-2,(31)

determine a solution of the constrained optimization problem(32) (Cμ+C-μ)ψ¯μ,(Cμ+C-μ)ψ¯μinf,f(λ)=k=0ψ(k)e-iλk-2-λ2nk=0ϕ(k)e-iλk2Df(32)

with the fixed coefficients {ϕ(k):k0}. The minimax spectral characteristic h0=hμ(f0,g0) is calculated by formula (20) if hμ(f0,g0)HD.

The minimax spectral characteristic h0 and the pair (f0,g0) of least favourable spectral densities form a saddle point of the function Δ(h;f,g) on the set HD×D. The saddle point inequalitiesΔ(h;f0,g0)Δ(h0;f0,g0)Δ(h0;f,g)fDf,gDg,hHD

hold true if h0=hμ(f0,g0) and hμ(f0,g0)HD, where (f0,g0) is a solution to the constrained optimization problem(33) Δ~(f,g)=-Δ(hμ(f0,g0);f,g)inf,(f,g)D,Δ(hμ(f0,g0);f,g)=12π-ππrμ,g0(e-iλ)2f0(λ)+λ2ng0(λ)f(λ)dλ+12π-ππλ2nrμ,f0(e-iλ)2f0(λ)+λ2ng0(λ)g(λ)dλ,rμ,g0(e-iλ)=k=0(Cμ0+C-μ0)ψ¯μ0ke-iλk,rμ,f0(e-iλ)=A(e-iλ)(1-e-iλμ)nk=0ψμ0(k)e-iλk-1-k=0(Cμ0+C-μ0)ψ¯μ0ke-iλk.(33)

This constrained optimization problem is equivalent to the unconstrained optimization problem(34) ΔD(f,g)=Δ~(f,g)+δ(f,g|Df×Dg)inf,(34)

where δ(f,g|Df×Dg) is the indicator function of the set Df×Dg. A solution (f0,g0) to this unconstrained optimization problem is characterized by a condition 0ΔD(f0,g0), which is the necessary and sufficient condition that the pair (f0,g0) belongs to the set of minimums of the convex functional ΔD(f,g) ( see Moklyachuk, Citation2008b; Pshenichnyi, Citation1971; Rockafellar, Citation1997). Here the notion ΔD(f0,g0) determines a subdifferential of the functional ΔD(f,g) at the point (f,g)=(f0,g0), which is a set of all linear bounded functionals Λ on L1×L1 satisfying the inequalityΔD(f,g)-ΔD(f0,g0)Λ(f,g)-(f0,g0),(f,g)D.

In the case of investigation the cointegrated sequences we get the following optimization problem for determination of the least favourable spectral densities(35) ΔD(f,p)=Δ~(f,p)+δ(f,p|Df×Dp)inf,Δ~(f,p)=Δ(hμβ(f0,p0);f,p)=12π-ππ|rμ,pβ,0(e-iλ)|2-β2|rμ,fβ,0(e-iλ)|2p0(λ)f(λ)dλ+12π-ππ|rμ,fβ,0(e-iλ)|2p0(λ)p(λ)dλ,rμ,pβ,0(e-iλ)=k=0(Cμβ)0+(C-μβ)0(ψ¯μβ)0ke-iλk,rμ,fβ,0(e-iλ)=A(e-iλ)(1-e-iλμ)nk=0ψμβ(k)0e-iλk-1-k=0(Cμβ)0+(C-μβ)0(ψ¯μβ)0ke-iλk.(35)

A solution (f0,g0) to this unconstrained optimization problem is characterized by the condition 0ΔD(f0,p0).

The form of the functionals Δ(hμ(f0,g0);f,g) and Δ(hμβ(f0,p0);f,p) allows us to find derivatives and differentials of these functionals in the space L1×L1. Hence, the complexity of the optimization problems (37) and (38) is characterized by the complexity of finding subdifferentials of the indicator functions δ(f,g|Df×Dg) of the sets Df×Dg.

6. Least favourable spectral densities in the class Df0×Dg0

Consider the problem of minimax-robust estimation of the functional Aξ based on observations of the sequence ξ(k)+η(k) at points of time k=0,-1,-2, provided the spectral densities f(λ) and g(λ) admit canonical factorizations (15 and 16) and belong to the set of admissible spectral densities D=Df×Dg, whereDf0=f(λ)|12π-ππf(λ)dλP1,Dg0=g(λ)|12π-ππg(λ)dλP2.

We use the Lagrange method of indefinite multiplies to find a solution to the constrained optimization problem (36), we get the following relations for determination the least favourable spectral densities f0Df0, g0Dg0:(36) f0(λ)+λ2ng0(λ)=α1rμ,g0(e-iλ)2,f0(λ)+λ2ng0(λ)=α2λ2nrμ,f0(e-iλ)2,(36)

where the multiplies α1,α20, matrices Cμ0, C-μ0, vector ψμ0=(ψμ0(0),ψμ0(1),ψμ0(2),) are determined with the help of factorizations (16) and (22) of the functions g0(λ) and f0(λ)+λ2ng0(λ), relation (24) and condition(37) 12π-ππf0(λ)dλ=P1,12π-ππg0(λ)dλ=P2.(37)

Making use the derived reasonings, we can formulate the following statements.

Proposition 6.1

The spectral densities f0(λ)Df0 and g0(λ)Dg0 which admit canonical factorizations (16) and (22) are least favourable in the class D=Df0×Dg0 for the optimal linear estimation of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if they satisfy equations (39 and 40), relations (24), the problem (31) and conditions (41). The function hμ(f0,g0) determined by formula (20), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

Proposition 6.2

Suppose that the spectral density f(λ) is known and admits canonical factorization (16). The spectral densityg0(λ)=1λ2nα2λ2nrμ,f0(e-iλ)2-f(λ)+

from the class Dg0 is least favourable for the optimal linear estimation of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if the coefficient α20, matrices Cμ0, C-μ0, vector ψμ0=(ψμ0(0),ψμ0(1),ψμ0(2),) are determined from canonical factorizations (16), (22) of the functions g0(λ) and f(λ)+λ2ng0(λ), relations (24), problem (33) and condition -ππg0(λ)dλ=2πP2. The function hμ(f,g0), determined by formula (20), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

Proposition 6.3

Suppose that the spectral density g(λ) is known and admits canonical factorization (16). The spectral densityf0(λ)=α1rμ,g0(e-iλ)2-λ2ng(λ)+

from the class Df0 is least favourable for the optimal linear estimation of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if the coefficient α10, vector ψμ0=(ψμ0(0),ψμ0(1),ψμ0(2),) are determined from canonical factorization (22) of the function f0(λ)+λ2ng(λ), relation (24), problem (35) and condition -ππf0(λ)dλ=2πP1. In this case, the matrices Cμ, C-μ are determined from the canonical factorization (16) of the given spectral density g(λ). The function hμ(f0,g), determined by formula (20), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

Consider the problem of minimax-robust estimation of the functional Aξ based on observations of the cointegrated sequence ζ(m) at points of time m=0,-1,-2, provided the spectral densities f(λ) and p(λ) admit canonical factorizations (25 and 26) and stochastic sequences ξ(m) and ζ(m)-βξ(m) are uncorrelated. The least favourable spectral densities in the set of admissible spectral densities Df0×Dp0, whereDf0=f(λ)|12π-ππf(λ)dλP1,Dp0=p(λ)|12π-ππp(λ)dλP2,

are determined by the condition 0ΔD(f0,p0). It follows from this condition that the least favourable spectral densities f0Df0, g0Dg0 are determined by the relations(38) p0(λ)=α1rμ,pβ,0(e-iλ)2-β2|rμ,fβ,0(e-iλ)|2,p0(λ)=α2|rμ,fβ,0(e-iλ)|2,(38)

where coefficients α1,α20, vector ψμβ0=(ψμβ,0(0),ψμβ,0(1),ψμβ,0(2),), matrices Cμβ0, C-μβ0 are determined by factorization Equations (25) and (26) of the function p0(λ) and p0(λ)-β2f0(λ), relation (24) and conditions(39) 12π-ππf0(λ)dλ=P1,12π-ππp0(λ)dλ=P2.(39)

Thus, we have the following statements.

Proposition 6.4

The spectral densities f0(λ) and p0(λ), that admit canonical factorizations (25) and (26), are least favourable in the class Df0×Dp0 for the optimal linear estimation of the functional Aξ based on observations of the cointegrated with ξ(m) sequence ζ(m) at points m0, if these densities satisfy equations (42 and 43) and are determined by relations (24), the problem (31) with g(λ):=λ-2n(p(λ)-β2f(λ)) and conditions (44). The function hμβ(f0,p0), determined by formula (28), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

7. Least favourable densities in the class D=Duv×Dε

Consider the problem of minimax-robust estimation of the functional Aξ based on observations of the sequence ξ(k)+η(k) at points of time k=0,-1,-2, provided the spectral densities f(λ) and g(λ) admit canonical factorizations (15 and 16) and belong to the set of admissible spectral densities D=Dvu×Dε, whereDvu=f(λ)|v(λ)f(λ)u(λ),12π-ππf(λ)dλ=P1,Dε=g(λ)|g(λ)=(1-ε)g1(λ)+εw(λ),12π-ππg(λ)dλ=P2.

The spectral densities u(λ), v(λ), g1(λ) are known and fixed and the spectral densities u(λ), v(λ) are bounded. It follows from the condition 0ΔD(f0,g0) that the least favourable spectral densities f0Duu, g0Dε satisfy the relations(40) f0(λ)+λ2ng0(λ)=α1rμ,g0(e-iλ)2(γ1(λ)+γ2(λ)+1)-1,f0(λ)+λ2ng0(λ)=α2λ2nrμ,f0(e-iλ)2(β(λ)+1)-1,(40)

where γ1(λ)0 and γ1(λ)=0 if f0(λ)v(λ); γ2(λ)0 and γ2(λ)=0, if f0(λ)u(λ); β(λ)0 and β(λ)=0 if g0(λ)(1-ε)g1(λ). The coefficients α10, α20, matrices Cμ0, C-μ0, vector ψμ0=(ψμ0(0),ψμ0(1),ψμ0(2),) are determined with the help of factorizations (16) and (22) of functions g0(λ) and f0(λ)+λ2ng0(λ), relations (24) and conditions (41).

The following theorems hold true.

Proposition 7.1

The spectral densities f0(λ)Df0 and g0(λ)Dg0 which admit the canonical factorizations (16) and (22) are least favourable in the class Dvu×Dε for the optimal linear estimation of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if they satisfy equations (45 and 46), relations (24), problem (31) and conditions (41). The function hμ(f0,g0) determined by formula (20), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

Proposition 7.2

Suppose that the spectral density f(λ) is known and admits canonical factorization (23). The spectral densityg0(λ)=1λ2nmaxα2λ2nrμ,f0(e-iλ)2-f(λ),(1-ε)g1(λ)

from the class Dε is least favourable for the optimal linear estimation of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if the coefficient α20, matrices Cμ0, C-μ0, vector ψμ0=(ψμ0(0),ψμ0(1),ψμ0(2),) are determined from the canonical factorizations (16), (22) of the functions g0(λ) and f(λ)+λ2ng0(λ), relations (24), the problem (33) and condition -ππg0(λ)dλ=2πP2. The function hμ(f,g0), determined by formula (20), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

Proposition 7.3

Suppose that the spectral density g(λ) is known and admits the canonical factorization (16). The spectral densityf0(λ)=minmaxα1rμ,g0(e-iλ)2-λ2ng(λ),v(λ)u(λ)

from the class Dvu is least favourable for the optimal linear estimation of the functional Aξ based on observations of the sequence ξ(m)+η(m) at points m0, if the coefficient α10, vector ψμ0=(ψμ0(0),ψμ0(1),ψμ0(2),) are determined from the canonical factorization (22) of the function f0(λ)+λ2ng(λ), relation (24), problem (35) and condition -ππf0(λ)dλ=2πP1. In this case, the matrices Cμ, C-μ are determined from canonical factorization (16) of the given spectral density g(λ). The function hμ(f0,g), determined by formula (20), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

Consider the problem of minimax-robust estimation of the functional Aξ based on observations of the cointegrated sequence ζ(m) at points of time m=0,-1,-2, provided the spectral densities f(λ) and p(λ) admit canonical factorizations (25) – (26) and stochastic sequences ξ(m) and ζ(m)-βξ(m) are uncorrelated. The least favourable spectral densities in the set of admissible spectral densities D=Dvu×Dε, whereDvu=f(λ)|v(λ)f(λ)u(λ),12π-ππf(λ)dλ=P1,Dε=p(λ)|p(λ)=(1-ε)p1(λ)+εw(λ),12π-ππp(λ)dλ=P2,

under the condition that the spectral densities f(λ) and p(λ) admit the canonical factorizations (25 and 26). From the condition 0ΔD(f0,p0), we get the following relations that determine the least favourable spectral densities f0Df0, g0Dg0 are determined by the relations(41) p0(λ)=α1rμ,pβ,0(e-iλ)2-β2|rμ,fβ,0(e-iλ)|2(γ1(λ)+γ2(λ)+1)-1,p0(λ)=α2|rμ,fβ,0(e-iλ)|2(β(λ)+1)-1,(41)

where γ1(λ)0 and γ1(λ)=0 if f0(λ)v(λ); γ2(λ)0 and γ2(λ)=0 if f0(λ)u(λ); β(λ)0 and β(λ)=0 if p0(λ)(1-ε)p1(λ). The coefficients α10, α20, matrices Cμβ0, C-μβ0, vector ψμβ0=(ψμβ,0(0),ψμβ,0(1),ψμβ,0(2),) are determined by the canonical factorizations (25) and (26) of functions p0(λ)-β2f0(λ) and p0(λ), relations (24) and condition (44).

Thus, we have the following statements.

Proposition 7.4

The spectral densities f0(λ) and p0(λ), that admit canonical factorizations (25 and 26), are least favourable in the class Dvu×Dε for the optimal linear estimation of the functional Aξ based on observations of the cointegrated with ξ(m) sequence ζ(m) at points m0, if these densities satisfy equations (47 and 48) and are determined by relations (24), problem (31) with g(λ):=λ-2n(p(λ)-β2f(λ)) and conditions 44). The function hμ(f0,p0), determined by formula (28), is minimax spectral characteristic of the optimal estimate of the functional Aξ.

8. Conclusions

In this article, we propose a solution of the filtering problem for the functional Aξ=k=0a(k)ξ(-k) which depends on unobserved values of a stochastic sequence ξ(k) with stationary nth increments. Estimates are based on observations of the sequence ξ(m)+η(m) at points of time m=-1,-2,, where η(m) is a stationary sequence uncorrelated with ξ(k). We derive formulas for calculating the values of the mean-square errors and the spectral characteristics of the optimal linear estimate of the functional in the case where spectral densities f(λ) and g(λ) of the sequences ξ(m) and η(m) are exactly known. The obtained formulas are simpler than those obtained with the help of the Fourier coefficients of some functions determined by the spectral densities. In the case of spectral uncertainty, where spectral densities are not known exactly, but a set of admissible spectral densities is specified, the minimax-robust method is applied. Formulas that determine the least favourable spectral densities and the minimax (robust) spectral characteristics are derived for some special sets of admissible spectral densities. The obtained results are applied to find a solution of the filtering problem for a class of cointegrated sequences.

Acknowledgements

The authors would like to thank the referees for careful reading of the article and giving constructive suggestions.

Additional information

Funding

The authors received no direct funding for this research.

Notes on contributors

Maksym Luz

Maksym Luz is a PhD student, Department of Probability Theory, Statistics and Actuarial Mathematics, Taras Shevchenko National University of Kyiv. His research interests include estimation problems for random processes and sequences with stationary increments.

Mikhail Moklyachuk

Mikhail Moklyachuk is a professor, Department of Probability Theory, Statistics and Actuarial Mathematics, Taras Shevchenko National University of Kyiv. He received PhD degree in Physics and Mathematical Sciences from the Taras Shevchenko University of Kyiv in 1977. His research interests are statistical problems for stochastic processes and random fields. He is also a member of editorial boards of several international journals.

References

  • Bell, W. (1984). Signal extraction for nonstationary time series. The Annals of Statistics, 12, 646–664.
  • Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (1994). Time series analysis, Forecasting and control (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
  • Dubovets’ka, I. I., Masyutka, O. Y., & Moklyachuk, M. P. (2012). Interpolation of periodically correlated stochastic sequences. Theory of Probability and Mathematical Statistics, 84, 43–56.
  • Dubovets’ka, I. I., & Moklyachuk, M. P. (2013a). Filtration of linear functionals of periodically correlated sequences. Theory of Probability and Mathematical Statistics, 86, 51–64.
  • Dubovets’ka, I. I., & Moklyachuk, M. P. (2013b). Minimax estimation problem for periodically correlated stochastic processes. Journal of Mathematics and System Science, 3, 26–30.
  • Dubovets’ka, I. I., & Moklyachuk, M. P. (2014a). Extrapolation of periodically correlated processes from observations with noise. Theory of Probability and Mathematical Statistics, 88, 67–83.
  • Dubovets’ka, I. I., & Moklyachuk, M. P. (2014b). On minimax estimation problems for periodically correlated stochastic processes. Contemporary Mathematics and Statistics, 2, 123–150.
  • Engle, R. F., & Granger, C. W. J. (1987). Co-integration and error correction: Representation, estimation and testing. Econometrica, 55, 251–276.
  • Franke, J. (1985). Minimax robust prediction of discrete time series. Zeitschrift far. Wahrscheinlichkeitstheorie und verwandte Gebiete, 68, 337–364.
  • Franke, J., & Poor, H. V. (1984). Minimax-robust filtering and finite-length robust predictors (Robust and Nonlinear Time Series Analysis. Lecture Notes in Statistics, Vol. 26, 87–126. Heidelberg: Springer-Verlag.
  • Gikhman, I. I., & Skorokhod, A. V. (2004). The theory of stochastic processes. I.. Berlin: Springer.
  • Golichenko, I. I., & Moklyachuk, M. P. (2014). Estimates of functionals of periodically correlated processes. Kyiv: NVP “Interservis".
  • Granger, C. W. J. (1983). Cointegrated variables and error correction models ( UCSD Discussion paper. 83–13a).
  • Grenander, U. (1957). A prediction problem in game theory. Arkiv för Matematik, 3, 371–379.
  • Ioffe, A. D., & Tihomirov, V. M. (1979). Theory of extremal problems (p. 460). Amsterdam: North-Holland.
  • Karhunen, K. (1947). Uber lineare Methoden in der Wahrscheinlichkeitsrechnung. Annales Academiae Scientiarum Fennicae. Series A I. Mathematica, 37, 3–79.
  • Kassam, S. A., & Poor, H. V. (1985). Robust techniques for signal processing: A survey. Proceedings of the IEEE, 73, 433–481.
  • Kolmogorov, A. N. (1992). Selected works of A. N. Kolmogorov. In A. N. Shiryayev (Ed.), Probability theory and mathematical statistics (Vol. II). Dordrecht: Kluwer Academic.
  • Luz, M. M., & Moklyachuk, M. P. (2012). Interpolation of functionals of stochastic sequences with stationary increments from observations with noise. Prykladna Statystyka. Aktuarna ta Finansova Matematyka, 2, 131–148.
  • Luz, M. M., & Moklyachuk, M. P. (2013a). Interpolation of functionals of stochastic sequences with stationary increments. Theory of Probability and Mathematical Statistics, 87, 117–133.
  • Luz, M. M., & Moklyachuk, M. P. (2013b). Minimax-robust filtering problem for stochastic sequence with stationary increments. Theory of Probability and Mathematical Statistics, 89, 117–131.
  • Luz, M., & Moklyachuk, M. (2014a). Robust extrapolation problem for stochastic processes with stationary increments. Mathematics and Statistics, 2, 78–88.
  • Luz, M., & Moklyachuk, M. (2014b). Minimax-robust filtering problem for stochastic sequences with stationary increments and cointegrated sequences. Statistics, Optimization & Information Computing, 2, 176–199.
  • Luz, M., & Moklyachuk, M. (2015a). Minimax interpolation problem for random processes with stationary increments. Statistics, Optimization & Information Computing, 3, 30–41.
  • Luz, M., & Moklyachuk, M. (2015b). Filtering problem for random processes with stationary increments. Contemporary Mathematics and Statistics, 3, 8–27.
  • Luz, M., & Moklyachuk, M. (2015c). Minimax-robust prediction problem for stochastic sequences with stationary increments and cointegrated sequences. Statistics, Optimization & Information Computing, 3, 160–188.
  • Luz, M., & Moklyachuk, M. (2016a). Filtering problem for functionals of stationary sequences. Statistics, Optimization & Information Computing, 4, 68–83.
  • Luz, M., & Moklyachuk, M. (2016b). Minimax prediction of random processes with stationary increments from observations with stationary noise. Cogent Mathematics, 3, 1–17, 1133219.
  • Moklyachuk, M. P. (1990). Minimax extrapolation and autoregressive-moving average processes. Theory of Probability and Mathematical Statistics, 41, 77–84.
  • Moklyachuk, M. P. (2000). Robust procedures in time series analysis. Theory of Stochastic Processes, 6, 127–147.
  • Moklyachuk, M. P. (2001). Game theory and convex optimization methods in robust estimation problems. Theory of Stochastic Processes, 7, 253–264.
  • Moklyachuk, M. P. (2008a). Robust estimates for functionals of stochastic processes. Kyiv: Kyiv University.
  • Moklyachuk, M. P. (2008b). Nonsmooth analysis and optimization (p. 400). Kyiv: Kyivskyi Universitet.
  • Moklyachuk, M. P. (2015). Minimax-robust estimation problems for stationary stochastic sequences. Statistics, Optimization & Information Computing, 3, 348–419.
  • Moklyachuk, M., & Luz, M. (2013). Robust extrapolation problem for stochastic sequences with stationary increments. Contemporary Mathematics and Statistics, 1, 123–150.
  • Moklyachuk, M. P., & Masyutka, O Yu (2006a). Extrapolation of multidimensional stationary processes. Random Operators and Stochastic Equations, 14, 233–244.
  • Moklyachuk, M. P., & Masyutka, O. Y. (2006b). Robust estimation problems for stochastic processes. Theory of Stochastic Processes, 12, 88–113.
  • Moklyachuk, M. P., & Masyutka, O. Y. (2007). Robust filtering of stochastic processes. Theory of Stochastic Processes, 13, 166–181.
  • Moklyachuk, M. P., & Masyutka, O. Y. (2008). Minimax prediction problem for multidimensional stationary stochastic sequences. Theory of Stochastic Processes, 14, 89–103.
  • Moklyachuk, M. P., & Masyutka, O. Y. (2011). Minimax prediction problem for multidimensional stationary stochastic processes. Communications in Statistics - Theory and Methods, 40, 3700–3710.
  • Moklyachuk, M. P., & Masyutka, O. Y. (2012). Minimax-robust estimation technique for stationary stochastic processes (p. 296). Lap Lambert Academic.
  • Pinsker, M. S. (1955). The theory of curves with nth stationary increments in Hilbert spaces. Izvestiya Akademii Nauk SSSR. Seriya Matematicheskaya, 19, 319–344.
  • Pinsker, M. S., & Yaglom, A. M. (1954). On linear extrapolation of random processes with nth stationary increments. Doklady Akademii Nauk SSSR, 94, 385–388.
  • Pshenichnyi, B. N. (1971). Necessary conditions for an extremum. Pure and applied mathematics. 4 (Vol. XVIII, 230 p). New York, NY: Marcel Dekker.
  • Rockafellar, R. T. (1997). Convex analysis (p. 451). Princeton, NJ: Princeton University Press.
  • Rozanov, Y. A. (1967). Stationary stochastic processes. San Francisco, CA: Holden-Day.
  • Vastola, K. S., & Poor, H. V. (1983). An analysis of the effects of spectral uncertainty on Wiener filtering. Automatica, 28, 289–293.
  • Wiener, N. (1966). Extrapolation, interpolation, and smoothing of stationary time series. With engineering applications. Cambridge: MIT Press, Massachusetts Institute of Technology.
  • Yaglom, A. M. (1955). Correlation theory of stationary and related random processes with stationary nth increments. Matematicheskii Sbornik, 37, 141–196.
  • Yaglom, A. M. (1957). Some classes of random fields in n-dimensional space related with random stationary processes. Teoriya Veroyatnostej i Ee Primeneniya, 2, 292–338.
  • Yaglom, A. M. (1987a). Correlation theory of stationary and related random functions. Basic results (Springer Series in Statistics, Vol. 1, p. 526). New York, NY: Springer-Verlag.
  • Yaglom, A. M. (1987b). Correlation theory of stationary and related random functions. In Supplementary notes and references (Springer Series in Statistics, Vol. 2, p. 258). New York, NY: Springer-Verlag.