![MathJax Logo](/templates/jsp/_style2/_tandf/pb2/images/math-jax.gif)
Abstract
This paper proposes a new regularization technique using spectral graph wavelet for backward heat conduction problem (BHCP) on the graph. The method uses the fourth-order compact difference for an approximation of differential operators. Meanwhile, the error estimate between the exact and wavelet regularized solution is derived. Adaptive node arrangement is obtained using spectral graph wavelet. The essence of the method is that the same operator can be used for the construction of the spectral graph wavelet and the approximation of the differential operator. The proposed method is applied to solve BHCP on graph arising from regular one-dimensional and two-dimensional mesh. Numerical results show that we can obtain a stable solution using spectral graph wavelet regularization. Moreover, spectral graph wavelet adaptivity and fourth-order compact difference scheme lead to a very efficient solution.
1. Introduction
The inverse problems [Citation1] are those in which one would like to determine causes provided a desired or observed effect is known. The applications include the inverse problem of gravimetry, tomography, the inverse conductivity problem, inverse scattering, inverse spectral problems, etc. Generally, an inverse problem is classified into three types: determination of the boundary conditions [Citation2], identification of the physical parameters or parameter identification [Citation3], determination of the initial state of the system [Citation4, Citation5]. We deal with the third type of inverse problem in the field of heat transfer, i.e. to find the temperature distribution for 0<t<T from measured temperature distribution at a time t = T>0, called the backward heat conduction problem (BHCP) [Citation6]. The BHCP we consider is
(1)
(1) Practically, this situation arises where measured temperature distribution in a finite strip is known at some final time T with the known value of temperature across the boundary of the domain. Here, ν is the constant heat diffusion coefficient and
stands for
-dimensional Laplacian operator. The space–time domain is denoted as
where D is the bounded domain in
.
BHCP is ill-posed since it violates the third property in the sense of Hadamard, i.e. the solution does not depend continuously on the final temperature. Moreover, any small disruption in the input data may yield drastic change to the solution. In fact, there is a quick disappearance of the characteristic of the initial temperature due to the rapid decay of temperature with respect to time t. Hence, due to measurement and computational error, the numerical recovery of initial temperature from measured data is a tough task. Such difficulties can be overcome by using some regularization techniques [Citation7].
Now, we brief several methods with different regularization techniques proposed for the BHCP in literature. The mollification method is used in [Citation8] where a sequence of mollification operators is used to mollifying the improper data. The modified boundary element method has been studied in [Citation9]. In [Citation4], iterative Boundary element method (BEM) is used where an iterative algorithm is numerically implemented using BEM and thus reduces the BHCP to a sequence of well-posed forward heat conduction problem. Some other methods include optimal filtering method [Citation10], quasi-reversibility technique [Citation11], kernel-based method [Citation12], operator-splitting method [Citation13] and the method of fundamental solutions [Citation14]. Seeking a group preserving scheme, BHCP has been solved in [Citation5]. The Fourier regularization method has been entrenched in [Citation15] to eliminate all high frequencies from the solution and thus converting them to well-posed. Central difference regularization is discussed in [Citation16].
In articles [Citation5, Citation16, Citation17], the authors use standard finite difference scheme for spatial discretization of second derivative for BHCP. Compact difference scheme which is a viable alternative to standard finite difference scheme was first introduced by Lele [Citation18] as a generalization of Padè scheme. Additionally, it is also useful for filtering and interpolation applications to evaluate the derivatives. Compact schemes are a simple and powerful tool to inherit the spectral-like resolution in the evaluation of derivatives of numerical solutions and very low numerical dissipation with the freedom of choosing the complex geometries and boundary conditions. With compact difference scheme, one can obtain numerical solutions with high accuracy without requiring extra boundary conditions which include one of its advantages. Due to smaller stencil size compared to standard finite difference scheme for the same accuracy, the matrices obtained in compact schemes have smaller bandwidth. This results in the low computational cost for compact schemes which adds on to the salient features of this scheme. In recent years, compact scheme has been applied to solve numerous problems like non-linear dispersive wave problem [Citation19], Navier–Stokes equations [Citation20], option pricing problems [Citation21], Reaction–Diffusion problems [Citation22], viscous incompressible flows on non-uniform grids [Citation23] and the numerical solution of PDE (partial differential equation) [Citation24].
The wavelet methods have been used to efficiently solve partial differential equations (PDEs) [Citation25] due to its attractive mathematical properties which include multiscale analysis, wavelet decomposition, fast wavelet transform, vanishing moments, localization and data compression. Due to this useful properties, wavelet methods have been successfully applied to direct as well as inverse problems. For example, Haar wavelet is used by authors in [Citation26, Citation27] for some direct and inverse problems. Legendre wavelets is used in [Citation28] to solve nonlinear problems, Chebyshev and Hermite wavelet are used in [Citation29, Citation30]. The numerical solution of some integral equations using wavelets based method can be seen in [Citation31–34]. The application to some other inverse problems includes sideways heat equation [Citation35], the Cauchy problem for the Laplace equation [Citation36], the Cauchy problem for the Helmholtz equation [Citation37] and backward heat conduction problem [Citation38]. The wavelets used until now to solve inverse problems are classical wavelets which are defined on flat geometries. The critical issue is to solve the inverse problems on a general manifold and graph. The spectral graph wavelets [Citation39] (introduced by Hammond et al. in 2011) exhibit good localization properties in the limit of fine scale. Other attractive properties include smoothness, shape-awareness, multiscale, and being flexible and adaptable for complex geometry and arbitrary topology. Moreover, in the construction of this wavelet, the mesh is not required to discretize the domain, hence is well suited for dealing with the inverse problems on general manifold and graph.
While numerically dealing with PDEs, one can either opt static node arrangement [Citation40] or can work with adaptive/dynamic node arrangement [Citation41, Citation42]. Static node arrangement is formulated at the beginning of the numerical computation where a huge set of nodes are needed to determine all the features of the solution. This continuously growing demands on computation raise the computational as well as storage cost. To overcome these issues, adaptive node arrangement is required where the strategy is to dynamically adapt discretizations in the way of the computational solution process. Instead of dealing with a large set of uniform points in the whole domain, more and more points are added only in the neighbourhood of the solution having sharp features thus leads to the dynamic adaption of the node arrangement. To guide the refinenemt, an indicator function is required for the generation of adaptive node arrangement. In the spectral graph wavelet, the graph Laplacian serves this purpose. While adaptive spectral graph wavelet method (ASGWM) is already applied for solving some linear and non-linear direct problems on the sphere and graph structure [Citation43, Citation44], it has never been applied to solve inverse problems on general manifold or graph-like structure.
In this paper, we deal with the BHCP on path graph (graph arising from regular one-dimensional mesh) and 2d-grid graph (graph arising from regular two-dimensional mesh). Though, we are dealing here only with a simple graph, BHCP on the complex graph will be considered in the near future. Moreover, in this article, our aim is only to introduce a new regularization technique which can be applied to solve any inverse problem defined on the graph. To the best of our knowledge, there is no regularization technique available in the literature to solve an inverse problem on the graph. The primary contribution of this paper can be seen in the following manner:
In adaptive spectral graph wavelet method, the same operator, i.e. the approximation of graph laplacian, is used for constructing wavelet as well as for the approximation of second-order differential operator occurred in the PDE.
Spectral graph wavelet is used for the regularization of BHCP by filtering the high frequency instabilities of the noisy data, thus converting them to well-posed.
Error estimate between exact and wavelet regularized solution is obtained.
For the first time, useful properties of the spectral graph wavelet (BHCP in our case) are exploited here to solve the inverse problem on graph arising from the regular mesh.
2. Spectral graph wavelet: a brief description
In spectral graph wavelet [Citation39], wavelets are defined on the graph by working in the spectral graph domain, where the basis consists of the eigenfunction of the graph Laplacian . Classical wavelets which are constructed by translating and dilating a single wavelet cannot be directly extended on the graph as it is not clear how to define translation and dilation on an irregular graph. In this section, a brief description of the spectral graph wavelet defined on the arbitrary finite weighted graph is given.
2.1. Weighted graph
A weighted graph consists of a set of vertices V, a set of edges E and a weight function
. The weighted function assigns a positive weight to each edge. Suppose the graph is finite (i.e. the number of vertices
in the graph
). The adjacency matrix
for the weighted graph G is the
matrix where
It will be assumed that the graph is undirected, i.e. the adjacency matrix A is symmetric matrix. The possibility of negative weights is not considered.
The degree of each vertex m for a weighed graph is written as . It is defined as the sum of weights of all the edges incident to it, i.e.
. A diagonal matrix D is defined with diagonal elements equal to the degrees
. Consider a function
on the vertices of the graph G. The value of function f on each vertex defines each coordinate and thus it can be viewed as a vector in
. Adopting this identification,
is written as a function on the vertices of the graph and
as the mth vertex value.
A non-normalized Laplacian is defined as . For any function
,
can be written as
where the summation is done over all vertices k that are connected to the vertex m. Consider the graph G arising from a regular mesh defined by taking vertices
as points on a regular one-dimensional grid, with each points connected to its two neighbours with weight
(where h is the distance between adjacent grid points). The graph Laplacian
to function
defined on the vertices is
which corresponds to standard 3-point stencil approximation of the continuous Beltrami operator with a difference in sign.
In the matrix form, the adjacency matrix A and the matrix D, corresponding to the above mentioned graph G shown in Figure () are given by
Hence, the graph Laplacian
which is central difference approximation of
is written as
Remark 2.1
If vertices are points on a regular two-dimensional grid (k = 2), with each points connected to its four neighbouring point, then the graph Laplacian
to function f defined on the vertices is
which corresponds to standard 5-point stencil approximation for
.
2.2. Spectral graph wavelet transform (SGWT)
As the graph Laplacian is a real symmetric matrix, it has a complete set of orthonormal eigenvectors. Let
are the eigenvectors corresponding to the eigenvalues
of the matrix
(like
used in defining the Fourier transform of the function defined on
are eigenfunctions of the one–dimensional Laplacian operator
) which satisfy
.
For any defined on the vertices of the graph G, its graph Fourier transform
is defined by
(2)
(2) where the convention is adopted that the inner product be conjugate-linear in the first argument. The inverse graph Fourier transform is
(3)
(3) Let
denotes the set of integers, then the finite set
can be defined as
. For
defined on the vertices of graph G, the associated norm is given by
If we denote
as discrete analogue of Sobolev space
, then the norm for a function
is given by
Now to define the spectral graph wavelet transform, initially a kernel function is chosen satisfying
and
. The kernel g satisfying these properties is called the wavelet kernel. These assumptions are sufficient for the kernel g to be localized in the spectral domain and the associated spectral graph wavelets will also be localized in the spectral domain. For the wavelet kernel g to be localized in the limit of fine scales, behaviour of g should be monic power of x near the origin [Citation39], i.e.
(4)
(4) where
as g is normalized. The coefficients of the cubic polynomial
are determined by the continuity constraints
,
and
.
For the given spectral graph wavelet kernel g, the wavelet operator acts on a given function f by modulating each Fourier mode as
(5)
(5) which gives SGWT. The inverse spectral graph wavlet transform (ISGWT) is
(6)
(6) The wavelet operator at scale
is then defined by
. It should be noted that even though the spatial domain of the graph is discrete, the domain of the wavelet kernel g is continuous and thus the scaling may be defined for any positive real number
. The spectral graph wavelets are defined as
where
represents the Kronecker delta vector which takes value 1 at the kth vertex and 0 otherwise, such that
The wavelet coefficients of a function f are obtained by taking the inner product of that function with these wavelets, as
Using the orthonormality of the
, the wavelet coefficients can be achieved directly from the wavelet operators as
(7)
(7)
For all numerical computations in this paper, is choosen according to (Equation4
(4)
(4) ), where we have taken
,
and
, so that
(8)
(8) One could refer to [Citation39] for other permissible values of
.
2.3. Spectral graph scaling function transform (SGST)
Initially, the spectral graph scaling functions
are determined by a single real-valued function
which acts as a low pass filter and satisfies two properties:
and
. We will refer to
as scaling kernel. In our computation, the chosen scaling kernel is
(9)
(9) where γ is set such that
. The scaling kernel
and wavelet kernel
for path graph is plotted against λ in Figure with
. The plot of scaling function
and wavelet function
for the path graph are given in Figure with k is choosen as mid point of the graph. From the figure, the space localization for the wavelets is readily apparent in the limit of fine scale, i.e. as
.
The scaling function coefficients are given by
(10)
(10) Note that the scaling functions defined in this way are present merely to smoothly represent the low frequency content of the function f.
Remark 2.2
In spectral graph wavelet, wavelets ψ are not generated through the two-scale relation as for traditional orthogonal wavelets. Therefore, this wavelet will fall under the category of non-MRA wavelet.
2.4. Fast SGWT and fast SGST
The naive way of computing SGWT and SGST, by directly using Equation (Equation7(7)
(7) ) and Equation (Equation10
(10)
(10) ) respectively, requires explicit computation of entire set of eigenvalues and eigenfunctions of the Laplacian operator
. This approach is computationally inefficient for large graphs. A fast transform that avoids the need for computing the complete spectrum of
is needed for SGWT and SGST to be a useful tool for practical computational problems. In order to achieve this, the wavelet kernel g (discussed in Section 2.2) and the scaling function kernel
(discussed in Section 2.3) are approximated by low order polynomials.
The kernels g and are approximated by their Chebyshev polynomials as they form an orthogonal basis for
. Any
has a convergent Chebyshev series
with the Chebyshev coefficients
For a fixed wavelet scale
, approximating
for
can be done by shifting the domain using the transformation
with
. Denoting the shifted Chebyshev polynomials
, we can write
(11)
(11) valid for
, with
For each scale
, the approximating polynomial
is achieved by terminating the Chebyshev expansion given by the equation (Equation11
(11)
(11) ) to
terms. Exactly the same scheme is used to approximate the scaling function kernel h by the polynomial
.
The selection of the values of may be considered a design problem, posing a trade off between accuracy and computational cost. The approximate wavelet and scaling function coefficients are given be
The plot of the wavelet kernel
and its approximate polynomial
for the path graph is plotted in Figure .
The spectral graph wavelets depend on the continuous scale parameter . But for any practical computation,
must be sampled to a finite number of scales. Choosing J scales
will yield a collection of NJ wavelets
, along with N scaling functions
. Therefore, any function f defined on the vertices of the graph can be written as
(12)
(12) where
are the scaling function coefficients and
are wavelet coefficients at the scale j.
3. Adaptive spectral graph wavelet method (ASGWM)
In this section, we will explain adaptive spectral graph wavelet method to solve BHCP on graph arising from the regular mesh. It should be noted that the graph Laplacian can be defined for graphs arising from sampling points on a differential manifold. The graph arising from the regular mesh which we are using is a simple example of such a sampling process. The graph Laplacian
obtained in the construction of spectral graph wavelet can serve the purpose of the approximation of Laplacian operator. The essence of this method is that the same operator is used for the approximation of the differential operator involved in the differential equation and for the construction of the spectral graph wavelets. We will use fourth-order compact difference approximation (CDA4) for approximating the Laplacian operator.
3.1. Compact difference approximation for second derivative
For a graph arising from regular mesh on an one-dimensional grid (path graph), the value of , hence
. Let
,
where m and n denote the indices for discrete space and time and h, τ are, respectively, the spatial and temporal variations. Let
be second derivative approximation of f at node
. The compact difference approximation for second derivative at all interior points derived from the formula [Citation18]
(13)
(13) for
. For the fourth-order accurate compact finite difference approximation, the coefficients in (Equation13
(13)
(13) ) are
and
which gives the fourth-order compact difference scheme as follows:
(14)
(14) For boundary points
and
, the fourth-order approximation of second derivative is given by
The details about compact finite difference scheme with its graphical representation have been discussed in [Citation45].
Remark 3.1
We are using here only fourth-order compact difference scheme for simplicity. In general, one can use any higher order compact difference scheme obtained using (Equation13(13)
(13) ).
3.2. Fourier analysis of differencing errors
To compare the difference approximations in numerical analysis, we require additional information to analyse the error characteristics of approximations. Therefore, we study resolution characteristics which can be measured via Fourier analysis/von-Neumann analysis. Resolution characteristics give the measure of error between difference scheme and its exact value over the full grid. Good resolution characteristics mean difference scheme more accurately represents the exact value. We compare above-mentioned approximation for the second derivative with the standard fourth-order finite difference approximation to determine the improvement in error characteristics. One can see [Citation18] for more details about Fourier analysis.
Let ω be wave number be modified wave number of the difference approximation for second derivative, then the modified wave number for fourth-order compact difference approximation (FDA4) given in (Equation14
(14)
(14) )
(15)
(15) and modified wave number for fourth-order finite difference approximation (CDA4)
(16)
(16) The plot for modified wave number of FDA4 and CDA4 with respect to wave number of the exact differentiation (
) are plotted versus wave number ω in Figure . Error in the approximation of the second derivative is measured by the difference between modified wave number for FDA4 and CDA4 with modified wave number of exact differentiation respectively. It is clear from the plot that resolution ability of CDA4 is better than FDA4 since curve of CDA4 remains close to the exact differentiation over relatively vast range of wave number. Note that we are neglecting the negative sign from the expression of modified wavenumbers for plotting the graph.
3.3. Reconstruction and compression error
For any f defined on the vertices of the graph and a given threshold ε, Equation (Equation12(12)
(12) ) can be written as
, where
is called the compression error and for
there is no compression and in that case it is reconstruction error. The number of the node points required for
is called number of significant coefficients denoted by
.
The two test functions which we are considering are:
Test function 1: with
and
on the interval
.
Test function 2: with c = 1000 and
in the domain
.
For test function 1, we obtain the following results: for , the reconstructed function is of order
. The test function
and reconstructed function
for two different values of ε are given in Figure . The plot for compression error
versus ε is shown in Figure (a). It is clear from the figure that compression error increases with increase in ε. Figure (b) shows the plot of compression error versus
from which we can easily observe that compression error decreases with increase in ε.
For test function 2, we obtain the following results: for , the reconstructed function is of order
. In Figure , test function 2 and corresponding reconstructed function
are plotted for different values of ε. The plot for compression error
versus ε is shown in Figure (a). It is clear from the figure that compression error increases with increase in ε. Figure (b) shows the plot of compression error versus
from which we can easily observe that compression error decreases with increase in ε.
3.4. Adaptive node arrangement
The numerical solution of the BHCP is computed by approximating the solution at a discrete set of node points. To discover all the features of the solution, we need a large set of node points, but this will increase the computational as well as storage cost. In some cases, the set which is required to capture all the features of the solution may exceed the practical limitations. To handle with such problem, we work on an adaptive node arrangement. In adaptive node arrangement, the node will keep on modifying according to how the numerical solution of the PDE evolves with time. Instead of taking a larger set of node points, more points are added only in the areas where the solution of PDE has sharp features.
Node adaptation occurs quite naturally in wavelet methods. One of the important properties of wavelets is that the wavelet coefficients decreases rapidly for smooth functions. Moreover, if a function has a discontinuity in one of its derivatives then the wavelet coefficients will decrease slowly only near the point of discontinuity and maintains fast decay where the function is smooth. This property of wavelets makes it suitable to detect where in the numerical solution of a partial differential equation shocks or regions with large gradients are located and hence an adaptive node arrangement can be generated. In the case of spectral graph wavelet, if
is the set of scales, then
follows the above said fact strictly when j is near J. Hence, we will consider
s (wavelet coefficients at scale
) for node adaptation. The wavelet coefficient
at different value of j for two above considered test functions is shown in Figure (). From the figure, we can see that wavelet coefficients are more localized near non-smooth part of the functions and this localized pattern increases with increase in j.
Figure 10. Wavelet coefficients at different value of j for two different test functions: (a)
for test function 1 and (b)
for sawtooth function with discontinuity at x = 0.5.
![Figure 10. Wavelet coefficients dkj at different value of j for two different test functions: (a) dkj for test function 1 and (b) dkj for sawtooth function with discontinuity at x = 0.5.](/cms/asset/2d4a39c2-fc7a-4be0-b407-ef8eb308c6b3/gipe_a_1797002_f0010_oc.jpg)
To illustrate the algorithm for node adaptation, we consider a function defined on a set of node points
and a pre-defined threshold parameter ε. Perform SGST and SGWT to obtain the set of coefficients
. We will construct
(fine node arrangement) from
(coarse node arrangement). Since each
is associated with a spectral scaling function
, we will keep all the points of
in
. We recall that every spectral wavelet function at the scale
, i.e.
, is uniquely associated with an
. We analyse the wavelet coefficients
. If
, then the corresponding node point
is called an active node point. For each active node point
, an adjacent zone will be added in
. The adjacent zone will serve two purposes:
It will make
finer in the area of sharp features.
In solving evolutionary PDEs, additional criteria for node adaptation should be added. In particular, the computational set of node points should consist of node points associated with wavelets whose coefficients are or can possibly become significant during the period of the time when the set of node points remain unchanged.
For an active node point , we fix two positive numbers R and M called adjacent zone constants. In the region
, we obtain M points simulating on the neighbourhood of
. This will be called the adjacent zone of the point
.
The graphical representation of adaptive grid generation for one and two-dimensional cases is shown in Figures and respectively. For example, as shown in Figure , for an active node point with M = 2, we have added two points in the adjacent zone. The process of spectral graph wavelet based adaptive node arrangement generation is as follows:
= AdaptiveNodeArrangement(f,
)
Choose a threshold parameter ε and positive adjacent zone constants R and M.
m = 0,
,
.
do while m = 0 or
$-$ Perform SGWT on
to get
.
$-$ .
$-$ Analyse wavelet coefficients
and collect all the active node points.
$-$ Corresponding to each active node point, add an adjacent zone in
.
$-$ Interpolate
onto new grid
and call it
.
$-$ m = m + 1.
.
The adaptive node arrangement for two different test functions in one dimension using the algorithm mentioned above is shown in Figure (a,b). In Figure , test function 2 and corresponding adaptive node arrangement are plotted.
4. Wavelet regularization
In order to obtain the stable numerical solution for BHCP, we have to apply an appropriate regularization technique. Filtering technique is one of the regularization techniques for constructing the good approximate solution from a severely ill-posed problem. It is very popular due to its ease of implementation (especially in Fourier domain), effectiveness and possibility of obtaining the good approximate solution for ill-posed PDEs. Filtering can be done either in the spatial domain (spatial filtering) or Fourier domain (Fourier filtering) by filtering short wave modes participate in numerical calculations. In filtering technique, the solution is obtained by completely eliminating or suppressing the spurious errors which present in high frequency component of the data. Some of the filtering techniques for ill-posed problems are discussed in [Citation46]. The key disadvantage of Fourier filtering [Citation15] is that the Fourier bases are only localized in the frequency domain yet having global support in the spatial domain. Therefore, they are not efficient in encoding the local signal information. A popular and powerful solution is to use wavelet bases, which are functions localized in both space and frequency. Thus it can capture local signal information in a more efficient and compact way. In this article, we will use spectral graph wavelet as a regularization technique for filtering of high frequency.
Let represents the approximated value of
at node
for any t>0. By using central difference approximation for second derivative
and denoting
, the difference equation for the one-dimensional backward heat equation (Equation1
(1)
(1) ) is
(17)
(17) with
as a vector and boundary conditions
. On the real line, the eigenvector for the one-dimensional Laplacian operator is the complex exponentials
, thus Fourier and inverse Fourier transform will be
(18)
(18)
(19)
(19) where
. Putting
as scaled wave number, (Equation18
(18)
(18) ) and (Equation19
(19)
(19) ) become
(20)
(20)
(21)
(21) where
is the Fourier mode. If we consider one particular mode ω in (Equation21
(21)
(21) ) and put
in (Equation17
(17)
(17) ) for
, we obtain
(22)
(22) with
(23)
(23) Solving (Equation22
(22)
(22) ), we get
(24)
(24) From (Equation24
(24)
(24) ), we observe that
is nothing but modified wave number
for finite difference approximation.
Finally, the solution for problem (Equation17(17)
(17) ) in spectral domain can be obtained by solving (Equation24
(24)
(24) ) together with (Equation23
(23)
(23) ) which gives
(25)
(25) Similarly, if fourth-order compact difference approximation is used instead of finite difference approximation, (Equation22
(22)
(22) ) can be written as
(26)
(26) where approximation of Laplacian operator is obtained using CDA4 given in (Equation14
(14)
(14) ). Equivalently,
(27)
(27) Moreover, for t = 0, we can easily see from (Equation26
(26)
(26) ) that
(28)
(28) The SGWT and ISGWT for a given function f can be written as
(29)
(29)
(30)
(30) where
. Choose
so that scaled wave number
.
Practically, we can never have completely accurate data Φ since it depends on (physical) observations. Thus the data available to us are measured data , so it is perturbed with noise because of the errors in the measurements and the limitations of the measuring instruments. Using (Equation29
(29)
(29) ) and (Equation30
(30)
(30) ), the spectral graph wavelet solution
with measured data
in spectral domain will be
(31)
(31) or equivalently, the wavelet regularized approximate solution
is
(32)
(32)
Lemma 4.1
The unique solution for the semi discrete problem (Equation17(17)
(17) ) can be obtained if and only if
(33)
(33)
Proof.
As already stated earlier, the exact solution u for the problem Equation17(17)
(17) can be written in the frequency domain as
(34)
(34) with its Fourier coefficients
At t = 0, it becomes
which implies that
(35)
(35) Using the condition (Equation33
(33)
(33) ), we obtain
(36)
(36) Now we define the vector ρ with
as
so that ρ
and
(37)
(37) Now consider the direct semi discrete problem
(38)
(38) with
. The problem (Equation38
(38)
(38) ) is the direct problem which has a unique solution, say
. We can write the solution for (Equation38
(38)
(38) ) as
(39)
(39) Putting t = T in (Equation39
(39)
(39) ) and using (Equation37
(37)
(37) ), we get
This proves that problem (Equation17
(17)
(17) ) has a unique solution.
The localization result for kernels g which have a zero of integer multiplicity at the origin will be given by the following lemma. Such kernels can be approximated by a single monomial for small scales.
Lemma 4.2
Let g be times continuously differentiable, satisfying
for all
and
. Assume that there is some
such that
for all
. Then, for
we have
Proof.
For detail about the proof, one can refer to [Citation39].
Theorem 4.1
Let g be a kernel satisfying the hypothesis of Lemma 4.2, with constant and b. Then for a given exact data
the wavelet regularized solution
as defined by (Equation32
(32)
(32) ) continuously depends on
in
. Furthermore, we have
(40)
(40)
Proof.
Let and
are two solutions of (Equation32
(32)
(32) ) corresponding to the final values Φ and ψ respectively. From (Equation32
(32)
(32) ), we have
(41)
(41)
(42)
(42)
where
Now we choose as
(43)
(43) so that
Now we choose the scales for wavelets as
for
and
, then we get
Hence,
(44)
(44) This completes the proof of the theorem.
Furthermore, using (Equation44(44)
(44) ) and the condition
, we have
(45)
(45)
Error estimate
Next, we will prove the error estimate between the exact solution and wavelet regularized solution for BHCP.
Theorem 4.2
Let be the solution using exact data Φ and
be the wavelet regularized solution using measured data
. Assume that there exists a priori bound
and
. Let g be a kernel satisfying the hypothesis of Lemma (4.2, with constant
and b. If we choose
with
where
denotes the largest integer part of the real number, then we obtain the following error estimate:
(46)
(46)
Proof.
Using Parseval relation and (Equation26(26)
(26) ), (Equation31
(31)
(31) ), (Equation28
(28)
(28) ), we can write
Now we estimate
and
separately. First
(47)
(47) where
Now
Thus
(48)
(48) Now we estimate
. From Theorem (4.1), we get
(49)
(49) Finally, using (Equation48
(48)
(48) ) and (Equation49
(49)
(49) ) we obtain
This completes the proof.
In order to illustrate the effect of wavelet regularization, we considered test function 1. To this test function, some noise δ is manually added to obtain . The noisy function and corresponding filtered data using spectral graph wavelet are shown in Figure
5. Numerical results
Applying the change of variable in problem (Equation1
(1)
(1) ), we retrieve the following formulation of the backward problem with
:
(50)
(50)
Now, we apply the proposed numerical method on two different test problems in order to illustrate the efficiency and accuracy. All the computations are performed on MATLAB (9.0.0.341360 (R2016a)) software, on a 64 bit machine with processor Intel(R) Core(TM) i5-8250U CPU @1.80 GHz and 8 GB RAM. The operating system used is Windows 10 (version-1903).
Test problem 1: For test problem 1, we consider the BHCP given in (Equation50(50)
(50) ) for
, i.e. one-dimensional Laplacian operator with
, boundary condition
and bounded domain
. To obtain
, we first solve the forward heat conduction problem numerically using the initial condition
taken as test function 1. For all numerical examples, the scaling kernel
and wavelet kernel
are choosen according to (Equation8
(8)
(8) ) and (Equation9
(9)
(9) ) respectively.
To obtain noisy initial data for our backward problem, we introduce some random noise η in
, i.e.
where
, rand(x) is the random vector obtained using MATLAB function ‘rand’ and δ is the noise parameter which is chosen according to the problem. For our numerical computation, we are using
. For comparing the numerical and exact solution, we use the following relative error:
where
and
stand for numerical and exact solution at time t for the problem considered.
For our numerical results, we have fixed J = 4 and the value of regularization parameter J, N and corresponding h is chosen as according to (4.2). The initial condition and corresponding adaptive grid are already shown in Figure (a). The regularized numerical solution for this problem and corresponding adaptive node arrangement using spectral graph wavelet method are shown in Figure at different times. It is evident from the figure that the regularized solution becomes stable after wavelet filtering. The localized pattern of the solution is captured accurately and efficiently using the proposed method.
Figure 16. Evolution of the solution and dynamically adapted node arrangement for test problem 1 using : (a)
, (b)
, (c)
, (d)
.
![Figure 16. Evolution of the solution and dynamically adapted node arrangement for test problem 1 using ϵ=10−3,R=0.1,M=6: (a) T=0.1(N(ϵ)=176), (b) T=0.4(N(ϵ)=248), (c) T=0.8(N(ϵ)=301), (d) T=1(N(ϵ)=377).](/cms/asset/d1f2f88c-02b8-4144-8b9b-f2e5ccf23f58/gipe_a_1797002_f0016_oc.jpg)
Figure (a) shows the plot of error between numerical and exact solution with noise δ for test problems 1. For this experiment, we fixed the time at . The plot shows that error of regularized problem is less sensitive to noise. Moreover, it is observed that the growth rate of error suppresses after regularization. For example, at fixed
and
, error
for original problem is
and for wavelet regularized solution is
. The plot in Figure (b) gives the relation of error with time for test problem 1 at fixed value of noise parameter which is
. The figure shows that error increases with time after wavelet regularization but with less growth rate. The graph of error versus
is given in Figure which proves the convergence of the method. To compare our proposed method, we have solved test problem 1 with Fourier regularization method as given by Fu et al. in the paper [Citation15]. We have compared both the results in terms of relative error and CPU time which is given in Table . From the table, it can be observed that the relative error using ASGWM and the method given in [Citation15] are almost comparable. From the CPU time of both the methods, we can see that the proposed method is more efficient.
Figure 17. Plot of (a) error versus noise parameter δ with fixed and (b) error versus time T with fixed
for test problem 1.
![Figure 17. Plot of (a) error versus noise parameter δ with fixed T=10−2 and (b) error versus time T with fixed δ=10−3 for test problem 1.](/cms/asset/6e6a49c9-6722-435a-8d08-468d54e1be56/gipe_a_1797002_f0017_ob.jpg)
Table 1. Comparison of relative error for test problem 1 between Fu et al. [Citation15] and ASGWM.
For efficiency of the proposed method, we have to calculate the efficiency coefficient Θ which is defined as . Here,
is the CPU time taken by the finite difference method at
and
is the CPU time taken by ASGWM. The adaptive algorithm will be more efficient for larger efficiency coefficient. For the test problem 1, the plot of Θ versus ε is shown in Figure (a) and the plot of error versus ε is shown in Figure (b). From Figure (a), we can observe that the method is more efficient for large ε. But for large ε, as we can see from Figure (b) that error also increases as expected. Thus, for good accuracy and efficiency, we have to choose an optimal value of ε.
Test problem 2: For test problem 2, we consider the problem (Equation50(50)
(50) ) for
, i.e. two-dimensional BHCP. For this problem,
in bounded domain
with boundary condition
. We solve the forward heat conduction problem numerically using the initial condition
which is same as test function 2 to obtain
. In Figure , the initial condition for two-dimensional BHCP and corresponding adaptive grid are plotted. The stable regularized numerical solution and corresponding dynamically adaptive node arrangement using spectral graph wavelet method are shown in Figure for different times. It can be easily demonstrated from the figure that proposed method is able to accurately and efficiently capture the emergence of localized pattern.
Figure 20. Evolution of the regularized numerical solution and corresponding dynamically adapted node arrangement for test problem 2 using . (a) Solution for T = 0.1. (b) Adaptive node arrangement (
). (c) Solution for T = 0.2. (d) Adaptive node arrangement (
). (e) Solution for T = 0.4. (f) Adaptive node arrangement (
). (g) Solution for T = 0.8. (h) Adaptive node arrangement (
).
![Figure 20. Evolution of the regularized numerical solution and corresponding dynamically adapted node arrangement for test problem 2 using ϵ=10−3,R=0.1,M=6. (a) Solution for T = 0.1. (b) Adaptive node arrangement (N(ϵ)=1258). (c) Solution for T = 0.2. (d) Adaptive node arrangement (N(ϵ)=2665). (e) Solution for T = 0.4. (f) Adaptive node arrangement (N(ϵ)=4382). (g) Solution for T = 0.8. (h) Adaptive node arrangement (N(ϵ)=4724).](/cms/asset/19509046-99ed-499d-8889-e18d3e4ff1d3/gipe_a_1797002_f0020_oc.jpg)
To see the performance of our proposed method, Table () is given which shows the values of and corresponding Θ for different values of ε for test problem 2,
. Relation between error in numerical and exact solution with noise for test problems 2 is shown in Figure (a) for fixed time
. In Figure (b), plot of error versus time at fixed value of noise parameter
is given for test problem 2. It is observed from numerical experiments and can be easily concluded from both the figures that the growth of error suppresses after regularization.
Table 2. The performance of ASGWM for test problem 2 with regularization.
6. Conclusion and future work
In this paper, we have proposed a new regularization method based on spectral graph wavelet for stable solution of BHCP on graph. Fourth-order compact difference scheme with adaptive node technique is used to increase the efficiency of the proposed method. Fourier analysis shows that the fourth-order compact difference approximation has better resolution ability as compared to the standard fourth-order finite difference approximation. We have also provided the error estimate between the exact and wavelet regularized solution for BHCP. The efficiency and the convergence of the method is verified. To the best of our knowledge, till now, no one has proposed any regularization method to solved inverse problems on graph like structure. We want to point out here that the useful properties of spectral graph wavelet are for the first time exploited here for the solution of BHCP on graph.
In future, we will use spectral graph wavelet for the regularization of BHCP on a general/complex graph as well as for predicting shock waves. We will also try to extend the proposed method to solve some non-linear inverse problems. It will also be a good future research topic to solve some other complex inverse problems arises from real-life applications using this method.
Acknowledgments
The authors like to thanks the anonymous reviewers whose comments/suggestions helped improve and clarify this manuscript. The second author acknowledges the support provided by the Department of Science and Technology, India, under the grant number SERB/F/11946/2018-2019.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Additional information
Funding
References
- Isakov V. Inverse problems for partial differential equations. New York: Springer; 2006.
- Yin HM, Rundell W. A parabolic inverse problem with an unknown boundary condition. J Differ Equ. 1990;86:234–242. doi: 10.1016/0022-0396(90)90031-J
- Dehghan M. Determination of an unknown parameter in a semi-linear parabolic equation. Math Probl Eng. 2002;8:111–122. doi: 10.1080/10241230212906
- Mera NS, Elliott L, Ingham DB, et al. An iterative boundary element method for solving the one-dimensional backward heat conduction problem. Int J Heat Mass Transf. 2001;44:1937–1946. doi: 10.1016/S0017-9310(00)00235-0
- Liu CS. Group preserving scheme for backward heat conduction problems. Int J Heat Mass Transf. 2004;47:2567–2576. doi: 10.1016/j.ijheatmasstransfer.2003.12.019
- Beck JV, Blackwell B. Inverse heat conduction, Ill-posed problems. New York: Wiley Interscience; 1985.
- Engl HW, Hanke M, Neubauer A. Regularizaton of inverse problems. Dordrecht: Kluwer Academics; 1996.
- Hào DN. A mollification method for ill-posed problems. Numer Math. 1994;68:469–506. doi: 10.1007/s002110050073
- Han H, Ingham DB, Yuan Y. The boundary element method for the solution of the backward heat conduction equation. J Eng Des. 1994;516:292–299.
- Seidman TI. Optimal filtering for the backward heat equation. SIAM J Numer Anal. 1996;33:162–170. doi: 10.1137/0733010
- Lattès R, Lions JL. The method of quasi-reversibility. Applications to partial differential equations. Vol. 18. New York: American Elsevier Publishing Co., Inc.; 1969.
- Ames KA, Epperson JF. A kernel-based method for the approximate solution of backward parabolic problems. SIAM J Numer Anal. 1997;34:1357–1390. doi: 10.1137/S0036142994276785
- Kirkup SM, Wadsworth M. Solution of inverse diffusion problems by operator-splitting methods. Appl Math Model. 2002;26:1003–1018. doi: 10.1016/S0307-904X(02)00053-7
- Mera NS. The method of fundamental solutions for the backward heat conduction problem. Inverse Probl Sci Eng. 2005;13:65–78. doi: 10.1080/10682760410001710141
- Fu CL, Xiong XT, Qian Z. Fourier regularization for a backward heat equation. J Math Anal Appl. 2007;331:472–480. doi: 10.1016/j.jmaa.2006.08.040
- Xiong XT, Fu CL, Qian Z. Two numerical methods for solving a backward heat conduction problem. Appl Math Comput. 2006;179:370–377.
- Beck JV. Nonlinear estimation applied to the nonlinear inverse heat conduction problem. Int J Heat Mass Transf. 1970;13:703–716. doi: 10.1016/0017-9310(70)90044-X
- Lele SK. Compact finite difference schemes with spectral-like resolution. J Comput Phys. 1992;103:16–42. doi: 10.1016/0021-9991(92)90324-R
- Li J, Visbal MR. High order compact schemes for nonlinear dispersive waves. J Sci Comput. 2006;26:1–23. doi: 10.1007/s10915-004-4797-1
- Shukla RK, Tatineni M, Zhong X. Very high-order compact finite difference schemes on non-uniform grids for incompressible Navier–Stokes equations. J Comput Phys. 2007;224:1064–1094. doi: 10.1016/j.jcp.2006.11.007
- Patel KS, Mehra M. High order compact finite difference scheme for pricing asian option with moving boundary condition. Differ Equ Dyn Syst. 2017;27:39–56. doi: 10.1007/s12591-017-0372-8
- Kumar V. High-order compact finite-difference scheme for singularly-perturbed reaction-diffusion problems on a new mesh of Shishkin type. J Optim Theory Appl. 2009;143:123–147. doi: 10.1007/s10957-009-9547-y
- Pandit SK, Kalita JC, Dalal DC. A transient higher order compact scheme for incompressible viscous flows on geometries beyond rectangular equation on non-uniform grids. J Comput Phys. 2007;225:1100–1124. doi: 10.1016/j.jcp.2007.01.016
- Ahmed MO. An exploration of compact finite difference methods for the numerical solution of PDE [PhD dissertation]. Western Ontario London University; 1997.
- Mehra M. Wavelets theory and its applications. Singapore: Springer; 2018.
- Pourgholi R, Tavallaie N, Foadian S. Applications of Haar basis method for solving some ill-posed inverse problems. J Math Chem. 2012;50:2317–2337. doi: 10.1007/s10910-012-0036-4
- Lepik Ü. Numerical solution of evolution equations by the Haar wavelet method. Appl Math Comput. 2007;185:695–704.
- Razzaghi M. Legendre wavelets method for the solution of nonlinear problems in the calculus of variations. Math Comput Model. 2001;34:45–54. doi: 10.1016/S0895-7177(01)00048-6
- Babolian E, Fattahzadeh F. Numerical solution of differential equations by using Chebyshev wavelet operational matrix of integration. Appl Math Comput. 2007;188:417–426.
- Oruç Ö. A computational method based on Hermite wavelets for two-dimensional Sobolev and regularized long wave equations in fluids. Numer Methods Partial Differ Equ. 2018;34:1693–1715. doi: 10.1002/num.22232
- Adibi H, Assari P. Using CAS wavelets for numerical solution of Volterra integral equations of the second kind. Dyn Continuous Discrete Impulsive Syst Ser A. 2009;16:673–685.
- Adibi H, Assari P. Chebyshev wavelet method for numerical solution of Fredholm integral equations of the first kind. Math Prob Eng. 2010;2010:1–17. doi: 10.1155/2010/138408
- Adibi H, Assari P. On the numerical solution of weakly singular Fredholm integral equations of the second kind using Legendre wavelets. J Vib Control. 2011;17:689–698. doi: 10.1177/1077546310366865
- Assari P, Dehghan M. Application of dual-Chebyshev wavelets for the numerical solution of boundary integral equations with logarithmic singular kernels. Eng Comput. 2019;35:175–190. doi: 10.1007/s00366-018-0591-9
- Eldén L, Berntsson F, Regińska T. Wavelet and Fourier methods for solving the sideways heat equation. SIAM J Sci Comput. 2000;21:2187–2205. doi: 10.1137/S1064827597331394
- Qiu CY, Fu CL. Wavelets and regularization of the Cauchy problem for the Laplace equation. J Math Anal Appl. 2008;338:1440–1447. doi: 10.1016/j.jmaa.2007.06.035
- Regińska T, Wakulicz A. Wavelet moment method for the Cauchy problem for the Helmholtz equation. J Comput Appl Math. 2009;223:218–229. doi: 10.1016/j.cam.2008.01.005
- Wang JR. Shannon wavelet regularization methods for a backward heat equation. J Comput Appl Math. 2011;235:3079–3085. doi: 10.1016/j.cam.2011.01.001
- Hammond DK, Vandergheynst P, Gribonval R. Wavelets on graphs via spectral graph theory. Appl Comput Harmon Anal. 2011;30:129–150. doi: 10.1016/j.acha.2010.04.005
- Zhang L, Ouyang J, Wang X, et al. Variational multiscale element-free Galerkin's method for 2D Burger's equation. J Comput Phys. 2010;229:7147–7161. doi: 10.1016/j.jcp.2010.06.004
- Jameson L. A wavelet-optimized, very high order adaptive grid and order numerical method. SIAM J Sci Comput. 1998;19:1980–2013. doi: 10.1137/S1064827596301534
- Goyal K, Mehra M. A fast adaptive diffusion wavelet method for Burgers equations. Comput Math Appl. 2014;4:568–577. doi: 10.1016/j.camwa.2014.06.007
- Goyal K, Mehra M. An adaptive meshfree spectral graph wavelet method for partial differential equations. Appl Numer Math. 2017;113:168–185. doi: 10.1016/j.apnum.2016.11.011
- Shukla A, Mehra M, Leugering G. A fast adaptive spectral graph wavelet method for the viscous Burgers'equation on a star-shaped connected graph. Math Method Appl Sci. 2019: 1–20. doi: 10.1002/mma.5907
- Mehra M, Patel KS. Algorithm 986: a suite of compact finite difference schemes. ACM Trans Math Softw. 2017;44:1–31. doi: 10.1145/3119905
- Daripa P. Some useful filtering techniques for illposed problems. J Comput Appl Math. 1998;2:161–171. doi: 10.1016/S0377-0427(98)00186-1