![MathJax Logo](/templates/jsp/_style2/_tandf/pb2/images/math-jax.gif)
ABSTRACT
Based on the idea of Fourier extension, we develop a new method for numerical differentiation of two-dimensional functions on an arbitrary domain. The function will be extended to a periodic function on a larger domain. The Tikhonov regularization method in Hilbert scales is presented to deal with the ill-posedness of the problem. The Sobolev norm defined on the larger domain will be used as a stabilizer. An error analysis is provided with a regularization parameter chosen by a discrepancy principle. Numerical experiments are also presented to illustrate the effectiveness of the proposed method.
2010 MATHEMATICS SUBJECT CLASSIFICATION:
1. Introduction
Numerical differentiation is an interesting topic in the field of numerical analysis. This arises in a lot of mathematical models and engineering problems [Citation1–6]. The main difficulty of numerical differentiation is that it is ill-posed, i.e. the small errors in the input data may lead to huge errors in its approximated derivatives. In the past years, a wide range of computational methods have been reported to treat the numerical differentiation problem [Citation7–20]. According to the types of regularization techniques, these methods can be classified into difference methods, mollification methods, truncation methods and Tikhonov methods. Most of these papers focused on a one-dimensional case, but only a few results on the high dimensional cases have been reported [Citation12,Citation21–24]. In particular, based on radial basis functions approximation [Citation15], the authors used a semi-norm in the global space as the regularization functional on a finite interval. By solving numerically a smoothing functional, a regularization solution based on Green's function was constructed [Citation12]. Wei et al.[Citation21] gave a regularization algorithm for reconstruction of numerical derivatives from two-dimensional scattered noisy data based on the thin plate spline approximation theory.
In [Citation23], a truncated Fourier series method was proposed for the numerical differentiation of 2D periodic functions. This method is effective for calculating arbitrary derivatives of periodic functions. However, the situation changes completely when the function is non-periodic. The reason lies in the well-known Gibbs phenomenon, and rapid convergence of Fourier series is available only for periodic functions. Recently, Fourier extension method has attracted more and more attentions of the researchers [Citation25–30]. It has been proved successfully to ameliorate the Gibbs phenomenon. If a function , the idea of the Fourier extension is to extend the function f to the function g that is periodic on a rectangular domain
.
For numerical differentiation, our aim is to obtain approximation derivatives of f from its perturbed data satisfying
(1)
(1) where
is a given constant called the error level. In this paper, we construct an approximation function f by using the Fourier extension method. Considering the features of numerical differentiation problems, we present a modified Tikhonov regularization method to obtain a stable Fourier extension. The Sobolev norm defined on a larger domain will be used as a stabilizer, and an error analysis is provided when we choose the regularization parameter by a discrepancy principle.
The structure of the paper is as follows. In Section 2, we present the mathematical formulation of the Fourier extension by using the Tikhonov method. The choice of the regularization parameter and corresponding convergence results are shown in Section 3. Section 4 provides a variety of numerical results to demonstrate the effectiveness of our method.
2. Formulation of problem and solution
We first introduce some notations. Let and
be a subdomain of
. Let
,
and
be integers. Set
and
. Next, let
be the set of all non-negative integers. For any two-tuples
,
. The notation
stands for
and
. For any positive integer q, we define
and
(2)
(2)
denotes the norm in Sobolev space
and we defined
as
(3)
(3) where s = 0 and
denotes the
norm. Let
be the subspace of
containing all functions with period
for all variables.
Fourier transformation of a function is
(4)
(4) with the Fourier coefficients
(5)
(5) Accordingly, for any vector
, we define the operator
(6)
(6) and
(7)
(7) Suppose that we know the perturbed data
of
satisfying
(8)
(8) where
is a given error level; our aim is to obtain approximation derivatives of f from
.
By using the Tikhonov regularization method, we treat this problem as follows: define a cost functional
(9)
(9) where β is a regularization parameter and q is a positive integer. If we let
(10)
(10) then we can verify that
(11)
(11) So cost functional (Equation9
(9)
(9) ) can be converted to
(12)
(12) Now if
is the minimizer of the functional Φ, then
(13)
(13) will be chosen as the approximate function of f. It is well known that
can be obtained by solving the following equation [Citation31]
(14)
(14)
Remark
is a diagonal matrix. The method can be easily implemented because of the Fourier transformation's differential properties.
Moreover, if we let and
, then
(15)
(15) and the following lemma holds.
Remark 2.1
It is well known that the function has the following properties.
Lemma 2.2
[Citation32]
(16)
(16) and
(17)
(17)
By using the extension theorem in Sobolev spaces [Citation33] and cut-off functions in [Citation34,Citation35], we can give the following lemma.
Lemma 2.3
For any there exists a function
such that
(18)
(18) with some constant E.
Lemma 2.4
Suppose that and
is defined above, and the vector
contains all the Fourier coefficients of
if we let
then for
(19)
(19)
Proof.
(20)
(20)
and
(21)
(21)
The assertion of the lemma follows from (Equation11
(11)
(11) ), (Equation18
(18)
(18) ), (Equation20
(20)
(20) ) and (Equation21
(21)
(21) ).
The following interpolation inequality is needed for our theoretical analysis.
Lemma 2.5
[Citation33]
Let Ω be a domain in satisfying the cone condition. There exists a constant K depending on
and j, s such that for any
and
(22)
(22)
3. The choice of regularization parameter β and convergence results
Morozov's discrepancy principle will be used to choose the regularization parameter β: for a given constant , choose β as the solution of the nonlinear scalar equation
(23)
(23) Then, we can get the following error estimate.
Theorem 3.1
Suppose that is defined by (Equation13
(13)
(13) ) and (Equation23
(23)
(23) ) and
then for any
we have
(24)
(24)
Proof.
Let be some a certain Fourier extension of f which satisfies (Equation18
(18)
(18) ) and β be chosen by (Equation23
(23)
(23) ). We set
(25)
(25) If we let
, it can be deduced that
(26)
(26) By using the triangle inequality, (Equation11
(11)
(11) ), (Equation19
(19)
(19) ), (Equation23
(23)
(23) ) and (Equation25
(25)
(25) )
(27)
(27)
Moreover, in terms of the triangle inequality, (Equation19
(19)
(19) ) and Lemma 2.2, we have
(28)
(28)
Moreover, let
. We use the representation
and obtain from (Equation11
(11)
(11) ), (Equation19
(19)
(19) ) and Lemma 2.2
(29)
(29) then we have
(30)
(30) From (Equation25
(25)
(25) ), (Equation27
(27)
(27) ), (Equation28
(28)
(28) ) and (Equation30
(30)
(30) ), we can obtain
(31)
(31)
(32)
(32) Noting that
(33)
(33) and by using Lemma 2.5 with
, we can deduce that there exists a constant
such that
(34)
(34) Therefore,
(35)
(35) Moreover,
(36)
(36)
Remark 3.2
The number ‘’ is only needed in the proof. We don't need to compute it in the real example.
Remark 3.3
Actually, by the theoretical process in [Citation32], the theorem conclusions are only needed to be always true for . The specific deduction can be referred to [Citation32].
Remark 3.4
The main conclusion can be easily extended to n-dimensional space.
4. Numerical tests
To verify the effectiveness of the proposed method, we present several tests under various cases. All the examples are computed on Windows 7 system with Memory 8 GB, CPU Intel(R) Core(7m) is 3470 cpu@320 GHz by MATLAB 2017b. We take the perturbed data which is given by
(37)
(37) where
is a Matlab function.
To estimate the computational error of an approximate solution, we compute the relative error by the following formula:
(38)
(38)
Example 4.1
Take a smooth function and Equation (Equation14
(14)
(14) ) is discretized by the collocation method. We take
as the unknown function to compute the numerical differentiation of its first- and second-order derivatives. The nodes
are given as follows:
case 1:
and the nodes are equidistant (Figure (a)).
case 2:
and the nodes are random scatter (Figure (b)).
case 3:
is a polygon with vertices at
,
,
,
,
,
and the nodes are random scatter (Figure (c)).
case 4:
is a rectangular ring, and the nodes are random scatter (Figure (d)).
Firstly, we observe that the impact of parameter q. The relative errors of Case 1 for various q are given in Table . The results show that the errors become smaller with the increase of q and the improvement becomes less obvious when q is lager than 32. So we test other cases with q = 32.
Table 1. The numerical results of Case 1 for Example 4.1.
The relative errors of Cases 2–4 are given in Table . Comparing the data of columns 2–3 in Table with the ones of column 4 and column 10 in Table , we can see that the results of random scatter nodes are worse than the equidistant nodes. And from Table , we can see that the method works well for all cases.
Table 2. The numerical results of Case 2-4 with q = 32 for Example 4.1.
The numbers in columns 7 and 13 in Table , and columns 4, 5, 8, 9, 12, 13 in Table show that the ratios are stable when . Moreover, fit the numbers in the above columns to
(39)
(39) (Find k and
, which can be determined by the data linearization method [Citation36], so that
is the least-squares power curve.) We can get
for case 1,
for case 2,
for case 3,
for case 4 with q = 32.
From the above results, it can be seen that this method is suitable for several different node and region cases. We can also see that in case 2 are worse than the other cases. The results may be caused by the discretization errors.
Now we present the results of two examples from [Citation12,Citation37]. The numerical processing of this method is simpler.
Example 4.2
[Citation12]
Choose the exact function . Equation (Equation14
(14)
(14) ) is discretized by the collocation method, and the nodes
are given as
and are equidistant. We also create noisy data by adding some random errors to the exact values in manner of (Equation37
(37)
(37) ). The error is controlled by
and the numerical results are shown in Table and Figures (a–c) and (a–c). We take
in Figures and .
Figure 2. The first-order derivative of in Example 4.2 with q = 32 and
. (a) The exact function of
, (b) the constructed function of
, and (c) the constructed error function of
.
![Figure 2. The first-order derivative of f(x,y) in Example 4.2 with q = 32 and δ1=10−3. (a) The exact function of fx+fy, (b) the constructed function of fx+fy, and (c) the constructed error function of fx+fy.](/cms/asset/b2a0a99c-a24b-4309-97d8-cd5c4a52a80e/gipe_a_1661410_f0002_oc.jpg)
Figure 3. The second-order derivative of in Example 4.2 with q = 32 and
. (a) The exact function of
, (b) the constructed function of
, and (c) the constructed error function of
.
![Figure 3. The second-order derivative of f(x,y) in Example 4.2 with q = 32 and δ1=10−3. (a) The exact function of fxx+fxy+fyy, (b) the constructed function of fxx+fxy+fyy, and (c) the constructed error function of fxx+fxy+fyy.](/cms/asset/ee8a9065-edfe-4971-b22d-dc47b0dec6a9/gipe_a_1661410_f0003_oc.jpg)
Table 3. The numerical results of Example 4.2.
Substitute the numbers in columns 7 and 13 in Table into the right-hand side of the (Equation39(39)
(39) ), we can obtain
with q = 32 for Example 4.2.
From the figures, we can see that the numerical results is quite good.
Example 4.3
[Citation37]
Let where
and the nodes are equidistant. Numerical results are shown in Table and Figures (a–c) and (a–c). We take
in Figures and . And we give the cpu time denoted by T in Table when q = 32 for
and
.
Figure 4. The first-order derivative of in Example 4.3 with q = 32 and
. (a) The exact function of
, (b) the constructed function of
, and (c) the constructed error function of
.
![Figure 4. The first-order derivative of f(x,y) in Example 4.3 with q = 32 and δ1=10−3. (a) The exact function of fx+fy, (b) the constructed function of fx+fy, and (c) the constructed error function of fx+fy.](/cms/asset/826ad3c1-625a-48bc-8db5-af7d654ba294/gipe_a_1661410_f0004_oc.jpg)
Figure 5. The second-order derivative of in Example 4.3 with q = 32 and
. (a) The exact function of
, (b) the constructed function of
, and (c) the constructed error function of
.
![Figure 5. The second-order derivative of f(x,y) in Example 4.3 with q = 32 and δ1=10−3. (a) The exact function of fxx+fxy+fyy, (b) the constructed function of fxx+fxy+fyy, and (c) the constructed error function of fxx+fxy+fyy.](/cms/asset/c43ac8c3-6ab3-4cc3-aebf-7f138dccfb96/gipe_a_1661410_f0005_oc.jpg)
Table 4. The numerical results of Example 4.3
Substitute the numbers in columns 7 and 13 in Table into the right-hand side of the (Equation39(39)
(39) ), we can get that
with q = 32 for Example 4.3.
Compared with the results in [Citation12,Citation37], the performance of the method in this paper is satisfactory.
All the above examples are for infinitesimal differentiable functions. Now we give a less smooth function to test the validity of the method.
Example 4.4
Let
(40)
(40)
, where
and the nodes are equidistant. We take
as the unknown function to compute the numerical differentiation of its first-order derivatives. Numerical results are shown in Table and Figure (a–c). We take
in Figure for
.
Figure 6. The first-order derivative of in Example 4.4 with q = 32 and
. (a) The exact function of
, (b) the constructed function of
, and (c) the constructed error function of
.
![Figure 6. The first-order derivative of f(x,y) in Example 4.4 with q = 32 and δ1=10−3. (a) The exact function of fx+fy, (b) the constructed function of fx+fy, and (c) the constructed error function of fx+fy.](/cms/asset/c7249868-f8b3-469b-8375-0b26ddf41030/gipe_a_1661410_f0006_oc.jpg)
Table 5. The numerical results of Example 4.4.
Substitute the numbers in columns 7 and 13 in Table into the right-hand side of the (Equation39(39)
(39) ), we can obtain
with
q = 32 for Example 4.4.
The reconstructed function are very similar to those of corresponding function. In general, we can see that our construction is effective. The above numerical results show that the proposed method is effective and promising for numerically computing the first- and second-order derivatives of functions with two variables from the noisy data.
5. Conclusions
A method based on Fourier extension has been proposed to obtain derivatives of two-dimensional functions. We have proved that the numerical method is stable. Numerical results for tests show that the method can work for any domain and the function with non-smooth derivatives. The method will be expected to deal with other ill-posed problem, which will be discussed in a future paper.
Disclosure statement
No potential conflict of interest was reported by the authors.
Additional information
Funding
References
- Deans SR. The radon transform and some of its applications. New York: A Wiley-Interscience Publication; 1983.
- Egger H, Engl HW. Tikhonov regularization applied to the inverse problem of option pricing: convergence analysis and rates. Inverse Probl. 2005;21(3):1027–1045.
- Gorenflo R, Vessella S. Abel integral equations, analysis and applications. Berlin: Springer-Verlag; 1991. (Lecture Notes in Mathematics; vol. 1461).
- Hanke M, Scherzer O. Error analysis of an equation error method for the identification of the diffusion coefficient in a quasi-linear parabolic differential equation. SIAM J Appl Math. 1998;59(3):1012–1027.
- Wan XQ, Wang YB, Yamamoto M. Detection of irregular points by regularization in numerical differentiation and application to edge detection. Inverse Probl. 2006;22(3):1089–1103.
- Yin BB, Ye YZ. Recovering the local volatility in Black–Scholes model by numerical differentiation. Appl Anal. 2006;85(6–7):681–692.
- Cullum J. Numerical differentiation and regularization. SIAM J Numer Anal. 1971;8(2):254–265.
- Fu CL, Feng XL, Qian Z. Wavelets and high order numerical differentiation. Appl Math Model. 2010;34(10):3008–3021.
- Hanke M, Scherzer O. Inverse problems light: numerical differentiation. Am Math Mon. 2001;108:512–521.
- Hu B, Lu S. Numerical differentiation by a Tikhonov regularization method based on the discrete cosine transform. Appl Anal. 2012;91(4):719–736.
- Ramm A, Smirnova A. On stable numerical differentiation. Math Comput. 2001;70(235):1131–1153.
- Wang YB, Wei T. Numerical differentiation for two-dimensional scattered data. J Math Anal Appl. 2005;312(1):121–137.
- Wang YB, Jia XZ, Cheng J. A numerical differentiation method and its application to reconstruction of discontinuity. Inverse Probl. 2002;18(6):1461–1476.
- Wang ZW, Wen RS. Numerical differentiation for high orders by an integration method. J Comput Appl Math. 2010;234(3):941–948.
- Wei T, Hon YC. Numerical differentiation by radial basis functions approximation. Adv Comput Math. 2007;27(3):247–272.
- Xu HL, Liu JJ. Stable numerical differentiation for the second order derivatives. Adv Comput Math. 2010;33(4):431–447.
- Yang L. A perturbation method for numerical differentiation. Appl Math Comput. 2008;199(1):368–374.
- Zhao ZY. A truncated Legendre spectral method for solving numerical differentiation. Int J Comput Math. 2010;87(14):3209–3217.
- Zhao ZY, Meng ZH. Numerical differentiation for periodic functions. Inverse Probl Sci Eng. 2010;18(7):957–969.
- Zhao ZY, Meng ZH, He GQ. A new approach to numerical differentiation. J Comput Appl Math. 2009;232(2):227–239.
- Wei T, Hon YC, Wang YB. Reconstruction of numerical derivatives from scattered noisy data. Inverse Probl. 2005;21(2):657–672.
- Xie O, Zhao ZY. Numerical differentiation of 2d functions by a mollification method based on Legendre expansion. Int J Comput Sci. 2013;10(1):729–734.
- Zhao ZY, Meng ZH, Xu L, et al. A new mollification method for numerical differentiation of 2d periodic functions. International Joint Conference on Computational Sciences and Optimization, Cso 2009; April 24–26; Sanya, Hainan, China; 2009. p. 205–207.
- Ling L. Finding numerical derivatives for unstructured and noisy data by multiscale kernels. SIAM J Numer Anal. 2006;44(4):1780–1800.
- Adcock B, Huybrechs D, Martín-Vaquero J. On the numerical stability of Fourier extensions. Found Comput Math. 2014;14(4):635–687.
- Boyd JP. A comparison of numerical algorithms for Fourier extension of the first, second, and third kinds. J Comput Phys. 2002;178(1):118–160.
- Huybrechs D. On the Fourier extension of nonperiodic functions. SIAM J Numer Anal. 2010;47(6):4326–4355.
- Lyon M, Picard J. The Fourier approximation of smooth but non-periodic functions from unevenly spaced data. Adv Comput Math. 2014;40(5–6):1073–1092.
- Lyon M. A fast algorithm for Fourier continuation. SIAM J Sci Comput. 2011;33(6):3241–3260.
- Lyon M. Approximation error in regularized svd-based Fourier continuations. Appl Numer Math. 2012;62(12):1790–1803.
- Engl HW, Hanke M, Neubauer A. Regularization of inverse problems. Vol. 375. Dordrecht: Kluwer Academic Publishers; 2000.
- Nair MT, Pereverzev SV, Tautenhahn U. Regularization in Hilbert scales under general smoothing conditions. Inverse Probl. 2005;21(6):1851–1869.
- Adams RA. Sobolev spaces. New York (NY): Academic Press; 1975.
- Boyd JP. Fourier embedded domain methods: extending a function defined on an irregular region to a rectangle so that the extension is spatially periodic and C∞. Appl Math Comput. 2005;161(2):591–597.
- Boyd JP. Asymptotic Fourier coefficients for a C∞ bell (smoothed-top-hat) & the Fourier extension problem. J Sci Comput. 2006;29(1):1–24.
- Mathews JH, Fink KD. Numerical methods using MATLAB. 4th ed. Englewood Cliffs (NJ): Prentice-Hall; 2004.
- Nakamura G, Wang SZ, Wang YB. Numerical differentiation for the second order derivatives of functions of two variables. J Comput Appl Math. 2008;212(2):341–358.