Research Article | Open Access
Hector Vazquez-Leal, Roberto Castaneda-Sheissa, Uriel Filobello-Nino, Arturo Sarmiento-Reyes, Jesus Sanchez Orea, "High Accurate Simple Approximation of Normal Distribution Integral", Mathematical Problems in Engineering, vol. 2012, Article ID 124029, 22 pages, 2012. https://doi.org/10.1155/2012/124029
High Accurate Simple Approximation of Normal Distribution Integral
The integral of the standard normal distribution function is an integral without solution and represents the probability that an aleatory variable normally distributed has values between zero and . The normal distribution integral is used in several areas of science. Thus, this work provides an approximate solution to the Gaussian distribution integral by using the homotopy perturbation method (HPM). After solving the Gaussian integral by HPM, the result served as base to solve other integrals like error function and the cumulative distribution function. The error function is compared against other reported approximations showing advantages like less relative error or less mathematical complexity. Besides, some integrals related to the normal (Gaussian) distribution integral were solved showing a relative error quite small. Also, the utility for the proposed approximations is verified applying them to a couple of heat flow examples. Last, a brief discussion is presented about the way an electronic circuit could be created to implement the approximate error function.
Normal distribution is considered as one of the most important distribution functions in statistics because it is simple to handle analytically, that is, it is possible to solve a large number of problems explicitly; the normal distribution is the result of the central limit theorem. The central limit theorem states that in a series of repeated observations, the precision of the approximation improves as the number of observations increases . Besides, the bell shape of the normal distribution helps to model, in a practical way, a variety of random variables. The normal (or gaussian) distribution integral has a wide use on several science branches like: heat flow, statistics, signal processing, image processing, quantum mechanics, optics, social sciences, financial mathematics, hydrology, and biology, among others. Normal distribution integral has no analytical solution. Nevertheless, there are several methods  which provide an approximation of the integral by numerical methods: Taylor series, asymptotic series, continual fractions, and some other more. Numerical integration is expensive in computation time and it is only good for numerical simulations; in several cases the power series require many terms to obtain an accurate approximation; this fact makes them a numerical tool exclusive for computational calculations, which are not adequate for quick calculations done by hand.
The Homotopy Perturbation Method [3–10] was proposed by He, it was introduced like a powerful tool to approach various kinds of nonlinear problems. As is well known, nonlinear phenomena appear in a wide variety of scientific fields, such as applied mathematics, physics, and engineering. Scientists in these disciplines are constantly faced with the task of finding solutions of linear and nonlinear ordinary differential equations, partial differential equations, and systems of nonlinear ordinary differential equations. In fact, there are several methods employed to find approximate solutions to nonlinear problems such as variational approaches [11–16], Tanh method , exp-function , Adomian’s decomposition method [19, 20], and parameter expansion . Nevertheless, the HPM method is powerful, is relatively simple to use, and has been successfully tested in a wide range of applications [15, 22–29]. The homotopy perturbation method can be considered as combination of the classical perturbation technique and the homotopy (whose origin is in the topology), but has eliminated the limitations of the traditional perturbation methods . The HPM method does not need a small parameter or linearization, in fact it only requires few iterations for getting highly accurate solutions. Besides, the HPM method has been used successfully for solving integral equations, for instance, the case of the Volterra integral equations . The method requires an initial approximation, which should contain as much information as possible about the nature of the solution. That often can be achieved through an empirical knowledge of the solution. Therefore, we propose the use of the homotopy perturbation method to calculate an approximate analytical solution of the normal distribution integral.
In this work the HPM method is applied to a problem having initial conditions. Nevertheless, it is also possible to apply it to the case where the problem has boundary conditions; here, the differential equation solutions are subject to satisfy a condition for different values of the independent variable (two for the case of a second order equation) .
This paper is organized as follows. In Section 2, we solve the normal distribution integral (NDI) by HPM method. In Section 3, we use the approximated solution of NDI to establish an approximate version of error function, and the result is compared to other analytic approximations reported in the literature. In Section 4, a series of normal distribution related integrals are solved. In Section 6, two application problems for the error function are solved. In Section 7, we summarize our findings and suggest possible directions for future investigations. Finally, a brief conclusion is given in Section 8.
2. Solution of the Gaussian Distribution Integral
This section deals with the solution of the Gaussian distribution integral; it is represented as follows:
This integral can be reformulated as a differential equation
To apply the homotopy perturbation method, the next equation is created where is the homotopy parameter. The solution for (2.2) is similar, qualitatively, to a hyperbolic tangent because when tends to , the derivative tends to zero, hence by symmetry, tends to the same constant (absolute value) on both directions. Therefore, it is desirable that the first approach of the HPM method contains a hyperbolic term. In consequence, a differential equation is established () that may be solved using hyperbolic tangent, which is given by
Also, the initial approximation for homotopy would be where , , , and are adjustment parameters.
Now, by the HPM it is assumed that (2.3) has the following form:
Adjusting , the approximate solution is obtained
Substituting (2.6) into (2.3) and equating terms with powers equals to , it can be solved for , , , and so on. In order to fulfill the initial condition from (2.2) (), it follows that , , and so on. Thus, the result is where , , , and ; these parameters are adjusted (using the NonlinearFit command from Maple Release 15) to obtain a good approximation; this adjustment allows to ignore successive terms. (Given a total of -samples from the exact model, the NonlinearFit command finds values of the approximate model parameters such that the sum of the squared -residuals is minimized.) Therefore, the proposed approximation for (2.1) is
Also, it is known that solution for (2.1) may be expressed in terms of the error function where the error function is defined by
In Figure 1 it can be seen that the maximum relative error is negligible for many practical applications in fields like engineering and applied sciences. In fact, the precision of this approximation allows to derive (2.9) with respect to and graphically compare it to the exact function , as shown in Figure 2(a), reaching an acceptable relative error (see Figure 2(b)) in the range of . Therefore,
From this approximation it is possible to generate normal distribution functions like the error function or the cumulative distribution function.
3. Error Function
(1) In  it was presented the following approximation
Due to the fact that (3.3) is only useful for values , it is considered a disadvantage because it limits variation over axis.
(2) In , it was reported an approximation related to the function error, which is expressed as
The approximation for (3.4) is where
In order to compare our work with (3.5), consider
Replacing for , it is obtained that
for solving ,
(3) In  was reported an approximation of the normal distribution integral, which is transformed into an error function
Figure 3(a) shows the exact error function contrasted to (3.1), (3.2), (3.3), (3.10), and (3.11), finding a high level of accuracy for all five approximations. Besides, Figure 3(b) shows the relative error for the five approximations, where (3.10) has the lowest relative error followed by (3.1) and (3.2), while (3.11) has the highest relative error.
4. Cumulative Distribution Function
The cumulative distribution function  is defined as where is the standard normal probability density function defined as follows:
Then, the process applied to (3.1) is repeated to convert coefficients of (4.3) into fractions. The result is an approximate version of (4.3) now in fractions, which is given bywhere, converting the result into exponential terms and performing simplification, the expression becomes
5. Table for Normal Distribution Function-Related Integrals
In  are shown a series of integrals without exact solution, these involve the use of the cumulative distribution function (4.1), and the standard normal probability density function (4.2). The cumulative distribution function is replaced for its approximate version (4.5) to generate the integrals in Table 1.
For illustrative purposes, we have chosen values for , , , , , and to be able to calculate the relative error between the exact and approximate solutions. Thus, to obtain a new solution, it can be done assigning a new value to the desired constant, or constants, and perform the required calculations. In this case, the approximate version with coefficients expressed as fractions (4.5) for the cumulative distribution function (4.1) was employed in order to make simple manual calculations easier. Nevertheless, it is also possible to use approximation (4.3).
6. Application Cases
As an example to apply the error function, two cases are considered for the unidimensional heat flow equation.
6.1. Example 1
Consider the case for a thin semi-infinite bar () whose surface is isolated (see Figure 5); it has a constant initial temperature . Suddenly, zero temperature is applied at the end and is kept at that value. It is attempted to determine the temperature distribution for the bar, , at any point and time . This problem will be solved using techniques from Fourier integral .
From heat flow theory, it is known that should satisfy (heat conduction equation) where , known as thermal diffusivity. It is subject to initial condition and boundary condition . The method of separation of variables is applied. This technique assumes that it is possible to obtain solutions in a product fashion
From boundary conditions follows that , and since there is no restriction for , it is possible to integrate over , replacing in function such that solution to the problem takes the shape where is determined from the following integral equation:
now, it is possible to express the heat distribution as follows:
It is possible to express (6.6) in terms of the error function or
Figure 6 shows how temperature varies for a certain distance (expressed in meters) and time (measured in seconds); temperature is expressed in Kelvin. Thermal diffusivity parameter () employed for this example is which belongs to silver, pure ().
(a) Time range between 0 s and 2000 s
(b) Time range between 0 s and 250 s
6.2. Example 2
Another interesting example of heat flow is the nonstationary flux in an agriculture field due to the sun (Figure 7). Suppose that the initial distribution of temperature on the field is given by , and the superficial temperature is always constant .
Let the origin be on the surface of the field, in such a way that the positive end for axis points inward the field. For symmetry reasons, it is possible to consider as a function of and time . The temperature distribution is governed, again, by (6.1). It is subject to conditions and . Unlike Example 1, (6.1) is expressed as an ordinary single variable second-order differential equation using the substitution where
This substitution immediately converts (6.1) into
Integrating (6.13) leads to the following: where and are integration constants.
Determining and constants results from applying the initial and boundary conditions, such that the final result is given as
Figure 8 shows how temperature varies in depth; values are in meters. The temperature is in Kelvin, and time is measured in seconds. For this case, field temperature is , surface temperature is , and the thermal conductivity value is .
(a) Time range between 0 s and 1800 s
This paper presents the normal distribution integral as a differential equation. Then, instead of using a traditional linear function in HPM, a nonlinear differential equation is used which has analytic solution (qualitatively related to the solution of the normal distribution integral). This is done to initiate the HPM method at the “closest” point to the solution. In fact, in the research area of homotopy continuation methods [37–40], it is well known that when the homotopy parameter is , the solution of the homotopy function must be trivial or simple to solve. Hence, it is possible to use a nonlinear differential equation instead of as long as the differential equation has an analytic solution (at ). The function nested into the function helps to establish a better approximation for the normal distribution integral. Then, the HPM method was successfully applied on the treatment of the normal distribution integral. From this result other related integrals were calculated, finding that the maximum relative error for the Gaussian integral was less than (Figure 1(b)). For the case of the approximate error function (3.1) and (3.2), the relative error was less than (Figure 3(b)), and for the cumulative error function the maximum error for region was less than (Figure 4(c)). Therefore, those approximations have a high level of accuracy, comparable to other approximations found in the literature; nevertheless, the proposed approximations in this work have such mathematical simplicity that allows to be used on practical engineering applications where the relative error does not represent a severe constraint.
The approximate solution of the cumulative distribution function was used to solve some defined and undefined integrals without known analytic solution, showing a low order relative error. Besides, the approximate error function (3.1) was employed to express, analytically, the solution for two heat flow problems, obtaining results with low order relative error.
Approximations (2.9), (3.2), and (4.4) have a low order of mathematical complexity so they become susceptible to be implemented in hardware for analog circuits. Therefore, approximations for the Gaussian, error, and cumulative functions may be part of a circuit for analog signal processing. Finally, the necessary blocks to implement some of the normal distribution functions in a circuit using the current-current mode are as follows:(1)The hyperbolic tangent was implemented in analog circuits .(2)Arctangent function was implemented in .(3)To multiply a current by a factor, it is only necessary to use current mirrors .(4)The addition or subtraction of constant values is achieved by connecting to the terminal a positive or negative current, respectively .(5)The addition of constants is equivalent to add constant current sources by using current mirrors .
Finally, after analyzing qualitatively the proposed approximation of this work, it is possible to establish a better approximation (see Figure 9) to the error function with hyperbolic tangents nested, resulting in the following: where values for constants were calculated by means of the same numerical adjustment procedure employed to calculate (2.9). This approximation for the error function may be implemented in a circuit easily by means of the repeated use of the analog block for the hyperboloidal tangent  and some current mirrors .
This work presented an approximate analytic solution for the Gaussian distribution integral (by using HPM method), the error function and the cumulative normal distribution providing low order relative errors. Besides, the relative error for the error function is comparable to other approximations found in the literature and has the advantage of being a simple expression. Also, it was possible to solve, satisfactorily, a series of normal distribution-related integrals, which may have potential applications in several areas of applied sciences. It was also demonstrated that the approximate error function can be employed on the practical solution of engineering problems like the ones related to heat flow. Besides, given the simplicity of the approximations, these are susceptible of being implemented in analog circuits focusing on the analog signal processing area.
- S. Lipschutz, Probabilidad, McGraw-Hill, 2003.
- J. H. Patel and C. B. Read, Handbook of the Normal Distribution, Statistics A Series of Textbooks and Monographs, Marcel Dekker, New York, NY, USA, 2nd edition, 1996.
- J. H. He, “Homotopy perturbation technique,” Computer Methods in Applied Mechanics and Engineering, vol. 178, no. 3-4, pp. 257–262, 1999.
- J. H. He, “A coupling method of a homotopy technique and a perturbation technique for non-linear problems,” International Journal of Non-Linear Mechanics, vol. 35, no. 1, pp. 37–43, 2000.
- J. H. He, “Application of homotopy perturbation method to nonlinear wave equations,” Chaos, Solitons and Fractals, vol. 26, no. 3, pp. 695–700, 2005.
- J. H. He, “Homotopy perturbation method for bifurcation of nonlinear problems,” International Journal of Nonlinear Sciences and Numerical Simulation, vol. 6, no. 2, pp. 207–208, 2005.
- J. H. He, “Homotopy perturbation method for solving boundary value problems,” Physics Letters A, vol. 350, no. 1-2, pp. 87–88, 2006.
- J. H. He, “New interpretation of homotopy perturbation method,” International Journal of Modern Physics B, vol. 20, no. 18, pp. 2561–2568, 2006.
- J. H. He, “An elementary introduction to recently developed asymptotic methods and nanomechanics in textile engineering,” International Journal of Modern Physics B, vol. 22, no. 21, pp. 3487–3578, 2008.
- J. H. He, “Recent development of the homotopy perturbation method,” Topological Methods in Nonlinear Analysis, vol. 31, no. 2, pp. 205–209, 2008.
- L. M. B. Assas, “Approximate solutions for the generalized KdV-Burgers' equation by He's variational iteration method,” Physica Scripta, vol. 76, no. 2, pp. 161–164, 2007.
- J. H. He, “Variational approach for nonlinear oscillators,” Chaos, Solitons and Fractals, vol. 34, no. 5, pp. 1430–1439, 2007.
- A. Yildinm, “Exact solutions of poisson equation for electrostatic potential problems by means of the variational iteration method,” International Journal of Nonlinear Sciences and Numerical Simulation, vol. 10, no. 7, pp. 867–871, 2009.
- M. Jalaal, D. D. Ganji, and G. Ahmadi, “An analytical study on settling of non-spherical particles,” Asia-Pacific Journal of Chemical Engineering. In press.
- Z. Z. Ganji, D. D. Ganji, and M. Esmaeilpour, “Study on nonlinear Jeffery-Hamel flow by He's semi-analytical methods and comparison with numerical results,” Computers and Mathematics with Applications, vol. 58, no. 11-12, pp. 2107–2116, 2009.
- N. Jamshidi and D. D. Ganji, “Application of energy balance method and variational iteration method to an oscillation of a mass attached to a stretched elastic wire,” Current Applied Physics, vol. 10, no. 2, pp. 484–486, 2010.
- D. J. Evans and K. R. Raslan, “The tanh function method for solving some important non-linear partial differential equations,” International Journal of Computer Mathematics, vol. 82, no. 7, pp. 897–905, 2005.
- F. Xu, “A generalized soliton solution of the Konopelchenko-Dubrovsky equation using He's exp-function method,” Zeitschrift fur Naturforschung, vol. 62, no. 12, pp. 685–688, 2007.
- G. Adomian, “A review of the decomposition method in applied mathematics,” Journal of Mathematical Analysis and Applications, vol. 135, no. 2, pp. 501–544, 1988.
- E. Babolian and J. Biazar, “On the order of convergence of Adomian method,” Applied Mathematics and Computation, vol. 130, no. 2-3, pp. 383–387, 2002.
- L.-N. Zhang and L. Xu, “Determination of the limit cycle by He's parameter-expansion for oscillators in a (u3/(1 + u2) potential,” Zeitschrift fur Naturforschung, vol. 62, no. 7-8, pp. 396–398, 2007.
- M. Madani, M. Fathizadeh, Y. Khan, and A. Yildirim, “On the coupling of the homotopy perturbation method and Laplace transformation,” Mathematical and Computer Modelling, vol. 53, no. 9-10, pp. 1937–1945, 2011.
- M. Jalaal, D. D. Ganji, and G. Ahmadi, “Analytical investigation on acceleration motion of a vertically falling spherical particle in incompressible Newtonian media,” Advanced Powder Technology, vol. 21, no. 3, pp. 298–304, 2010.
- M. Jalaal and D. D. Ganji, “On unsteady rolling motion of spheres in inclined tubes filled with incompressible Newtonian fluids,” Advanced Powder Technology, vol. 22, no. 1, pp. 58–67, 2011.
- M. Jalaal and D. D. Ganji, “An analytical study on motion of a sphere rolling down an inclined plane submerged in a Newtonian fluid,” Powder Technology, vol. 198, no. 1, pp. 82–92, 2010.
- D. D. Ganji and A. Sadighi, “Application of He's homotopy-perturbation method to nonlinear coupled systems of reaction-diffusion equations,” International Journal of Nonlinear Sciences and Numerical Simulation, vol. 7, no. 4, pp. 411–418, 2006.
- D. D. Ganji, “The application of He's homotopy perturbation method to nonlinear equations arising in heat transfer,” Physics Letters A, vol. 355, no. 4–5, pp. 337–341, 2006.
- D. D. Ganji and A. Rajabi, “Assessment of homotopy-perturbation and perturbation methods in heat radiation equations,” International Communications in Heat and Mass Transfer, vol. 33, no. 3, pp. 391–400, 2006.
- D. D. Ganji, M. Rafei, A. Sadighi, and Z. Z. Ganji, “A comparative comparison of he’s method with perturbation and numerical methods for nonlinear equations,” International Journal of Nonlinear Dynamics in Engineering and Sciences, vol. 1, no. 1, pp. 1–20, 2009.
- M. H. Holmes, Introduction to Perturbation Methods, vol. 20 of Texts in Applied Mathematics, Springer, New York, NY, USA, 1995.
- M. El-Shahed, “Application of He's Homotopy Perturbation Method to Volterra's Integro-differential Equation,” International Journal of Nonlinear Sciences and Numerical Simulation, vol. 6, no. 2, pp. 163–168, 2005.
- Y. X. Wang, H. Y. Si, and L. F. Mo, “Homotopy perturbation method for solving reaction-diffusion equations,” Mathematical Problems in Engineering, vol. 2008, Article ID 795838, 2008.
- S. Winitzki, “A handy approximation for the error function and its inverse,” Lecture Note, 2008.
- R. G. Hart, “A close approximation related to the error function,” Mathematics of Computation, vol. 20, pp. 600–602, 1966.
- M. R. Spiegel, Schaum’s Outline of Fourier Analysis with Applications to Boundary Value Problems, McGraw-Hill, 1974.
- W. Gander and J. Hrebicek, Solving Problems in Scientific Computing Using Maple and MATLAB, Springer, New York, NY, USA, 4th edition, 2004.
- R. C. Melville, L. Trajkovic, S. C. Fang, and L. T. Watson, “Artificial parameter homotopy methods for the DC operating point problem,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 12, no. 6, pp. 861–877, 1993.
- K. Yamamura, T. Sekiguchi, and Y. Inoue, “A fixed-point homotopy method for solving modified nodal equations,” IEEE Transactions on Circuits and Systems I, vol. 46, no. 6, pp. 654–665, 1999.
- H. Vázquez-Leal, L. Hernández-Martínez, and A. Sarmiento-Reyes, “Double-bounded homotopy for analysing nonlinear resistive circuits,” in Proceedings of the IEEE International Symposium on Circuits and Systems, vol. 4, pp. 3203–3206, May 2005.
- H. Vázquez-Leal, L. Hernández-Martínez, A. Sarmiento-Reyes, and R. Castañeda-Sheissa, “Numerical continuation scheme for tracing the double bounded homotopy for analysing nonlinear circuits,” in Proceedings of the International Conference on Communications, Circuits and Systems, vol. 2, pp. 1122–1126, May 2005.
- L. Gatet, H. Tap-Béteille, and M. Lescure, “Analog neural network implementation for a real-time surface classification application,” IEEE Sensors Journal, vol. 8, no. 8, Article ID 4567516, pp. 1413–1421, 2008.
- R. Velmurugan, S. Subramanian, V. Cevher et al., “On low-power analog implementation of particle filters for target tracking,” in Proceedings of the 14th European Signal Processing Conference (EUSIPCO '06), 2006.
- M. T. Abuelma'atti, “Universal CMOS current-mode analog function synthesizer,” IEEE Transactions on Circuits and Systems I, vol. 49, no. 10, pp. 1468–1474, 2002.
Copyright © 2012 Hector Vazquez-Leal et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.