Abstract
This paper derives the directional derivative expression of Taylor formula for two-variable function from Taylor formula of one-variable function. Further, it proposes a new concept, fractional directional differentiation (FDD), and corresponding theories. To achieve the numerical calculation, the paper deduces power series expression of FDD. Moreover, the paper discusses the construction of FDD mask in the four quadrants, respectively, for digital image. The differential coefficients of every direction are not the same along the eight directions in the four quadrants, which is the biggest difference by contrast to general fractional differentiation and can reflect different fractional change rates along different directions, and this benefits to enlarge the differences among the image textures. Experiments show that, for texture-rich digital images, the capability of nonlinearly enhancing comprehensive texture details by FDD is better than those by the general fractional differentiation and Butterworth filter. By quantity analysis, it shows that state-of-the-art effect of texture enhancement is obtained by FDD.
1. Introduction
Fractional differentiation, also called noninteger differentiation, is not a new concept: it dates back to Cauchy, Riemann, Liouville, and Letnikov in the 19th century. Then, several theoretical physicists and mathematicians have studied fractional differential equations, especially fractional-order linear differential equations and fractional differential equations with delay [1–5], also fractional equations of fractional variational problems [6, 7]. In comparison with integer-order differentiation, the fractional differentiation of direct current or low frequency signal is often nonzero. Fractional differential processing is not only nonlinearly keeping signal's low-frequency and direct current components, but also nonlinearly enhancing the signal's high-frequency and middle-frequency components [8]. Therefore, special Mach's phenomenon appears in fractional differentiation of image. Moreover, it has a special bionic vision receptive field model for fractional differential antagonism characteristics [9, 10]. Based on the special characteristics of fractional differentiation, in the last two decades, fractional differentiation has played a very important role in various physical sciences fields, such as mechanics, electricity, chemistry, biology, economics, time and frequency domains, system identification, notably control theory, mechatronics, and robotics [9, 11, 12]. Recently, fractal theory has already been used in fractal image processing [13–16].
In image processing, texture enhancement is an important issue in many areas like pattern recognition, image restoration, medical imaging processing, robotics, interpretation of image data, and remote sensing. But, to our knowledge, only a few reliable methods focus on texture enhancing. Texture enhancement often makes use of integer-order differential operators, especially -order used by the gradient and -order by the Laplacian. In [13–16], the principles of fractional differential operators in image processing are introduced with implementation of fractional differential masks. But these fractional differential masks have a common flaw which the fractional differential coefficients of every direction are always the same along the eight directions in the image plane, which is not conducive to reflect the different change rates of the image along different directions and is not benefitial to enlarge the differences among textures. Based on this, we introduce the concept of directional derivative to fractional differentiation and propose a new mathematical method, fractional directional differentiation (FDD), and then try to employ it to image processing, particularly to comprehensive fractal-like texture-details enhancement. Furthermore, by taking the approximations of power series expression of FDD, we propose four novel FDD masks and corresponding numerical calculation rules. The fractional differential coefficients along the eight directions in the image plane are not the same, which can reflect different fractional change rates along different directions and is benefit to enlarge the differences among the image textures. Thus, this can lead to texture enhancement. Experiments show that FDD can effectively enhance texture details of image and has a greater calculation range than that of fractional differential for texture-enhancing.
This paper is organized as follows. Section 2 first recalls on the necessary theoretical background of directional derivative and the main definitions of Riemann-Liouville in Euclidean space. According to Taylor formula of one-variable function, we deduce the directional derivative expression of Taylor formula for two-variable function, give the definition of FDD, and further deduce power series expression of FDD. Section 3 deals with and gives four FDD masks and their calculation rules. Section 4 reports the nonlinearly enhancing capability of texture details based on FDD. By calculating five classical parameters from gray-level cooccurrence matrix in particular, information entropy, average gradient and projection of gray-level, we implement quantity analysis.
2. Theory of FDD
2.1. Directional Derivative
Assume that is defined in the neighborhood . Find the line which passes through and parallels to as follows: where is the direction angle. Let satisfy (2.1) and . If we take the direction of the vector the same as , then , otherwise, , that is to say, changes along the positive or negative direction of . If the limit exists, then (2.2) is called the directional derivative of along the direction at , write , which denotes the slope of tangent line at for the plane curve and the geometric meaning is the same as general derivative.
It is well known, the sufficient condition which (2.2) exists is that has continuous partial derivatives of first order in the neighborhood at the point and Clearly, for any in , is the function with respect to and , that is, If exists continuous partial derivatives of second order in the neighborhood , making the direction fixed and by (2.5), we obtain Thus (2.6) is called the second order directional derivative of along the direction at .
Similarly, if exists order continuous partial derivatives in , we can define the -order directional derivative of along the direction at as follows:
2.2. Directional Derivative Expression of Taylor Formula for Two-Variable Function
In [17], the author deduced the Taylor series expansion of multivariable function and gave its conditions of convergence. On this basis, we will further derive the directional derivative expression of Taylor formula for multi-variable function. In this paper, we only discuss two-variable function. Actually, for multi-variable function, it is similar to two-variable function.
Let have order continuous partial derivatives in , then (2.7) holds and we call that is the order () differentiation of , thus the Taylor formula of can be expressed as follows: where . Now let , that is, when , , and when , . Clearly, (2.8) becomes Taking (2.10) into (2.9), we get Equation (2.11) is called the directional derivative expression of Taylor formula for . Compared with Taylor formula of one-variable function, they have a unified form.
2.3. Fractional Differentiation
If the signal has order continuous derivatives and is at least , where denotes the greatest integer and is less than or equal to , then the definitions of fractional calculus based on Grumwald-letnikov and Riemann-Liouville [4] are equivalent. Otherwise, the latter is an expansion of the former with wider applications [10]. Though the definition of fractional calculus based on Riemann-Liouville is more common, few studies involve in its numerical solution. Currently, more researches still focus on the numerical solution of fractional calculus based on Grumwald-Letnikov [10, 13–15, 18]. It is well-known that -order fractional integral based on Riemann-Liouville can be expressed as follows [1]: where is continuous in , and is a positive real number.
On the basis of fractional integral, -order fractional differentiation based on Riemann-Liouville, write , can be defined. In fact, the -order differential operator can be viewed as . Let , where . Obviously, and . Thus, -order differentiation of is Equation (2.13) shows obviously that the calculation of -order fractional differentiation based on Riemann-Liouville need to first find -order fractional integral, and then seek general -order derivative. Note that and must keep their order, which means that we must first find integral, then do derivative.
2.4. FDD of Two-Variable Function
In (2.11), when the direction is fixed at any point , is a variable number along . Thus, (2.11) can be seen as a function with respect to the variable and denotes the variety of along the direction at . With the change of direction , (2.11) denotes the variety of along different directions at . In order to quantify the variety of in a certain direction at the point , find fractional differentiation (-order) of (2.11) as follows: where . Equation (2.14) denotes just the fractional measurement of the variety of along the direction at . Equation (2.14) is called fractional directional differentiation (FDD) of along the direction at . Thus, the FDD depicts a fractional change rate of along the direction at any point .
3. FDD Mask and Algorithm
There are many studies on numerical calculation of fractional differentiation [1, 13, 16, 18]. Similarly, we need to discuss numerical calculation of FDD. To implement numerical calculation of (2.14), we first seek its power series expression. According to [18], can be induced as follows: where is the Beta function, and , is an integer. Taking (3.1) into (2.14), we obtain Thus, (3.2) is the power series expression of FDD for .
Since the processing data of computer or digital filter is digital and finite, the maximum variety of image's grayscale is also finite. The shortest neighborhood distance between pixels can achieve only one pixel [13, 16]. Therefore, the measurement for duration of two-dimensional digital image on -coordinate or -coordinate must take pixel as unit, and the minimum division must be , and since or , it has
Next, we will implement numerical calculation and seek the masks of FDD in four quadrants, respectively. In the first quadrant, the forward differences of , and can be expressed as: Taking (3.4) into (3.2) and by (2.7), (3.3), when in (3.2), we get Let Then, (3.5) becomes Equation (3.7) indicates that it has a mask when , write FDD-1, shown in Figure 1.
In the first quadrant, we choose three direction angles , and to calculate the coefficients (3.6) of the mask FDD-1.(i) For , let change strictly along the positive direction of in the image plane, therefore and we can find the FDD at . By (3.3), we have . Thus, the coefficients (3.6) of the mask FDD-1 becomes (ii) For , let change always along the positive direction of in the image plane, therefore and FDD can be found at . By (3.3), we have . Thus the coefficients (3.6) of the mask FDD-1 are as follows: (iii) For , let change always along the positive direction of in the image plane, therefore and we can find the FDD at . By (3.3), we have . Thus the coefficients (3.6) of the mask FDD-1 are equal to
Similarly, in the second quadrant, the backward difference on the negative -coordinate and forward difference on the positive -coordinate of , , , , and are expressed as follows: Taking (3.11) into (3.2) and by (2.7), (3.3), where in (3.2), after simplification, we get Let Then (3.12) can be expressed as Equation (3.14) indicates that it has a mask when , write FDD-2, shown in Figure 2.
Since the mask FDD-2 in Figure 2 denotes the algorithm of FDD along different directions in the second quadrant, we can also take three direction angles , , and to calculate the coefficients (3.13). In fact, the three direction angles in the second quadrant can show the direction angles , , and in the image plane. Similar to the calculation of the mask FDD-1's coefficients, the calculation of (3.13) is as follows:(i) When , we have (ii) When and by (3.3), we obtain (iii) When and by (3.3), it has
In the same way, the backward differences of , , , , and in the third quadrant can be expressed as follows: Taking (3.18) into (3.2) and by (2.7), (3.3), when in (3.2), after simplification, we get its approximation Let Thus, (3.19) can be rewritten as Equation (3.21) indicates that it has a mask when , write FDD-3, shown in Figure 3.
The same as the first and the second quadrants, because the mask in Figure 3 denotes the algorithm of FDD along different directions in the third quadrant, we can also take three-directions angles , and into account for (3.20). Actually, the three-direction angles in the third quadrant can denote the , and in the image plane. (i) For , we have (ii) For and by (3.3), we obtain (iii) For , one has
Finally, in the fourth quadrant, the forward difference on positive -coordinate and backward difference on negative -coordinate of , , , , and are Taking (3.25) into (3.2) and by (2.7), (3.3), when in (3.2), we obtain Let Then (3.26) becomes Equation (3.28) denotes that it has a mask when , write FDD-4, shown in Figure 4.
Since the mask FDD-4 in Figure 4 denotes the algorithm of FDD along different directions in fourth quadrant, we can also take the three direction angles , and into account for (3.27). Similarly, the three direction angles in the fourth quadrant can denote the , and in the image plane. (i) When , it has (ii) When and by (3.3), we have (iii) When and by (3.3), we get
From the mask (), we take three direction angles in every quadrant, respectively, thus the -order FDD at any point along twelve directions can implement in in an image , which can enhance its anti-rotation capability. But note that the coefficients (3.8), (3.10), (3.15), and (3.24) are same as (3.29), (3.17), (3.22), and (3.31) respectively. Therefore, the mask () can actually achieve FDD along the eight directions in four quadrants, where the coefficients of the masks are (3.8), (3.9), (3.16), (3.17), (3.22), (3.23), (3.30), and (3.31), respectively. These fractional differential coefficients of the eight directions are different. This is the biggest difference between FDD and general fractional differentiation. Generally, FDD-1, FDD-2, FDD-3, and FDD-4 are collectively called FDD operator.
Digital image processing is based on direct processing discrete pixels, while the numerical calculation of FDD is to implement fractional space filter by FDD operator convolution. The principle of space filter is to move the operator point by point. In digital image , , FDD operator is used to filter with the convolution algorithms of FDD-1, FDD-2, FDD-3, and FDD-4, respectively
Since the coefficients of FDD along the eight directions are different and it can effectively enlarge the differences among image textures, FDD can enhance not only the contour features in the smooth area nonlinearly, but the high-frequency edge feature in those areas where gray changes remarkably as well. To simplify the operation, according to the outputs comparison of the eight directions in four quadrants, the biggest one is selected as FDD grayscale. FDD algorithm for digital color image is similar to that for gray image, while the difference lies in that R, G, B components should do FDD, respectively, as the algorithm for gray image before composing the RGB color image. In other words, the calculation of mask convolution for color image is three times of that for gray image. there are strong interrelation among the components, and the gray range is [0, 255]. Thus, when the order is big or small, the interrelations can be broken especially in the case of nonlinearly enhancing the components, and the enhancement image may be distorted. For digital color image, it is better to take the format of YCrCb and HSV.
4. Experiments and Results Analysis
This section will demonstrate that FDD operator has better capability of texture enhancing for texture rich image. FDD is required in advance for an image by FDD-1, FDD-2, FDD-3, and FDD-4 masks, respectively, along eight directions. In four quadrants, the direction angles and coefficients of FDD operator are taken and found according to (3.8), (3.9), (3.16), (3.17), (3.22), (3.23), (3.30), and (3.31), respectively. And we can see that the differential coefficients along these eight directions in the image plane are not the same, which can reflect different fractional change rates along different directions and is benefiting to enlarge the differences among the image textures. The calculation rules of every mask refer to (3.32)–(3.35). Finally, we select the maximum output value of the eight directions in four quadrants as grayscale of the point. Note that FDD has a greater calculation range than the transition width of general fractional differential order . Clearly, when , FDD is equivalent to the fractional directional integral operator. Some experimental results are shown in Figure 5.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
For quantity analysis, we calculate gray level cooccurrence matrix to describe the comprehensive information of the texture details like direction, neighboring distance, changing range, and the background. We pick up from gray level cooccurrence matrix five classical parameters of angle matrix, contrast, correlation, energy and homogeneity. The corresponding testing values of each parameter in the four angles can be obtained by taking , ,, and , respectively. So, there are testing values of parameters of gray level cooccurrence matrix. For the lunar surface in Figure 5, the parameters values of gray level cooccurrence matrix in 1-pixel distance are shown in Tables 1 and 2.
The visual analysis of the above data and discussion of the relationship between order and texture-enhancing details in the directions of , , , and are integrated as nonlinear curves by four parameters: contrast, correlation, energy, and homogeneity, shown in Figure 6.
(a)
(b)
(c)
(d)
Tables 1 and 2 and Figure 6 show that, no matter what the angle is, the change of texture-enhancement has some relations with the order . From (a) in Figure 6, we see that four contrast curves of enhancement image are above that of the original image. Image contrast can be interpreted as image clarity, that is, the clarity of image texture. The deeper the texture channels become, the greater the contrast is, as a result, the image looks clearer. The (b) in Figure 6 shows that the correlation of gray level cooccurrence matrix is always below that of the original image and becomes weaker with the increasing of when , that is to say, when the correlation decreases, the texture details become clearer. From (c) in Figure 6, we observe that the energy curve first decreases and then increases during . Particularly, when , the energy decreases and is above that of the original image; when , the energy continues to decrease and is less than that of the original image; when , the energy increases with the increasing of and is still below that of the original image. Since the energy is the sum of square of gray level cooccurrence matrix element and reflects the uniformity of image gray level distribution and the texture coarseness, which means that the more concentrated on the distribution the gray level cooccurrence matrix elements are, the greater the energy is. On the contrary, when the energy is smaller, the texture changing becomes more inhomogeneous and irregular, and texture details are clearer. So, from the energy, texture details by FDD operator are better when in general. The Figure 6(d) shows that the homogeneity of gray level coccurrence matrix is almost always below that of the original image and the trend is down then up. When , the homogeneity decreases with the increasing of , which means that the texture in different sections changes more dramatic and the texture details are clearer. When , the homogeneity correspondingly increases, that is, it changes little in different sections when . In summary, once one takes all the four parameters of gray-level cooccurrence matrix into account, the strongest points of FDD for texture-enhancing should focus on the range of in general. Here note that it is different from general fractional differential when , the result by FDD operator does not denote the original image, but the image of series expression of directional derivative to original image by (2.11), and it does not do fractional differentiation with respect to direction variable .
To further observe the texture-enhancing capability of FDD, we did a set of comparisons with the two algorithms, the general fractional differentiation, and the nonlinearly enhancing high-frequency components by Butterworth filter, for different kinds of textures. The results are shown in Figure 7. In addition, for easy comparison of its enhancing results, the results of experiments are the iteration of corresponding pixels of original image and FDD image.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
From Figure 7, we could find that the nonlinearly enhancing the high-frequency components by Butterworth filter suffers from one serious drawback when large structures are strongly enhanced. By contrast, the FDD allows the smooth enhancement of large structures. For the enhancement of small texture details, the FDD may have some advantages over Butterworth filter. And since the coefficients of general fractional differentiation are always the same along the eight directions in the image plane, which is not conducive to reflect the different change rates of the image along different directions. While the FDD coefficients along the eight directions in the image plane are not the same, which can reflect sufficiently different fractional change rates along different directions and is benefiting to enlarge the differences among the image textures. So the enhancement results by FDD are better than those by general fractional differential. FDD operator cannot only maintain the most energy of image on the low frequency, but also nonlinearly enhance its energy over intermediate and high frequencies, which leads to a richer texture details. For quantity analysis, we take information entropy [19] and average gradient [20, 21] as parameters that are shown in Table 3. The entropy denotes a measure of the amount of image information. Certainly, texture information is also one of image information. If an image has no texture, the gray level cooccurrence matrix is almost a zero matrix and its entropy is close to zero. Otherwise, if an image has a great number of comprehensive texture details, its entropy is also greater. The average gradient can be sensitive to reflect the ability of contrast expression of small details, which can be used to evaluate image clarity. The experiment data of Figure 7 are shown in Table 3.
From Figure 7 and Table 3, we can see that, although the algorithm of the nonlinearly enhancing the high-frequency components by Butterworth filter can increase the average gradient, it only enhances the margin and losses a lot of texture details, thus it only has the minimum information entropy. Comparing with general fractional differential, the average gradient by FDD is slightly lower than it, however, the enhanced images by FDD have the biggest information entropy, which means FDD can enhance both the margins and the textures. Therefore, FDD could nonlinearly preserve the low-frequency contour feature in the smooth area to the furthest degree, nonlinearly enhance high-frequency marginal information in those areas where gray scale changes frequently, and nonlinearly enhance texture details in those areas where gray scale does not change evidently. Thus FDD could nonlinearly enhance the comprehensive texture details.
For an RGB color image, the algorithm is similar to that for gray image. We do FDD for R, G, B component, respectively, then compose the RGB color image. The results are shown in Figure 8.
(a)
(b)
(c)
(d)
Observing carefully Figure 8, we see that the texture channels become deeper and the texture details are clearer by FDD operator. FDD operator not only maintains the most energy of image on the low frequency, but also nonlinearly enhance its energy over intermediate and high frequencies, which leads to a richer texture details. For the purpose of directly observing the change of grayscale, without losing generality, we take vertical projection (-coordinate) of gray level of (a) and (d) in Figure 8 as examples, to compare the change of gray-level values. The results are shown in Figure 9.
(a)
(b)
(c)
(d)
From Figure 9, we know that, the same as general fractional differential, FDD operator also enhances the high-frequency edge information with obvious enhancement effect. Moreover, comparing to integer-order differentiation, FDD keeps the envelope of gray level histogram distribution to some degree, and reserves the low-frequency contour information of the original image. After FDD to the original image, the result shows that the change magnitude of each point in the original image along eight directions in the four quadrants. Therefore, FDD adds some burrs in the envelope curve of gray-level projection of the original image, which just denotes that the texture details are richer than the original image in these locations where there are many burrs and FDD can nonlinearly enhance texture details in those areas that gray levels have little changed, but integer-order differential is near to zero in those areas. In short, FDD not only nonlinearly preserves the contour feature in the smooth area, but also keeps high-frequency edge feature in those areas where gray changes remarkably and high-frequency texture detail feature in those areas where gray does not change evidently.
5. Conclusion
Fractional differentiation has played a very important role in digital image processing fields and more and more researchers begin to study it. This paper intends to propose a new mathematic approach (FDD) and deduce a new operator (FDD operator) obtained though the generalization of the Taylor formula for one-variable function to two-variable function and deduced though the power series expression of two-variable function. The particularity of FDD operator is that a directional derivative order between and favours detection selectivity, which expands the transition width of fractional differential order . Since the FDD coefficients along the eight directions in the image plane are not the same, which can reflect sufficiently different fractional change rates along different directions and is benefiting to enlarge the differences among the image textures. So the enhancement results by FDD are better than those by general fractional differential. Experiments show that the FDD operator has excellent textural details enhancing capabilities for rich-grained digital images. For quantity analysis, from the different quantitative criteria, gray-level cooccurrence matrix, vertical projection (x-coordinate) of gray-level, information entropy and average gradient, all show that FDD can nonlinearly enhance comprehensive texture details. FDD is a new method and technology for image-texture enhancement.
Acknowledgments
This work is supported by the National Natural Science Foundation of China (no. 60773168), the project of Science and Technology Department of Sichuan Province (no. 2011JY0077), the Natural Science Foundation of Chengdu University of China (no. 2010XJZ28), and the project of Chengdu City Economic and Information Technology Commission (no. 201201014).