Abstract
Most image enlargement techniques suffer the problem of zigzagged edges and jagged images following enlargement. Humans are sensitive to the edges of objects; if the edges in the image are sharp, the visual is considered to be high quality. To solve this problem, this paper presents a new and effective method for image enlargement and enhancement based on adaptive inverse hyperbolic tangent (AIHT) algorithm. Conventional image enlargement and enhancement methods enlarge the image using interpolation, and subsequently enhance the image without considering image features. However, this study presents the method based on Adaptive Inverse Hyperbolic Tangent algorithm to enhance images according to image features before enlarging the image. Experimental results indicate that the proposed algorithm is capable of adaptively enhancing the image and extruding object details, thereby improving enlargements by smoothing the edge of the objects in the image.
1. Introduction
The digital images are affordable and easy to preserve, transmit, and modify; they are widely used across different fields. Since digital image sampling is nonsequential and incomplete, digital image resolution is often limited. Therefore, it is necessary to employ image enlargement technologies when viewing portions of an image in detail.
The quality of an image is commonly determined by factors in the natural environment. Factors present in the natural environment usually relate to light. If light distribution is extreme, the target object in the picture becomes hard to identify. This study proposes an image enlargement method that combines image enhancement with image enlargement. The proposed image enhancement process employs AIHT algorithm to enhance the image and smooth its edges. The enlargement process uses a bilinear enlargement algorithm to enlarge the enhanced image. This method adaptively enhances images while simultaneously extruding details in the target image, in order to smooth the edges created by enlargement. Image quality is often reduced when images are enlarged. The proposed method can improve image quality following enlargement. The most significant advantage of this method is the ability to reduce rough edges and image distortion even after image enlargement.
This paper is structured as follows: Section 2 discusses related image enlargement technology algorithms; Section 3 introduces the AIHT algorithm; Section 4 describes the proposed algorithm; Section 5 presents the test and simulation results; the conclusion provides a closing discussion of the proposed algorithm and suggests future research directions and applications.
2. Review of Image Enlargement Algorithms
Images are enlarged to enhance image resolution, increase image quality, and improve identification. The goal of this approach is to maintain image quality while eliminating image distortion, such as blurring and rough edges, upon image enlargement.
Traditional interpolation methods are commonly employed in image enlargement due to their simplicity and efficiency. Interpolation generally comprises two methods: nearest-neighbor interpolation [1] and bilinear interpolation [2]. When the continuous function passes through, the interpolation function can be used to calculate the sampling points. In theory, higher order interpolation functions are similar to continuous functions. However, this is not the case in practice [3].
2.1. Nearest Neighbor Interpolation
Nearest-neighbor interpolation, otherwise known as the substitution method, uses the gray value of neighboring pixels to interpolate the gray value of new pixel points [4, 5]. This method’s approach is to find the neighboring integer pixel points nearest to the noninteger pixel points. The gray value of these integer pixel points is then used to interpolate the gray value of new pixel points (shown in Figure 1).
In Figure 1 we can see the enlarged image of the pixel ; then, with conversion back to the original image , is interposed between the pixel and . Nearest-neighbor interpolation algorithm is to calculate the point in the image and its surrounding pixels , , , and the distance and then choose the shortest distance between the gray values of the pixels, as their gray values. The enlargement process using the nearest-neighbor interpolation algorithm will be encounter with the problem of blocking the effect.
The nearest-neighbor interpolation function is the simplest and most efficient interpolation algorithm. However, since it is easier to calculate its results in lower image quality, enlarged images usually display jagged and blocked features. The mathematical function is
2.2. Bilinear Interpolation
In mathematics, bilinear interpolation is an extension of linear interpolation for interpolating functions of two variables on a regular 2D grid image. The key idea is to perform linear interpolation first in one direction and then again in the other direction. Although each step is linear in the sampled values and in the position, the interpolation as a whole is not linear but rather quadratic in the sample location.
In computer vision and image processing, bilinear interpolation is one of the basic resampling techniques. When an image needs to be scaled up, each pixel of the original image needs to be moved in a certain direction based on the scale constant. However, when scaling up an image by a nonintegral scale factor, there are pixels that are not assigned appropriate pixel values. In this case, those holes should be assigned appropriate RGB or grayscale values so that the output image does not have nonvalued pixels. Bilinear interpolation can be used where perfect image transformation with pixel matching is impossible, so that one can calculate and assign appropriate intensity values to pixels. Unlike other interpolation techniques such as nearest neighbor interpolation, bilinear interpolation uses only the 4 nearest pixel values which are located in diagonal directions from a given pixel in order to find the appropriate color intensity values of that pixel.
Bilinear interpolation considers the closest 2 × 2 neighborhood of known pixel values surrounding the unknown pixel’s computed location. It then takes a weighted average of these 4 pixels to arrive at its final, interpolated value. The weight on each of the 4 pixel values is based on the computed pixel’s distance from each of the known points (shown in Figure 2).
Similar to nearest-neighbor interpolation, this method calculates new values based on four neighboring integer pixels [6, 7]. Interpolation is calculated as follows:
The refers to the pixels of the new position point after image enlargement and , , , and indicate the four vertices of the interpolation pixel . The closer these vertices are to , the greater their contribution to will be and vice versa. The neighboring pixels in images enlarged using bilinear interpolation are more continuous, or smoother, than when the integer points are acquired directly.
3. Adaptive Inverse Hyperbolic Tangent (AIHT) Algorithm
The world is filled with various images, which are representations of objects and scenes in the real world. Images are represented by a matrix of pixels, which can represent the gray levels or colors of the image. There are many aspects of images that are ambiguous and uncertain. Examples of these vague aspects include determining the border of a blurred object and determining which gray values of pixels are bright and which are dark [8]. If an image containing both objects and scenery gets too dark or blurred, it would be hardly recognized. Thus, the image enhancement technique is used to improve the appearance of an image for analysis and interpretation [9]. The objective of image enhancement is dependent on the application context; criteria for enhancement are often subjective or too complex to be easily converted to useful objective measures. The range of brightness values within an image is referred to as contrast. The contrast enhancement is a process that makes the image features stand out more clearly by optimizing the colors available on the display or an output device.
Figure 3 displays image enhancement using AIHT algorithm. In this method, the color image is first reformatted. The most distinctive feature of this algorithm is the use of AIHT function to modify the pixels based on their individual traits. The shape of the inverse hyperbolic tangent is controlled based on the bias and gain of light distribution in the original image [10, 11]. The AIHT algorithm has several desirable properties. For very small and very large luminance values, its logarithmic function enhances the contrast in both dark and bright areas of an image [12]. Because this function is an asymptote, the output mapping is always bounded between 0 and 1. Another advantage of this function is that it supports an approximately inverse hyperbolic tangent mapping for intermediate luminance, or luminance distributed between dark and bright values. [13–15].
The calculation for can be derived either algebraically from the definition of or by converting the derivative to a series and then integrating. The contrast of an image can be enhanced using inverse hyperbolic tangent function by (3). Adding the bias and gain parameters to control the shape of the inverse hyperbolic tangent curve leads to (4). Consider where refers to bias power function and refers to gain function.
Where is the image gray level of the th row and th column, the is a power of to speed up the changing. The gain function is a weighting function which is used to determine the steepness of the AIHT curve. A steeper slope narrows a smaller range of input values to the display range. The gain function is used to help shape how fast the midrange of objects in a soft region goes from 0 to 1. A higher gain value means a higher rate in change. Therefore the steepness of the inverse hyperbolic tangent curve can be further dynamically adjusted. The following section describes the method we will use, which is similar to the proposed algorithm.
3.1. Bias and Gain Parameters
The bias function is a power function defined over the unit interval which remaps according to the bias transfer function [16]. The bias function is used to bend the density function either upwards or downwards over the interval.
The bias power function is defined by
The gain function determines the steepness of the AIHT curve. A steeper slope maps a smaller range of input values to the display range. The gain function is used to help reshape the object’s midrange from 0 to 1 of its soft region. The gain function is defined by
Decreasing the gain value increases the contrast of the remapped image. Shifting the distribution toward lower levels of light (i.e., decreasing bias) decreases the highlights. By adjusting the bias and gain, it is possible to tailor a remapping function with appropriate amounts of image contrast enhancement. Figure 4 shows a block diagram of AIHT parameters evaluate, including bias and gain parameters.
The gain function determines the steepness of the curve. Steeper slopes map a smaller range of input values to the display range. The value of bias controls the centring of the inverse hyperbolic tangent. As seen in Figure 5, can be used to confirm the turning point and curve shape of the inverse hyperbolic tangent function. Figure 6 shows the different mapping curves at different gain value processing.
4. Image Enlargement and Enhancement Using AIHT Algorithm
Figure 7 illustrates an effective method of image enlargement and enhancement using AIHT algorithm. Most image enlargement and enhancement methods enlarge images via interpolation before conducting enhancement. The processing operations are performed and shown in Figure 7(a). Conversely, the proposed method conducts image enhancement using AIHT algorithm before enlarging the image, combining image enhancement and enlargement technologies. Steps to complete the processing are performed as in Figure 7(b).
(a) Enlargement before enhancement
(b) Enhancement before enlargement
In the image enhancement stage, AIHT algorithm is used to enhance images and soften edges. In the image enlargement stage, the bilinear interpolation enlargement algorithm is used to enlarge the enhanced images. The proposed method adaptively enhances images and extrudes image details to solve the problem of jagged edges common in image enlargements.
5. Results and Discussion
The test images used in this study represent three extremes: overly dark images, overly bright images, and back-lighted images. Figure 8 shows the results of image enlargement and enhancement using AIHT algorithm and compares images that were enlarged then enhanced to those that were enhanced before they were enlarged.
In this study, low-resolution images were enlarged 16 times, and the results of images that were enlarged before being enhanced were compared with those of images that were enhanced before being enlarged. Figure 8 compares the processing of images that were enlarged before being enhanced with the processing of images that were enhanced before being enlarged. The results showed that images that were enlarged before being enhanced had blurry and jagged edges, while enhancing before enlarging the images, as proposed in this study, improved these problems.
Table 1 compares the mean square error (MSE), signal-to-noise ratio (SNR), and peak signal-to-noise ratio (PSNR) values of images that were enlarged before being enhanced with images that were enhanced before being enlarged. The MSE, SNR, and PSNR values of back-lighted images, overly dark images, and overly bright images produced better results when enlarged before being enhanced, while normal images produced better results when enhanced before being enlarged. However, MSE, SNR, and PSNR values are not the only factors that determine image quality and therefore can only be used as a reference. Image quality can only be assessed accurately via manual inspection, and, as such, the image processing algorithm should conform to human visual reactions.
6. Conclusions
The quality of digital images typically decreases when they are enlarged. Most image enlargement and enhancement methods increase image size using interpolation before enhancement. Conversely, this paper suggests enhancing images using AIHT algorithm before enlarging them. Unlike other studies that do not consider the unique features of the original images during enhancement, this study’s proposed method conducts adaptive image enhancement and enlargement to optimize the quality of the enlarged images. The proposed algorithm optimizes image quality by adaptively enhancing different types of images and extruding object details, and increases the resolution of processed images to enhance image quality and reduce image distortion, such as blurring and jagged edges, resulting from image enlargement.
Conflict of Interests
The authors declare no conflict of interests regarding the publication of this paper.