Personal Communication Technologies for Smart Spaces Density-Based Clustering for Content and Color Adaptive Tone Mapping

Javed, Maleeha; Dawood, Hassan; Khan, Muhammad Murtaza; Banjar, Ameen; Alharbey, Riad; Dawood, Hussain

doi:https://doi.org/10.1155/2020/8846033

Mobile Information Systems

On this page

Abstract Introduction Results Conclusion Data Availability Conflicts of Interest References Copyright Related Articles

Special Issue

Personal Communication Technologies for Smart Spaces

View this Special Issue

ResearchArticle | Open Access

Volume 2020 | Article ID 8846033 | https://doi.org/10.1155/2020/8846033

Personal Communication Technologies for Smart Spaces Density-Based Clustering for Content and Color Adaptive Tone Mapping

Maleeha Javed,¹Hassan Dawood,¹Muhammad Murtaza Khan,^2,3Ameen Banjar,⁴Riad Alharbey,⁴and Hussain Dawood⁵

Academic Editor: Ali Kashif Bashir

Received11 Mar 2020

Revised25 Jun 2020

Accepted31 Jul 2020

Published17 Aug 2020

Abstract

Tone mapping operators are designed to display high dynamic range (HDR) images on low dynamic range devices. Clustering-based content and color adaptive tone mapping algorithm aims to maintain the color information and local texture. However, fine details can still be lost in low dynamic range images. This paper presents an effective way of clustering-based content and color adaptive tone mapping algorithm by using fast search and find of density peak clustering. The suggested clustering method reduces the loss of local structure and allows better adaption of color in images. The experiments are carried out to evaluate the effectiveness and performance of proposed technique with state-of-the-art clustering techniques. The objective and subjective evaluation results reveal that fast search and find of density peak preserves more textural information. Therefore, it is most suitable to be used for clustering-based content and color adaptive tone mapping algorithm.

1. Introduction

The demand for high dynamic range (HDR) images is rapidly increasing with the advent of sensors, display technology, and availability of multiple exposure photography. HDR images provide better visual quality as compared to their counterpart low dynamic range (LDR) images on account of their large ranged brightness levels and better preservation of color variations. This enables to store and visualize bright and dark objects in the same image which would normally require multiple images at different exposures to be in low dynamic range. Visualization of HDR images on standard display devices (made for displaying LDR images) is challenging as they are incapable of displaying the high dynamic range of the image. To address this issue, tone mapping operators are used to convert HDR images to LDR images. However, the technology that directly displays HDR images is becoming more cost-effective. Recently, most of the available display devices have LDR, which is why HDR to LDR conversion still has practical applications.

For visualization of HDR images on LDR devices, Retinex theory has been widely used, which slices the image into its components: base layer and detail layer. Edge preservation filtering techniques are used for the approximation of base layer in Retinex image decomposition. However, these methods have resulted in false coloring and halo artifacts because filtering is unable to capture complex local structure of the image. To overcome this problem, we need a method that can better adopt the local structure and color variation of HDR images in LDR images.

Furthermore, tone mapping operators are generally divided into two main categories: global tone mapping operators and local tone mapping operators. Global tone mapping operators use the same monotonic curve for dynamic range compression of the entire image [1, 2]. Initially, the focus of the research was on the design of global tone mapping operators. Drago et al. [3] proposed a tone mapping algorithm that used an adaptive logarithmic base for luminance compression while maintaining the image’s details and contrast. Kim and Kautz [4] introduced a tone mapping operator based on the hypothesis that the human visual system adopts Gaussian distribution. Reinhard et al. [5] proposed the use of spontaneous dodging and burning for dynamic range compression. The terms “dodging” and “burning” originate from printing, where holding backlight from a region of print is called dodging and the addition of light to image is referred to as burning. This can be used to increase or decrease the brightness of a captured image effectively. Reinhard and Devlin [6] introduced the light adaptive tone mapping which provides satisfying visual effects. Khan et al. [7] introduced a lookup table-based approach, where they have utilized the histogram of luminance for tone mapping. To produce the low dynamic range image appropriate for various viewing conditions, Han et al. [8] modify Khan et al.’s [7] method by considering the impact of ambient light on HVS. Generally, global tone mapping operators are computationally efficient [9]. However, they are unable to preserve the local characteristics and dynamic range variations as they ignore local pixel intensity variations in an image [9, 10].

Local tone mapping operators solve the issue of global tone mapping operators by incorporating the ratio between neighboring pixels and compressing each pixel. Gu et al. [11] and Min et al. [12] proposed local tone mapping operators based on layer decomposition, where the input image is divided into base layer and detail layer. The layer-decomposition-based approach has also been utilized by authors in [13–16]. Durand and Dorsey [17] proposed a method that preserves the detail layer by encoding large-scale variations of the base layer. Debevec and Gibson [18] proposed a method that helped to preserve brightness and details of image by applying a local luminance adaption function for compression of dynamic range, followed by reinjecting details in the low dynamic range image. Image color appearance model (iCAM06) [19] employed tone mapping by using iCAM06 color appearance model by considering the viewing conditions to generate optimal results. However, iCAM06 [19] led to the poor visual quality due to introduction of halo artifact, color saturation, and gradient reversal at the edges. To eliminate these problems, the authors in [20] proposed an iCAM06 based model. In their proposed algorithm guided filter [20], color adaptive transformation matrix and HPE primitives were altered to enhance the effectiveness of model.

Krawczyk et al. [21] introduced an algorithm based on anchoring theory that decomposed image luminance into patches and then calculated the lightness for each patch. Li et al. [22] proposed a symmetrical analysis-synthesis filter for reducing the intensity range. Jia and Zhang [23] used the guided image filter for tone mapping. Meylan et al. [24] suggested a method based on the characteristic of human retina to reduce dynamic range while increasing the local contrast of the image. Another retina inspired range compression algorithm is used [25] to overcome the halo artifacts, loss of details, different visualization across different displays, and color saturation.

Parraga and Otazu [26] developed a tone mapping method based on human color perception by dividing the image intensity into multiresolution contrast. Also, they had used a nonlinear saturation model for dynamic range reduction based on visual cortex behavior. Chen et al. [27] introduced Earth mover’s distance to segment HDR image and then applied local tone mapping on each component of the image. This maintained local texture and balanced perceptional impression. To remove artifacts and contrast enhancement, Liang et al. [28] used nonlinear diffusion. l₂-based retime model [29] was used for contrast enhancement. Ahn et al. [30] proposed a Retinex-based adaptive local tone mapping algorithm according to which the use of guided filter reduced halo artifacts. Recently, Liang et al. [31] proposed a hybrid l₁ − l₀ norm-based layer decomposition model. l₁ sparsity term was imposed on the base layer and l₀ on the detail layer. In [32], the authors proposed the use of decomposed multiscale Retinex for information preservation in tone-mapped image. Shu and Wu [33] employed an optimal local tone mapping operator to avoid halo artifacts and double edges. Rana et al. [34] proposed a pixel-wise adaptive tone mapping operator based on support vector regression to overcome the problem of drastic illumination variation.

El Mezeni and Saranovac [35] introduced an enhanced local tone mapping operator (ELTM). ELTM decomposed an image into detail and base layers, where the base layer was compressed into both logarithmic and linear domain. Local tone mapping operator presented in [36] was operationally similar to HVS. Li and Zheng [37] presented a saliency-aware local tone mapping operator that preserved edges using guided filters. Ferradans et al. [38] proposed a two-stage algorithm incorporating both global tone mapping and local tone mapping. In the first step, they applied a global tone mapping operator based on the human visual system and followed by local method for contrast enhancement in the second stage. To make the local and global tone mapping algorithm more effective, Ambalathankandy et al. [39] used histogram equalization method implemented on FPGA with efficient resource usage. To resolve the overenhancement, a nonuniform quantization technique is proposed for CT image enhancement [40]. Recently, deep convolution neural network is also used for range compression [41]. The authors in [41] used the output of existing tone mapping operators as training set and therefore inherited the best properties of all tone mapping operators. Hence, they performed robustly well for all testing images compared to current methods of tone mapping.

Li et al. [42] introduced a clustering-based content and color adaptive tone mapping algorithm that preserved the local structure and naturalness of image. They used K-means algorithm for the clustering of color structure. However, K-means is difficult to adopt for a specific problem due to prespecified number of clusters. In addition, the utilization of K-means for tone mapping has led to the loss of complex local detail in LDR images. Furthermore, the number of available clustering algorithms encourages the use of the most effective algorithm for clustering-based tone mapping algorithm. Therefore, to preserve the complex local details, we have adopted a better clustering technique.

In this paper, we have proposed a clustering-based tone mapping algorithm to overcome the problems of false coloring, halo artifacts, and loss of complex local structure. For that purpose, we have utilized the fast search and find of density peak for content and color adaptive tone mapping. This clustering technique automatically recognizes clusters regardless of dimensionality of data. The following study compares various available state-of-the-art clustering algorithms for tone mapping operation. The effectiveness of proposed technique is compared with different clustering algorithms through subjective and objective evaluation techniques. The experimental analysis suggests that the fast search and find of density peak provides visually appealing result without compromising the local structure of an image.

The rest of the paper is composed of the following sections. The second section provides a brief introduction to the clustering-based content and color adaptive tone mapping algorithm. The third section describes different applied clustering techniques. Furthermore, the fourth section discusses the experimentation conducted to evaluate the performance of different clustering techniques. Our overall work is concluded in the fifth section.

2. Clustering-Based Content and Color Adaptive Tone Mapping Algorithm

Li et al. [42] proposed clustering-based content and color adaptive tone mapping algorithm. Most of conventional tone mapping operators split an image into chrominance and luminance channels. Instead, Li et al. divided an image into overlapped color patches. The overall algorithm consists of training and testing phases. The algorithm [42] utilizes training phase to learn PCA transform matrix for each color structure cluster from HDR training images, while the testing phase is used to project the HDR test images and to find the closest match in the training set. In the first step, logarithmic transform is applied on each HDR image to enhance the contrast and brightness of low luminance values in a channel while compressing the higher ones. Afterward, each image is divided into overlapped color patches to avoid artifacts such as local graying out, hue shift, or color fringes [43]. Each patch is further divided into approximately uncorrelated components: color structure, color variation, and patch mean. Patches with varied intensity level may have similar structures [42]. Therefore, patches are grouped together into different clusters based on color structure and then PCA transform matrix is obtained for each cluster. In the testing phase, for each patch color structure, similarity measure is calculated with cluster centers extracted from the training data and then relevant PCA matrix is retrieved. For tone mapping, S curve arctan function is applied on PCA projection matrix. The patch mean is compressed by a linear function and the color variation is controlled by an arctan function. The image is reconstructed by processed patches. At the end, postprocessing step is performed for contrast enhancement by clamping image at its maximum and minimum intensity value.

3. Compared Clustering Techniques

To explore the influence of different clustering algorithms, K-means is a reference clustering algorithm and the results are compared with Gaussian Mixture Model (GMM) [44], DBSCAN [45], and fast search and find of density peak (FSFDP) [46] clustering algorithms. Before presenting the results obtained by using each of these clustering schemes, a brief description of each clustering technique is presented with its strengths and shortcomings.

3.1. K-Means

K-means is an extensively used partition-based clustering technique proposed by MacQueen. Partitioning can be done based on minimizing the objective function known as square error [47] which can be calculated as follows:where , “c,” and “” represented Euclidean distance, number of cluster centers, and the number of points in cluster, respectively. K-means was considered by Li et al. [42] for the clustering of the color structure. K-means is a relatively simple and computationally efficient algorithm. However, it suffers from the restriction of requiring human interaction for selecting the number of clusters, which provides easy implementation and effective results. Results are influenced by the initialization and may affect the performance of the tone mapping algorithm. Furthermore, K-means is sensitive to the cluster with a single data point due to its square distance [48].

3.2. Fast Search and Find of Density Peak

Fast search and find of density peak (FSFDP) [46] assumes that the density of data at the center of a cluster is relatively high and the center of one cluster is far away from the center of another cluster. Based on this assumption, FSFDP calculates the number of clusters and their centers automatically. Moreover, it detects and removes outliers intuitively. Clusters of nonspherical shape are easy to be recognized using FSFDP. In FSFDP, the cutoff distance used for calculating the density of each data point has a great influence on the effectiveness of FSFDP. For a data point , FSFDP calculates local density, , and distance, , from its nearest center as follows:where , denotes the distance from data point to j and is cutoff distance used to calculate the density of each data point. For assigning a data point to the nearest cluster center, distance is calculated as

Equations (2) and (3) represent that the cluster centers are points with greater distance “δ” from other cluster centers and high data density “ρ.” The fast search and find of density peak is further experimented on two scale implementations [42] and represented as two-scale fast search and find of density peak (TFSFDP).

3.3. Gaussian Mixture Model

Unlike K-means clustering, Gaussian Mixture Model (GMM) [44] allows clusters of different shapes. The cluster orientation is dependent on the Gaussian distribution. GMM sets the k number of Gaussians according to the data distribution. GMM learns the cluster belonging through the probability of each data point using its parameters such as variance , mean , and weight of the cluster . Mathematically, it is computed by using

GMM allows cluster overlapping; however, it is computationally extensive. Therefore, GMM is not applicable for high-dimensional data. Moreover, GMM is dependent on Gaussian distribution (clusters).

3.4. Density-Based Spatial Clustering of Applications with Noise

Similar to FSFDP, Density-Based Spatial Clustering of Application with Noise (DBSCAN) [45] is a density-based clustering algorithm that does not require the number of clusters as an initial parameter. DBSCAN identifies the clusters of various shapes and sizes based on data connectivity. Furthermore, DBSCAN is widely adopted because of its efficient computation. However, the algorithm of DBSCAN depends on the initial radius “r” of the cluster as follows:

If the value of the radius is set to be small, all points that belong to the sparse cluster are considered as noise. On the other hand, if the radius is set to be large, all points lie within a single cluster. Therefore, to obtain appropriate results, the algorithm is executed for a number of times with different values of “r.”

4. Experiments and Results

This section describes the details of the dataset and the evaluation criteria used in our experiments. As different clustering methods have different parameters, the details of these are discussed in parameter setting section. The focus is to elaborate the influence of different state-of-the-art clustering algorithms on clustering-based content and color adaptive tone mapping algorithm, which is examined in performance and effectiveness section.

4.1. Dataset and Evaluation Criteria

For the training phase, Kodak’s database [49] is used, which consists of a total of 24 images of size of 512 × 768 × 3. All images are of true color (24 bits per pixel) and, for tone mapping, these images are used as standard set suit [49]. In the testing phase, we performed a series of experiments on Fun and Shi [50] HDR dataset to evaluate the influence of different clustering algorithms on clustering-based content and color adaptive tone mapping [42]. This dataset contains both indoor and outdoor HDR images of 105 scenes captured through Nikon D700 digital camera. Sample images from the dataset are shown in Figure 1.

We compared the results of different clustering algorithms both qualitatively and quantitatively. Tone mapping operators attempt to preserve desirable characteristics, including local structure and naturalness, and to avoid the halo artifacts while converting an HDR image into LDR images. The classical evaluation parameters for objective measurements like PSNR cannot be used for the evaluation of tone mapping due to the unavailability of reference LDR images. So, we used two metrics for quantitative evaluation of dynamic range reduction with different clustering techniques: tone-mapped image quality index (TMQI) [51] and feature similarity index for tone-mapped images (FSITM) [52]. TMQI [51] is used to compute the structural resemblance and indexes of naturalness, and FSITM [52] is to measure the local phase similarity between HDR and LDR images.

4.2. Parameters Setting

Appearance regeneration of an image is dependent not only on the intensity relationship but also on many local weighted attributes including brightness, contrast, gray level, and color relationship. Clustering-based content and color adaptive tone mapping [42] is a patch base model in which the size and shape of the patch depend upon the window used for the calculation of mean and color structure. In this study, we have used the default window with size of 7 × 7 as defined by Li et al. [42]. We have used default values of the control parameter for color appearance, local structure, and luminance within the tone mapping process as used by [42].

For clustering algorithms, the control parameters are set with the most optimal values. The details of these parameters for each clustering method are as follows.

4.2.1. For K-means

For K-means clustering, the number of clusters is initially set to be 100.

4.2.2. For Fast Search and Find of Density Peak

For fast search and find of density peak, cut-off distance “” given in equation (2) is significant to be set. However, varying its default value that is “1.4141” has no difference in objective evaluation as shown in Table 1; therefore we set it as 1.4141.

4.2.3. For Density-Based Spatial Clustering of Applications with Noise

Furthermore, for DBSCAN, we execute the algorithm several times to get to the appropriate value of “r” as mentioned in equation (5). On the default value of “r,” which is 10 for DBSCAN, the algorithm considers sparse datapoints as noise and therefore selected value of “r” to be 0.2.

4.2.4. For Gaussian Mixture Model

For GMM, we used the default value of Gaussian distribution “k” in equation (4) as (2). The experimentation shows that the different values of Gaussian distribution have none or little effect on objective evaluation. However, Gaussian distribution’s larger values cause high computational cost. This is illustrated in Figure 2.

4.3. Performance and Effectiveness

4.3.1. Objective Evaluation

Tables 2 and 3 present the results of different clustering techniques applied with the method of [42] in terms of TMQI and FSITM, respectively. The best results are highlighted in both tables. Green, blue, and yellow numbers represent the first, second, and third best scores, respectively; likewise red number represents the worst score. The effectiveness of tone mapping operators depends upon the contrast, brightness, and local structure of HDR image scenes. So, a tone mapping operator cannot be equally effective for all HDR images [53]. Table 2 depicts that TFSFDP performs best for 9 images; however, considering the average of each method, K-means and FSFDP can be used alternatively. Table 3 has strengthened the results further, as FSITM shows that TFSFDP performs best, while K-means and FSFDP stood in the second and third positions, respectively. Furthermore, DBSCAN performs worst in terms of both FSITM and TMQI for every image. Based on the obtained results, DBSCAN is not recommended for tone mapping.

Performance of clustering-based tone mapping techniques is also compared in terms of their execution time. The execution times of different clustering-based tone mapping techniques are presented in Figure 3, which highlights that GMM has high computation cost irrespective of the provided TMQI and FSITM results. Therefore, it is not a preferred clustering algorithm to be used for tone mapping operation. In terms of fastest execution time, K-means outperforms the other methods with least execution time of about “6.598 seconds,” whereas DBSCAN and FSFDP can also be considered for tone mapping operation as their execution times are about “11.31 seconds” and “12.218 seconds,” respectively.

4.3.2. Subjective Evaluation Assessment

Subjective evaluation is performed through visual assessment and scoring. Figures 4 and 5 exhibit a visual comparison of clustering-based techniques using tone-mapped indoor and outdoor scene images. FSFDP, TFSFDP, and K-means produced the visually appealing results as these clustering methods better preserve the local structure and color saturation as shown in Figures 4(a)–4(c) and Figures 5(a)–5(c). In case of FSFDP, minor details like clouds near the shaded corner shown in Figures 4(a) and 4(b) and wood pattern of cutting board as in Figures 5(a) and 5(b) remain better preserved than K-means that can be clearly illustrated from Figures 4(c) and 5(c). GMM suffers from information loss and unpleasant effect. In Figures 4(d) and 5(d), details on a glass of the window and shelve are not visible. In case of DBSCAN, colors are oversaturated and result in unnatural visual appearances of image as depicted in Figures 4(e) and 5(e).

(a)

(b)

(c)

(d)

(e)

(a)

(b)

(c)

(d)

(e)

Subjective evaluation of 12 images is performed by 8 volunteers currently working on image processing and machine learning. We used a monitor with a spatial resolution of 2560 × 1600 to display images, side by side using the image viewer customizable window. We showed the resultant images of all methods to volunteers and asked them to score image from 1 to 10. “1” represents the worst score, while “10” is the highest score. Ratings are recorded by using score sheets provided to each volunteer during the subjective assessment. Figure 6 shows that, for most of the images, FSFDP has the highest averaged score.

5. Conclusion

Tone mapping is a complex field in which the conversion of HDR image to LDR image without information loss is needed. The intention of this article is to present the best clustering technique among existing techniques for preserving complex local details lost in case of clustering-based content and color adaptive tone mapping method. For this purpose, the influence of different clustering techniques is examined. The effectiveness is measured in terms of subjective evaluation and FSITM and TMQI values. Experiments show that fast search and find of density peak results in more appealing results for tone mapping with acceptable computational cost. In the future, this model can be extended by using a feature other than color structure for clustering of patches. Besides, any other function in place of S shape arctan curve can be used for range compression.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

References

J. Tumblin and H. Rushmeier, “Tone reproduction for realistic images,” IEEE Computer Graphics and Applications, vol. 13, no. 6, pp. 42–48, 1993.
View at: Publisher Site | Google Scholar
G. Ward, “A contrast-based scalefactor for luminance display,” in Graphics Gems, vol. 4, pp. 415–421, Elsevier, Amsterdam, Netherlands, 1994.
View at: Publisher Site | Google Scholar
F. Drago, K. Myszkowski, T. Annen, and N. Chiba, “Adaptive logarithmic mapping for displaying high contrast scenes,” Computer Graphics Forum, vol. 22, no. 3, pp. 419–426, 2003.
View at: Publisher Site | Google Scholar
M. H. Kim and J. Kautz, “Consistent tone reproduction,” in Proceedings of the Proceedings of Computer Graphics and Imaging, Innsbruck, Austria, February 2008.
View at: Google Scholar
E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, “Photographic tone reproduction for digital images,” ACM Transactions on Graphics (TOG), vol. 21, no. 3, pp. 267–276, 2002.
View at: Publisher Site | Google Scholar
E. Reinhard and K. Devlin, “Dynamic range reduction inspired by photoreceptor physiology,” IEEE Transactions on Visualization and Computer Graphics, vol. 11, no. 1, pp. 13–24, 2005.
View at: Publisher Site | Google Scholar
I. R. Khan, S. Rahardja, M. M. Khan, M. M. Movania, and F. Abed, “A tone-mapping technique based on histogram using a sensitivity model of the human visual system,” IEEE Transactions on Industrial Electronics, vol. 65, no. 4, pp. 3469–3479, 2018.
View at: Publisher Site | Google Scholar
J. Han, I. R. Khan, and S. Rahardja, “Lighting condition adaptive tone mapping method,” in Proceedings of the ACM SIGGRAPH 2018 Posters on—SIGGRAPH’18, pp. 1-2, Vancouver, Canada, August 2018.
View at: Publisher Site | Google Scholar
D. Lischinski, Z. Farbman, M. Uyttendaele, and R. Szeliski, “Interactive local adjustment of tonal values,” in ACM Transactions on Graphics, vol. 25, no. 3, pp. 646–653, ACM, 2006.
View at: Publisher Site | Google Scholar
D.-H. Lee, M. Fan, S.-W. Kim, M.-C. Kang, and S.-J. Ko, “High dynamic range image tone mapping based on asymmetric model of retinal adaptation,” Signal Processing: Image Communication, vol. 68, pp. 120–128, 2018.
View at: Publisher Site | Google Scholar
B. Gu, W. Li, M. Zhu, and M. Wang, “Local edge-preserving multiscale decomposition for high dynamic range image tone mapping,” IEEE Transactions on Image Processing, vol. 22, no. 1, pp. 70–79, 2013.
View at: Publisher Site | Google Scholar
D. Min, S. Choi, J. Lu, B. Ham, K. Sohn, and M. N. Do, “Fast global image smoothing based on weighted least squares,” IEEE Transactions on Image Processing, vol. 23, no. 12, pp. 5638–5653, 2014.
View at: Publisher Site | Google Scholar
Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, “Edge-preserving decompositions for multi-scale tone and detail manipulation,” ACM Transactions on Graphics (TOG), vol. 27, no. 3, ACM, 2008.
View at: Publisher Site | Google Scholar
S. Paris, S. W. Hasinoff, and J. Kautz, “Local Laplacian filters,” Communications of the ACM, vol. 58, no. 3, pp. 81–91, 2015.
View at: Publisher Site | Google Scholar
L. Xu, C. Lu, Y. Xu, and J. Jia, “Image smoothing via L 0 gradient minimization,” in ACM Transactions on Graphics (TOG), vol. 30, no. 6, p. 174, ACM, 2011.
View at: Publisher Site | Google Scholar
L. Xu, Q. Yan, Y. Xia, and J. Jia, “Structure extraction from texture via relative total variation,” ACM Transactions on Graphics (TOG), vol. 31, no. 6, p. 139, 2012.
View at: Publisher Site | Google Scholar
F. Durand and J. Dorsey, “Fast bilateral filtering for the display of high-dynamic-range images,” ACM Transactions on Graphics (TOG), vol. 21, no. 3, ACM, 2002.
View at: Publisher Site | Google Scholar
P. Debevec and S. Gibson, “A tone mapping algorithm for high contrast images,” in Proceedings of the 13th Eurographics Workshop on Rendering, Pisa, Italy, June 2002.
View at: Google Scholar
J. Kuang, G. M. Johnson, and M. D. Fairchild, “iCAM06: a refined image appearance model for HDR image rendering,” Journal of Visual Communication and Image Representation, vol. 18, no. 5, pp. 406–414, 2007.
View at: Publisher Site | Google Scholar
S. Tong and Y. Yang, “A novel tone mapping algorithm,” in Proceedings of the 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), pp. 427–431, IEEE, Chongqing, China, May 2019.
View at: Publisher Site | Google Scholar
G. Krawczyk, K. Myszkowski, and H. P. Seidel, “Lightness perception in tone reproduction for high dynamic range images,” Computer Graphics Forum, vol. 24, no. 3, pp. 635–645, 2005.
View at: Publisher Site | Google Scholar
Y. Li, L. Sharan, and E. H. Adelson, “Compressing and companding high dynamic range images with subband architectures,” ACM Transactions on Graphics, vol. 24, no. 3, pp. 836–844, 2005.
View at: Publisher Site | Google Scholar
Y. Jia and W. Zhang, “Efficient and adaptive tone mapping algorithm based on guided image filter,” International Journal of Pattern Recognition and Artificial Intelligence, vol. 34, no. 4, p. 2054012, 2020.
View at: Publisher Site | Google Scholar
L. Meylan, D. Alleysson, and S. Süsstrunk, “Model of retinal local adaptation for the tone mapping of color filter array images,” Journal of the Optical Society of America A, vol. 24, no. 9, pp. 2807–2816, 2007.
View at: Publisher Site | Google Scholar
X.-S. Zhang, K.-F. Yang, J. Zhou, and Y.-J. Li, “Retina inspired tone mapping method for high dynamic range images,” Optics Express, vol. 28, no. 5, pp. 5953–5964, 2020.
View at: Publisher Site | Google Scholar
C. A. Parraga and X. Otazu, “Which tone-mapping operator is the best? A comparative study of perceptual quality,” Journal of the Optical Society of America A, vol. 35, no. 4, pp. 626–638, 2018.
View at: Publisher Site | Google Scholar
H. T. Chen, T. L. Liu, and C. S. Fuh, “Tone reproduction: a perspective from luminance-driven perceptual grouping,” International Journal of Computer Vision, vol. 65, no. 1-2, pp. 73–96, 2005.
View at: Publisher Site | Google Scholar
Z. Liang, W. Liu, and R. Yao, “Contrast enhancement by nonlinear diffusion filtering,” IEEE Transactions on Image Processing, vol. 25, no. 2, pp. 673–686, 2016.
View at: Publisher Site | Google Scholar
M. K. Ng and W. Wang, “A total variation model for Retinex,” SIAM Journal on Imaging Sciences, vol. 4, no. 1, pp. 345–365, 2011.
View at: Publisher Site | Google Scholar
H. Ahn, B. Keum, D. Kim, and H. S. Lee, “Adaptive local tone mapping based on retinex for high dynamic range images,” in Proceedings of the 2013 IEEE International Conference on Consumer Electronics (ICCE), pp. 153–156, IEEE, Las Vegas, NV, USA, January 2013.
View at: Publisher Site | Google Scholar
Z. Liang, J. Xu, D. Zhang, Z. Cao, and L. Zhang, “A hybrid l1-l0 layer decomposition model for tone mapping,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4758–4766, Salt Lake City, UT, USA, June 2018.
View at: Publisher Site | Google Scholar
B. J. Lee and B. C. Song, “Local tone mapping using sub-band decomposed multi-scale retinex for high dynamic range images,” in Proceedings of the 2014 IEEE International Conference on Consumer Electronics (ICCE), pp. 125–128, Las Vegas, NV, USA, January 2014.
View at: Publisher Site | Google Scholar
X. Shu and X. Wu, “Locally adaptive rank-constrained optimal tone mapping,” ACM Transactions on Graphics (TOG), vol. 37, no. 3, pp. 1–10, 2018.
View at: Publisher Site | Google Scholar
A. Rana, G. Valenzise, and F. Dufaux, “Learning-based adaptive tone mapping for keypoint detection,” in Proceedings of the 2017 IEEE International Conference on Multimedia and Expo (ICME), pp. 337–342, Hong Kong, China, July 2017.
View at: Publisher Site | Google Scholar
D. M. El Mezeni and L. V. Saranovac, “Enhanced local tone mapping for detail preserving reproduction of high dynamic range images,” Journal of Visual Communication and Image Representation, vol. 53, pp. 122–133, 2018.
View at: Publisher Site | Google Scholar
S. A. Henley, “Rendering of high dynamic range images,” U.S. Patent No. 7,480,421, U.S. Patent and Trademark Offic, Washington, DC, USA, 2009.
Z. Li and J. Zheng, “Visual-salience-based tone mapping for high dynamic range images,” IEEE Transactions on Industrial Electronics, vol. 61, no. 12, pp. 7076–7082, 2014.
View at: Publisher Site | Google Scholar
S. Ferradans, M. Bertalmio, E. Provenzi, and V. Caselles, “An analysis of visual adaptation and contrast perception for tone mapping,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 2002–2012, 2011.
View at: Publisher Site | Google Scholar
P. Ambalathankandy, M. Ikebe, T. Yoshida et al., “An adaptive global and local tone mapping algorithm implemented on FPGA,” IEEE Transactions on Circuits and Systems for Video Technology, 2019.
View at: Publisher Site | Google Scholar
A. Mehmood, I. R. Khan, D. Hassan, and D. Hussain, “Enhancement of CT images for visualization,” in Proceedings of the ACM SIGGRAPH 2019 Posters, vol. 83, pp. 1-2, New York, NY, USA, July 2019.
View at: Publisher Site | Google Scholar
A. Rana, P. Singh, G. Valenzise, F. Dufaux, N. Komodakis, and A. Smolic, “Deep tone mapping operator for high dynamic range images,” IEEE Transactions on Image Processing, vol. 29, pp. 1285–1298, 2019.
View at: Publisher Site | Google Scholar
H. Li, X. Jia, and L. Zhang, “Clustering based content and color adaptive tone mapping,” Computer Vision and Image Understanding, vol. 168, pp. 37–49, 2018.
View at: Publisher Site | Google Scholar
D. Ellis, Tone Mapping for High Dynamic Range Cameras, Department of Engineering Science Oxford University, Oxford, UK, 2008, http://www.robots.ox.ac.uk/∼dre/docs/ellis_d_stj_4yp.pdf.
Clustering with Gaussian mixture model—clustering with Gaussian mixture model—medium, 2018, https://medium.com/clustering-with-gaussian-mixture-model/clustering-with-gaussian-mixture-model-c695b6cd60da.
M. Ester, H. P. Kriegel, J. Sander, and X. Xu, “A density-based algorithm for discovering clusters in large spatial databases with noise,” Computer Science, vol. 96, no. 34, pp. 226–231, 1996.
View at: Google Scholar
A. Rodriguez and A. Laio, “Clustering by fast search and find of density peaks,” Science, vol. 344, no. 6191, pp. 1492–1496, 2014.
View at: Publisher Site | Google Scholar
S. A. Elavarasi, J. Akilandeswari, and B. Sathiyabhama, “A survey on partition clustering algorithms,” International Journal of Enterprise Computing and Business Systems, vol. 1, no. 1, 2011.
View at: Google Scholar
S. K. Popat and M. Emmanuel, “Review and comparative study of clustering techniques,” International Journal of Computer Science and Information Technologies, vol. 5, no. 1, pp. 805–812, 2014.
View at: Google Scholar
http://r0k.us/graphics/kodak/, 2018.
B. Funt and L. Shi, “HDR dataset,” 2018, http://www.cs.sfu.ca/∼colour/data/funt_hdr/.
View at: Google Scholar
H. Yeganeh and Z. Wang, “Objective quality assessment of tone-mapped images,” IEEE Transactions on Image Processing, vol. 22, no. 2, pp. 657–667, 2013.
View at: Publisher Site | Google Scholar
H. Z. Nafchi, A. Shahkolaei, R. F. Moghaddam, and M. Cheriet, “FSITM: a feature similarity index for tone-mapped images,” IEEE Signal Processing Letters, vol. 22, no. 8, pp. 1026–1029, 2015.
View at: Publisher Site | Google Scholar
K. Gu, S. Wang, G. Zhai et al., “Blind quality assessment of tone-mapped images via analysis of information, naturalness, and structure,” IEEE Transactions on Multimedia, vol. 18, no. 3, pp. 432–443, 2016.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Maleeha Javed et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

533

Downloads

914

Citations