Multiband Polarization Imaging

Zhao, Yongqiang; Peng, Qunnie; Yi, Chen; Kong, Seong G.

doi:https://doi.org/10.1155/2016/5985673

Journal of Sensors

On this page

Abstract Introduction Conclusion Acknowledgments References Copyright Related Articles

Special Issue

Multispectral, Hyperspectral, and Polarimetric Imaging Technology

View this Special Issue

Review Article | Open Access

Volume 2016 | Article ID 5985673 | https://doi.org/10.1155/2016/5985673

Multiband Polarization Imaging

Yongqiang Zhao,¹Qunnie Peng,¹Chen Yi,¹and Seong G. Kong²

Academic Editor: Stefania Campopiano

Received26 Dec 2014

Revised08 Apr 2015

Accepted15 Apr 2015

Published16 Nov 2015

Abstract

Multiband polarization imaging is an emerging sensing method that enables simultaneous acquisition of multiband spectral and multiangle polarization information of an object of interest in the scene. Spectral signatures of the light reflected from a target reveal the characteristics of the material composing the target while polarized light provides useful information on the surface features such as light scattering and specular reflection. In multiband spectral imaging, combined spectral and polarization information offers a comprehensive representation of an object utilizing complementary spectral and polarization information in visual sensing. Multiband polarization imaging has demonstrated a potential in the recognition of targets in challenging operating environments such as low-contrast and hazy conditions. This paper presents the concept and recent advances of multiband polarization imaging techniques, in particular, a bioinspired multiband polarization vision system. Applications of multiband polarization imaging in various fields include atmospheric observation, object detection and classification, medical diagnostics, surveillance, and 3D object reconstruction.

1. Introduction

An electromagnetic wave of light reflected from an object carries the signatures that characterize the object such as light intensity as a function of wavelength or spectrum, transmission directions, and the plane of polarization. Reflectance of absorption patterns of the spectrum describes material compositions of a target object, serving as a useful signature for target detection and classification. As a combined technique of spectroscopy and photography, spectral imaging observes spectral response of an object in different wavelengths at every location in an image plane. Spectral imaging acquires multiple images of a scene in different spectral bands. According to some criteria such as spectral resolution, number of spectral bands, and contiguousness of bands, spectral imaging techniques exist in several terms such as multispectral imaging and hyperspectral imaging, often in the visible and infrared regions of electromagnetic spectrum. Spectroscopic analysis has been used to identify the features inherent to the object of interest through measurement and analysis of electromagnetic spectra produced by reflection or absorption. Polarization is a property of transversal waves that can oscillate with more than one orientation. Light can be approximated as a plane wave and propagates as a transverse wave, in which both the electric and magnetic fields are perpendicular to the direction of propagation. In linear polarization, the oscillation of these fields takes place in a single direction. A polarizer is an optical filter that transmits only one polarization direction. Imaging in different polarization angles has been employed to capture unique surface features of an object. The amount and orientation information of polarization have been of great significance to enhance discriminating power of vision-based detection and classification systems.

Recently there have been growing interests in multiband polarization imaging techniques to take advantage of both polarization and spectral signatures in various computer vision tasks. Multiband polarization imaging offers several advantages over conventional imaging techniques in sensing and analysis of objects in challenging environments. Multiband polarization imaging measures the intensity of the light reflected from the object in multiple spectral bands and multiple polarization angles to capture comprehensive optical characteristics of an object of interest in the scene. Combined spectral and polarization information gives a complete representation of an object in terms of the material compositions as well as surface characteristics. In multiband polarization imaging, spatial, spectral, and polarization information are simultaneously acquired [1]. Spatial, spectral, and polarization information reveal the different characteristics of a material. It has been demonstrated that spatial-spectral information (spectral imagery) or spatial-polarization information (polarization imagery) provides improved classification accuracies [2–4]. Multiband polarization imaging provides an effective means to observe surface characteristics as well as material properties of an object in the scene, which may not be readily obtained using conventional imaging techniques. Polarization information finds surface properties of an object such as diffuse or specular reflection, scattering, and refractive index. Spectral signatures of an object measured in different spectral bands are used to characterize the types of materials.

Multiband polarization vision has gained significant interests in both biological and computer vision research communities [5] from the observations that some biological organisms in the nature demonstrate multiband polarization vision capabilities. Mantis shrimp and dragonfly are known to be able to easily detect and catch even transparent prey utilizing combined spectral and polarization information. They detect and recognize hidden or camouflaged objects or easily navigate through the water using the difference in polarization properties of the target and the background [2–4]. A compound eye of such organisms consists of tens of thousands of individual imaging units called ommatidia with effective imaging field-of-view of nearly 360 degrees. Each ommatidium responds to the light in different spectral bands as well as polarization angles. A unique structure of ommatidia in the eyes of mantis shrimp, squid, cuttlefish, and dragonfly is highly sensitive to polarized lights. In addition, the compound vision system demonstrates parallel processing capabilities that exist from retina to all ganglions [6, 7]. According to the studies on such organisms, a group of ommatidia are found in the dorsal rim area (DRA) of a compound eye. The DRAs of different organisms are known to have similar physiological characteristics. Every ommatidium contains two homochromatic photoreceptors that are orthogonal to each other. The photoreceptors in different ommatidia are sensitive to the light of different polarization angles [7–9]. Studies also indicate that the optic nerve systems of those organisms have particular polarization coding ability. From the research on retina in ommatidium of mantis shrimp and squid, the rhabdom and retinular cells have spectral perception ability from 300 nm to 700 nm with a perception bandwidth from 30 nm to 60 nm [10]. Mantis shrimp has 12 photoreceptors, each sampling a narrow set of wavelengths ranging from deep ultraviolet (300 nm) to far red (720 nm). Compared to three photoreceptors of the human visual system, those organisms can sense the light in a wider spectral region than humans do. Each type of photoreceptors is sensitive to a specific color. Mantis shrimp’s color vision system is based on temporal signaling combined with scanning eye movements, enabling color recognition rather than discrimination without brain-power-heavy comparisons [11]. This scheme probably gives the predatory shrimp a speed advantage in distinguishing prey with different color from cluttered background under changing light conditions [12]. In addition, the ommatidium in the hemisphere of the eye can identify the luminance, which acts as panchromatic imaging. Based on such physiological structures and functions, the organisms demonstrate multiband polarization vision in high resolution [13]. Multiband polarization vision system can be implemented based on the model of a cluster of ommatidia, where each ommatidium senses spectral or polarization information of the scene radiance in a particular spectral band or polarization angle.

Applications of multiband polarization imaging in object classification and clustering have demonstrated the effectiveness of multiband polarization imaging techniques. The variations of polarization parameters with wavebands are closely linked to the physiochemical characteristics of materials. Different inherent properties can enhance object discrimination and classification even when no obvious intensity difference exists. The measurement of Fresnel reflection coefficients in multiple bands can quantitatively assess the conductive characteristics to retrieve the dielectric constants, which provides good detectability of conductors and insulators. Roughness and surface orientation can be reflected in the spectral polarization parameters, which is critical for inhomogeneous objects identification [14]. Multiband polarization imaging has demonstrated enhanced target detection and navigation in military applications [15, 16]. Medical diagnosis with cytometry imaging and tissue assessment [17, 18] and the other applications including the measurement of aerosol density in the atmosphere [19, 20], geological exploration of glacier and vegetation distribution [21, 22], image dehazing [23–25], land cover classification [26], pathologic diagnosis of epithelial tissues [27], and visualization of an object hidden in the shadow [28] are application examples to name a few. Section 4 introduces some of popular application examples such as atmospheric observation, earth remote sensing, medical diagnosis, surveillance and reconnaissance, dehazing, and 3D reconstruction of specular objects.

2. Multiband Polarization Imaging Principles

Multiband polarization imaging techniques capture spectral and polarization information inherent to the properties of a target. We analyze multiband polarization image data to distinguish the differences in spectropolarimetric information among different objects. Spectral imaging attempts to measure intensity distribution of the light over different wavelengths while polarization imaging finds intensity of the image in different polarization directions. Figure 1 illustrates a hierarchy of multiband polarization imaging techniques. Two major steps to ensure precise multiband polarization imaging are spectral tuning and polarization adjustment. Multiband polarization imaging techniques obtain spectral information based on dispersion, channel tuning, or interference. Polarization information can be measured by rotating polarizer or micropolarization array. Images of different spectral bands and polarization angles are captured in sequence, which cannot satisfy time-sensitive imaging requirement.

2.1. Spectral Tuning

Spectral imaging combines photography and spectroscopy to generate image data whose picture element (pixel) is associated with a spectral signature (spectrum). The spectral information provided by this pixel is valuable in the discrimination, detection, and classification of elements and structures within the image [29]. Each pixel in a spectral image is typically composed of narrow spectral bands of the electromagnetic spectrum. A spectral image constitute a 3D data cube in two spatial coordinates and one spectral dimension where denotes the number of spectral bands. Spectral imaging has the ability to exploit multiple regions of the electromagnetic spectrum to probe and analyze the composition of a material. The materials comprising various objects in a scene reflect, absorb, and emit electromagnetic radiation in amounts that vary with the wavelength. If the radiation arriving at the sensor is measured over a spectral range, the resulting spectral signature can be used to uniquely characterize and identify any given material. Spectral feature of a pixel in a spectral image is compared to a database of known materials to determine the type of the material of the pixel.

In general, spectral components can be extracted using filters or devices with a function of spectral separation. Conventional spectral tuning methods include prism, mechanical filter wheel, diffraction grating, interference Fourier transform, and tomography [30, 31]. A flexible and programmable filtering elements such as acoustooptic tunable filter (AOTF) and liquid crystal tunable filter (LCTF) have been popular in spectral imaging. Multiband polarization imagers [2] collect spectral information using conventional methods such as diffraction grating, interference Fourier transform, and tunable filters and measure polarization information using optical polarizers. A multiband polarization imager using a single camera equipped with an LCTF and a polarizer wheel was proposed to capture simultaneously spectral and polarization information [21]. This imager obtains spectral information by sequentially tuning the center frequency of a bandpass characteristic of LCTF in different spectral bands and a set of component images of different polarization angles by rotating the polarizer in a filter wheel using a stepper motor. Such multiband polarization imaging techniques that capture spectral and polarization information separately and individually in sequence tend to be time consuming and require complicated optical, mechanical, and electronic devices. A multiband polarization imager was built for navigation with a constant-gain omnidirectional mirror, an UV camera, and a color camera [32]. The goal was to measure the polarization pattern of the sky. The images in different polarization angles are captured in sequence, with large distortion due to the omnidirectional mirror. Such types of polarization imagers may not capture moving objects due to slow response time. In the beam splitting method, the camera can only measure one-third of the input energy with a difficulty to acquire multiband polarization information.

Compared with conventional optical imaging methods, spectral imaging techniques have access to spectral resolution, spatial resolution, radiative resolution, and time resolution of a target. The four resolutions enable reflecting the intrinsic spectral signatures of a target and distinguish the spectral differences among variable objects. Various spectral tuning methods being used in multiband polarization imaging systems are listed as Table 1.

2.2. Polarization Adjustment

Polarization is an important physical quantity describing the physicochemical properties of an object during the interaction of reflection, scattering, and transmission with solar radiation. Polarization imaging acquires multiple images in different polarization angles with abundant spectral information to improve the discrimination capability. Polarization imaging techniques have demonstrated such advantages as high signal-to-noise ratio and strong contrast over conventional optical imaging methods [33, 34]. Polarization imaging techniques have been successfully utilized in remote sensing and computer vision fields [34, 35].

Polarization features of an object are usually represented using the Jones vector, Stokes vector, and Muller matrix [56]. Strategies such as rotating polarizer, splitter, and division of FPA have been utilized to modulate polarization states [57]. Instantaneous acquisition of the Stokes parameters is of great importance in polarization imaging research. Multiband polarization imagery represents spatial, spectral, and polarization information of an object using four Stokes parameters describing the state of polarization in multiple bands. Suppose an object was images at four different polarization directions, 0, 45, 90, and 135 degrees at a certain wavelength . Let , , , and denote the four image components measured at different polarization angles by rotating the polarizer to different orientations. Then the Stokes vector at wavelength is given bywhere is the total intensity of light at wavelength , donates the difference between the light intensity at 0° and 90°, represents the difference between 45° and 135° linear components, and is the circular right to left polarization state. Circular polarization component of a ground scene tends to be small, and therefore is often negligible [57]. When a linear polarization analysis is taken into account, the degree of linear polarization (DoLP) can be represented by a fraction of intensity attributed to the polarized light state as [34]

Polarization angle (Orient) indicates the angle of major axis of polarization ellipse with respect to the reference direction (-axis)

Joint spatial, spectral, and polarization information can be represented by seven independent variables: spatial coordinates , wavelength , and polarization angles (, , , ). Based on the mathematic description of polarization, multiples images are required to characterize the polarization states of scenes. With the advance of photodetectors, there are a number of strategies to capture polarization signatures [21, 57]. Table 2 shows strategies of polarization adjustment.

3. Multiband Polarization Imaging Systems

Inspired by the vision mechanism of some biological organisms, we developed a multiband polarization imaging system. The multiband polarization imager consists of a 3-by-3 array of CCD cameras, where each camera is equipped with either a color filter or an optical polarizer. An individual camera was set to capture an image in a certain spectral band or a polarization angle. This imager is to capture multiple images of the same scene in different spectral bands and polarization angles simultaneously for tasks such as target detection, so a large amount of geometrical distortion is not acceptable. Figure 2 shows a schematic diagram of the proposed multiband polarization imager for the acquisition of multiband spectral and polarization information from the scene. We use an optical polarizer to simulate the photoreceptor that is sensitive to the polarized light. The rhabdom and retinular cells having spectral sensing ability are simulated by a spectral bandpass filter to obtain multiband spectral image data. A 9-way gigabit ethernet card processes multiband spectral and polarization image data in parallel. This imager is configured to have five cameras with five color filters in the spectral bands of red, green, blue, yellow, and orange and four cameras with four optical polarizers of 0, 45, 90, and 135 degrees.

Figure 3 shows physical appearance of a prototype multiband polarization imaging system and the configuration of component cameras. For the sake of simplicity in implementation, nine () component CCD cameras are arranged in a 3-by-3 rectangular array rather than a hexagonal array as in the compound eye of an insect eye. Each camera is equipped with a color filter or a polarizer. Table 3 shows the arrangement of nine individual component cameras. To measure the polarization information with less noise or error, polarizers with four polarization angles of 0°, 45°, 90°, and 135° are used, mounted on the camera positions of , , , and . The spectral bandpass filters of red (600–700 nm), orange (590–610 nm), yellow (570–590 nm), green (490–570 nm), and blue (450–490 nm) measure the spectral information in five bands in the visible spectrum, mounted on the camera positions of , , , , and respectively. An industrial CCD camera (Basler Ace 1300, 30 gm) of dimension 42 mm × 29 mm × 29 mm () was used for each component camera. A large amount of image data coming from nine CCD cameras is processed and transmitted in parallel using 9-channel gigabit ethernet. An optical lens with the focal length of 16 mm, viewing angles of 38° (diagonal), 30.8° (horizontal), and 23.4° (vertical) was used in all the cameras. For a cooling purpose, CCD cameras are arranged with a gap of 22 mm.

(a)

(b)

Unlike sequential imaging process of conventional multiband polarization imagers, the proposed imager can capture simultaneously a set of images of the scene in multiple spectral bands as well as different polarization angles. Spectral and polarization information is extracted using color filters and optical polarizers. Multiband spectral and polarization information can be measured in the common FOV region that is viewed by all the component cameras. Due to the different viewing angles of each component camera and the resulting mismatch in the FOV, the spectral and polarization information is not complete in nonoverlapping, boundary region. This will reduce the effective FOV of the multiband polarization imager. To expand the FOV, missing spectral and polarization information in the boundary region must be recovered. An attempt has been made to estimate the missing spectral and polarization information in the expanded FOV using the low-rank matrix recovery method [43, 44] that exploits the redundancy and correlation of the measured data.

4. Applications of Multiband Polarization Imaging Techniques

Multiband polarization imaging offers simultaneous acquisition of spectral and polarimetric signatures of an object for the detection of targets camouflaged or hidden in cluttered background. This technique has demonstrated improved object detection capabilities in a wide variety of applications in optical metrology that range from atmospheric science and remote sensing to 3D reconstruction. Table 4 lists some of popular application examples and the corresponding mainstream sensors and techniques used.

4.1. Atmospheric Observation

Multiband polarization imaging can be used to acquire spectral and polarization features of suspended atmospheric particles, which is useful in the correction of atmospheric distortions, climate investigation, and astronomical sensing [19]. Due to inherent polarization effect caused by the atmospheric scattering and absorption of the light, the polarization states of aerosol particles in multiple spectral bands help to discriminate distribution, category, height, density, and size of suspended particles. Spectrum of metastable atomic oxygen in the upper atmosphere can be detected, which enables accurate measurements of the atmospheric properties, such as velocity, humidity, and temperature [36].

Early atmospheric exploration using multiband polarization imaging techniques starts in 1980s. The Polarization and Directionality of the Earth’s Reflectances (POLDER) instrument has been used to obtain spectral and polarization information of aerosol to detect the atmospheric distribution, with the wavebands centered at 443 nm, 670 nm, and 865 nm [22]. Sano et al. [20] validated the accuracy of suspended particles distribution by extending the observation to six spectral bands. Airborne multiband polarimetric investigation [58] was conducted in the spectral range from 400 nm to 1000 nm. The polarization properties of aerosols with wavebands were analyzed. Li et al. [37] exploited ground-based multiband polarization data to retrieve the optical parameters of atmospheric aerosols, such as the optical density, size, polarization phase, and negative refractive index. Gartley et al. [59] explored multiband polarization detection by extending the wavebands from 200 nm to 250 nm, which enables achieving effective measurements of spectral aerosol absorption. Marbach et al. [38] incorporated multiview and multiangular schemes into multiband polarization imaging to resolve the directional anisotropy and the microphysical properties of aerosols. Redding et al. [60] developed an experimental multiband polarization apparatus. This setup extracts the polarization ratio and spectral features to identify the types and aggregations of aerosol particles. Distribution and density of aerosols between the two different weather conditions were successfully discriminated.

4.2. Earth Remote Sensing

Spectropolarimetric signatures of radiation energy reflected by ground targets have been applied in earth remote sensing. The joint spatial, spectral, and polarization information are more discriminative and accurate to describe the geometry and physicochemical properties of terrain targets, outperforming traditional sensing methods that capture intensity information only. The salient differences reflected in spectral polarization properties among various types of plants can be utilized to estimate the growth and the biomass of crops, plants species, and distribution and coverage area of forests [21, 22]. In earth remote sensing, exploiting spectropolarimetric differences reflected by various components like rocks and plants enables vegetation distributions. Microwave reflective and emissive characteristics of snow, water surface retrieved by the combination of spatial, spectral, and polarimetric detection, have potential applications in remote sensing, such as snowfall and rainfall parameters, sea salinity, wave height, marine pollution, oil spills, and coastline identification [61].

Recent research on red tide detection with spectral polarized radiance measurements highlights the performance of multiband polarization imaging techniques, which gives incomparable detection accuracy than conventional detection methods. By investigating spectral variation and polarization effect of phytoplankton, the red tide species discrimination was implemented [62]. Multiband polarization imaging techniques are accessible for explorations of ice caves and glaciers [63]. Geological evolution can be recurred via detecting the polarized signatures of reflectance and fluorescence spectra. With the difference of spectral polarized information reflected by sand, soil, and water radiation, multiband polarization imaging techniques reveal significant information to observe landforms and geology. Mineral distribution and composition are approachable to be detected, with the inherent spectral polarized features. Maturity and dryness can be easily discriminated. Since multiband polarization imaging provides informative ground characteristics and thereby can be a useful indicator for evaluating the state of land desertification and erosion [64].

4.3. Medical Diagnosis

Pathological changes modify birefringence and structure of the tissue, which can be measured in terms of the polarization and spectral changes of scattered light. Multiband polarization imaging has been a powerful diagnostic tool to measure the features for quantitative pathology analysis. Absorption spectra in multiple wavebands are associated with molecular aggregations and provide information on the structure of biological tissues. Reflective index affected by the pathology of cell kernel and collagen can be retrieved by polarization analysis. Therefore, the compositional characteristics of organic tissues can be detected via spectral polarimetric diagnosis, such as the size and category of cell kernel and collagen [17, 18, 39, 65].

Widely applied in medical diagnosis, multiband polarization imaging strategy is an emerging technology for cytometry imaging, due to the operational flexibility of fast spectra collections and blood density estimation [40, 41]. Complementary to traditional X-ray-based diagnosis, multiband polarization detection optimizes the assessment of bone tissue. As a nondestructive measurement of biochemical properties, multiband polarization imaging is sensitive to local changes in mineral maturity regarding the spectral polarized signatures. Those attributes make multiband polarization imaging as a potential indicator for clinical diagnosis, like fracture risk and bone damage assessment [42]. The severity of natural caries lesions on occlusal surfaces can also be resolved using the joint spectra and polarization tomography. The integrated reflectivity is acquired to monitor the mineral loss and dental decay in the occlusal pit and fissures [66]. Multiband polarization imaging is effective to diagnose organic characteristics of skin pathology. Efforts have been applied in the skin melanin cancerous melanotic nevus detection and chilblain tissue diagnosis [67].

4.4. Surveillance and Reconnaissance

Multiband polarization imaging detection proves to have prominent performance in military strikes. The identification and tracking of missiles is accomplished using spectral polarization analysis of exhaust plume and fume. A strong polarization effect caused by fume in multiple bands is likely to expose the missile routes [45, 46]. Conventional photoelectric detection often fails to distinguish man-made objects with low contrast. However, obvious differences in spectral and polarization features exist between military targets and natural objects. Multiband polarization imaging seeks to identify the geometric description of anomalous materials in cluttered background, even hidden or camouflage targets like tanks and armored vehicles under the trees [3, 4, 15, 43, 44, 47]. Multiband polarization imaging detection visually enhances the contrast of hidden targets compared to intensity-only images. With a high refractive index of the artifacts, spectral and polarization signatures from multiband polarization images fusion can be applied to ground reconnaissance and battle damage assessment [68]. On the other hand, multiband polarization detection impels the design of new type of camouflage coating materials [35]. By modulating the modality and roughness, the artifacts emit homothetic polarization spectra with natural background, which make it difficult to discriminate.

Outperforming conventional optical detections, multiband polarization imaging has particular merits in surveillance and reconnaissance. Polarization images in different spectral bands are exploited to retrieve the sea regime, which ensures sailing safety [58, 69]. Aircraft aviation often encounters difficulties in overcast conditions, due to the severe erosion and turbulence caused by the ice crystal in cirrus. Such atmospheric disturbance is disruptive to the precision of navigation. However, crystal aerosols are strongly polarized of incident radiation, and the joint spectropolarimetric signatures are flexible for the detection of cirrus aggregation, which guarantees aircraft navigation and guidance [70, 71].

4.5. Image Dehazing

Outdoor imaging in poor weather conditions such as haze and mist remains a challenging task in practice. Captured images are pervasively plagued with nontrivial degradations caused by atmospheric particles. The airlight is partially polarized and dominates in the measured radiation. Taking into account the polarization parameters of atmospheric scattering and the refinement of transmission in three visible bands, the haze effect can be effectively eliminated using multiband polarization dehazing methods [23, 48, 49]. Image details and color fidelity of the scene are remarkably improved, which is closely comparable to the original haze-free scene. Compared to prior-based image dehazing methods, multiband polarization techniques provide more accurate visual effects, due to the unique physics-based analysis of intrinsic properties of targets [50, 51]. Multiband polarization scheme has performed physics-based effectiveness in descattering and visibility enhancement in turbid media, even liquids and solids. This unified spectral polarization imaging has remarkable advantages in specific applications, such as underwater inspection, torpedo navigation, and ecology evaluation [72, 73]. Overlapping cast shadow removal can be implemented based on spectral polarization analysis [74, 75]. Unexpected highlight and flare suppression is efficiently actualized by multiband polarimetric observation.

4.6. D Reconstruction of Specular Objects

A three-dimensional (3D) reconstruction of less-textured objects with specular surfaces can be a challenging task. Due to the lack of features, classical photometric 3D reconstruction algorithms may fail to acquire dense disparity since these methods rely on precise alignments, like binocular stereo vision. A 3D shape reconstruction with multiband polarization imaging has demonstrated effectiveness in the inspection of specular objects, disregarding the texture information [52, 76]. Reflection of unpolarized light becomes partially polarized according to the dielectric index of the surface. Using the Fresnel laws, the geometrical parameters such as zenith angle and azimuth angle can be retrieved from the degree of polarization and the angle of polarization, respectively. Therefore, the normal vector is integrated to reconstruct the depth information. Refractive index differences in multiple spectra can be employed to resolve the ambiguity on the zenith angle [53, 77]. Multiband polarization technique can be employed as an alternative 3D inspection method of specular objects [54, 55]. Specular reflection component can be eliminated using polarization signatures and spectra coherence constraints, while maintaining high visual quality [78].

5. Conclusion

Multiband polarization imaging is an emerging photoelectric detection technique with the ability to simultaneously acquire spectral and polarization information from an object of interest. This paper summarizes the principles and recent advances of multiband polarization imaging techniques. A multiband polarization imaging system implemented using a 2D camera array is introduced, which is inspired by a combined spectral and polarization vision mechanism of biological organisms. A number of application examples of multiband polarization imaging techniques are presented that include atmospheric observation, earth remote sensing, medical diagnosis, surveillance and reconnaissance, image dehazing, and 3D reconstruction of specular objects.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (61371152, 61071172, and 61374162), New Century Excellent Talents Award Program from Ministry of Education of China (NCET-12-0464), China Postdoctoral Science Foundation funded project (2013M532080), the Ministry of Education Scientific Research Foundation for Overseas Study, and the Fundamental Research Funds for the Central Universities (3102015ZY045).

References

B. M. Flusche, M. G. Gartley, and J. R. Schott, “Assessing the impact of spectral and polarimetric data fusion via simulation to support multimodal sensor system design requirements,” Journal of Applied Remote Sensing, vol. 4, no. 1, Article ID 043562, 15 pages, 2010.
View at: Publisher Site | Google Scholar
Y. Zhao, Q. Pan, C. Yi, and S. G. Kong, Multiband Polarization Imaging and Applications, Springer International Publishing, 2015.
Y. Zhao, L. Zhang, D. Zhang, and Q. Pan, “Object separation by polarimetric and spectral imagery fusion,” Computer Vision and Image Understanding, vol. 113, no. 8, pp. 855–866, 2009.
View at: Publisher Site | Google Scholar
Y.-Q. Zhao, P. Gong, and Q. Pan, “Object detection by spectropolarimeteric imagery fusion,” IEEE Transactions on Geoscience and Remote Sensing, vol. 46, no. 10, pp. 3337–3345, 2008.
View at: Publisher Site | Google Scholar
L. P. Lee and R. Szema, “Inspirations from biological optics for advanced photonic systems,” Science, vol. 310, no. 5751, pp. 1148–1150, 2005.
View at: Publisher Site | Google Scholar
T. W. Cronin, N. Shashar, R. L. Caldwell, J. Marshall, A. G. Cheroske, and T.-H. Chiou, “Polarization vision and its role in biological signaling,” Integrative and Comparative Biology, vol. 43, no. 4, pp. 549–558, 2003.
View at: Publisher Site | Google Scholar
T. W. Cronin and J. Marshall, “Patterns and properties of polarized light in air and water,” Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 366, no. 1565, pp. 619–626, 2011.
View at: Publisher Site | Google Scholar
T.-H. Chiou, A. R. Place, R. L. Caldwell, N. J. Marshall, and T. W. Cronin, “A novel function for a carotenoid: astaxanthin used as a polarizer for visual signalling in a mantis shrimp,” Journal of Experimental Biology, vol. 215, no. 4, pp. 584–589, 2012.
View at: Publisher Site | Google Scholar
V. Pignatelli, S. E. Temple, T.-H. Chiou, N. W. Roberts, S. P. Collin, and N. J. Marshall, “Behavioural relevance of polarization sensitivity as a target detection mechanism in cephalopods and fishes,” Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 366, no. 1565, pp. 734–741, 2011.
View at: Publisher Site | Google Scholar
J. Marshall and S. Kleinlogel, Processing of Visual Information in Mantis Shrimps, University of Queensland, Queensland, Australia, 2007.
J. Morrison, “Mantis shrimp's super colour vision debunked,” Nature News, 2014.
View at: Publisher Site | Google Scholar
H. H. Thoen, M. J. How, T.-H. Chiou, and J. Marshall, “A different form of color vision in mantis shrimp,” Science, vol. 343, no. 6169, pp. 411–413, 2014.
View at: Publisher Site | Google Scholar
T. W. Cronin, N. J. Marshall, and R. L. Caldwell, “Spectral tuning and the visual ecology of mantis shrimps,” Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 355, no. 1401, pp. 1263–1267, 2000.
View at: Publisher Site | Google Scholar
Y. Zhao, G. Zhang, F. Jie, S. Gao, C. Chen, and Q. Pan, “Unsupervised classification of spectropolarimetric data by region-based evidence fusion,” IEEE Geoscience and Remote Sensing Letters, vol. 8, no. 4, pp. 755–759, 2011.
View at: Publisher Site | Google Scholar
J. Duan, Q. Fu, C. Mo, Y. Zhu, and D. Liu, “Review of polarization imaging for international military application,” in International Symposium on Photoelectronic Detection and Imaging: Imaging Sensors and Applications, vol. 8908 of Proceedings of SPIE, International Society for Optics and Photonics, Beijing, China, August 2013.
View at: Publisher Site | Google Scholar
B. D. Bartlett and A. Schlamm, “Anomaly detection with varied ground sample distance utilizing spectropolarimetric imagery collected using a liquid crystal tunable filter,” Optical Engineering, vol. 50, no. 8, Article ID 081207, 2011.
View at: Publisher Site | Google Scholar
Z. Yongqiang, Z. Lei, and P. Quan, “Spectropolarimetric imaging for pathological analysis of skin,” Applied Optics, vol. 48, no. 10, pp. D236–D246, 2009.
View at: Publisher Site | Google Scholar
Y. Zhao, Q. Zhang, and J. Yang, “High-resolution multiband polarization epithelial tissue imaging method by sparse representation and fusion,” Applied Optics, vol. 51, no. 4, pp. A27–A35, 2012.
View at: Publisher Site | Google Scholar
K. Arai and Y. Nishimura, “Aerosol parameter estimation through atmospheric polarization observation with the different observation angles,” in Polarization Science and Remote Sensing IV, vol. 7461 of Proceeding of SPIE, San Diego, Calif, USA, August 2009.
View at: Publisher Site | Google Scholar
I. Sano, S. Mukai, and T. Takashima, “Multispectral polarization measurements of atmospheric aerosols,” Advances in Space Research, vol. 19, no. 9, pp. 1379–1382, 1997.
View at: Publisher Site | Google Scholar
K. Homma, H. Shingu, H. Yamamoto, H. Kurosaki, and M. Shibayama, “Application of an imaging spectropolarimeter to agro-environmental sciences,” in Sensors, Systems and Next-Generation Satellites VII, vol. 5234 of Proceedings of SPIE, pp. 638–647, September 2003.
View at: Publisher Site | Google Scholar
H. Guo and T. Yu, “A review of atmospheric aerosol research by using polarization remote sensing,” Spectroscopy and Spectral Analysis, vol. 34, no. 7, pp. 1873–1880, 2014.
View at: Google Scholar
J. Mudge and M. Virgen, “Real time polarimetric dehazing,” Applied Optics, vol. 52, no. 9, pp. 1932–1938, 2013.
View at: Publisher Site | Google Scholar
S. Fang, X. S. Xia, X. Huo, and C. Chen, “Image dehazing using polarization effects of objects and airlight,” Optics Express, vol. 22, no. 16, pp. 19523–19537, 2014.
View at: Publisher Site | Google Scholar
T. Treibitz and Y. Y. Schechner, “Active polarization descattering,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 3, pp. 385–399, 2009.
View at: Publisher Site | Google Scholar
Y.-Q. Zhao, L. Zhang, and S. G. Kong, “Band-subset-based clustering and fusion for hyperspectral imagery classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 49, no. 2, pp. 747–756, 2011.
View at: Publisher Site | Google Scholar
Y. Zhao, Q. Zhang, and J. Yang, “High-resolution multiband polarization epithelial tissue imaging method by sparse representation and fusion,” Applied Optics, vol. 51, no. 4, pp. 27–35, 2012.
View at: Publisher Site | Google Scholar
I. Ibrahim, P. W. Yuen, K. Hong et al., “Illumination invariance and shadow compensation via spectro-polarimetry technique,” Optical Engineering, vol. 51, no. 10, Article ID 107004, 2012.
View at: Publisher Site | Google Scholar
D. A. Landgrebe, “Hyperspectral image data analysis as a high dimensional signal processing problem,” IEEE Signal Processing Magazine, vol. 19, no. 1, pp. 17–28, 2002.
View at: Google Scholar
X. Meng, J. Li, D. Liu, and R. Zhu, “Fourier transform imaging spectropolarimeter using simultaneous polarization modulation,” Optics Letters, vol. 38, no. 5, pp. 778–780, 2013.
View at: Publisher Site | Google Scholar
J. Li, B. Gao, C. Qi, J. Zhu, and X. Hou, “Tests of a compact static Fourier-transform imaging spectropolarimeter,” Optics Express, vol. 22, no. 11, pp. 13014–13021, 2014.
View at: Publisher Site | Google Scholar
N. Carey and W. Stürzl, “An insect-inspired omnidirectional vision system including UV-sensitivity and polarisation,” in Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV '11), pp. 312–319, November 2011.
View at: Publisher Site | Google Scholar
R. Azzam and N. Bashara, Ellipsometry and Polarized Light, North-Holland Publishing, Elsevier Science Publishing, 1987.
J. S. Tyo, D. L. Goldstein, D. B. Chenault, and J. A. Shaw, “Review of passive imaging polarimetry for remote sensing applications,” Applied Optics, vol. 45, no. 22, pp. 5453–5469, 2006.
View at: Publisher Site | Google Scholar
X. Sun, Y. Qiao, and J. Hong, “Review of polarization remote sensing techniques and applications in the visible and infrared,” Journal of Atmospheric and Environmental Optics, vol. 3, article 5, 2010.
View at: Google Scholar
D. Tanré, F. M. Bräon, J. L. Deuzä et al., “Remote sensing of aerosols by using polarized, directional and spectral measurements within the A-Train: the PARASOL mission,” Atmospheric Measurement Techniques, vol. 4, no. 7, pp. 1383–1395, 2011.
View at: Publisher Site | Google Scholar
Z. Li, P. Goloub, C. Devaux et al., “Aerosol polarized phase function and single-scattering albedo retrieved from ground-based measurements,” Atmospheric Research, vol. 71, no. 4, pp. 233–241, 2004.
View at: Publisher Site | Google Scholar
T. Marbach, P. Phillips, A. Lacan, and P. Schlüssel, “The multi-viewing, -channel, -polarisation imager (3MI) of the EUMETSAT polar system—second generation (EPS-SG) dedicated to aerosol characterisation,” in Sensors, Systems, and Next-Generation Satellites XVII, vol. 8889 of Proceedings of SPIE, International Society for Optics and Photonics, October 2013.
View at: Publisher Site | Google Scholar
L. Ying, L. Wen, and L. Cheng, “Research on the fluorescence polarization characteritic of alcoholism blood,” Acta Optica Sinica, vol. 7, pp. 2065–2068, 2010.
View at: Google Scholar
J. A. Levitt, D. R. Matthews, S. M. Ameer-Beg, and K. Suhling, “Fluorescence lifetime and polarization-resolved imaging in cell biology,” Current Opinion in Biotechnology, vol. 20, no. 1, pp. 28–36, 2009.
View at: Publisher Site | Google Scholar
A. J. Makowski, C. A. Patil, A. Mahadevan-Jansen, and J. S. Nyman, “Polarization control of Raman spectroscopy optimizes the assessment of bone tissue,” Journal of Biomedical Optics, vol. 18, no. 5, Article ID 055005, 2013.
View at: Publisher Site | Google Scholar
D. Fried, P. Ngaotheppitak, C. Darling, and C. Ho, “Polarization sensitive optical coherence tomography for quantifying the severity of natural caries lesions on occlusal surfaces,” in 13th Lasers in Dentistry, vol. 6425 of Proceedings of SPIE, International Society for Optics and Photonics, San Jose, Calif, USA, March 2007.
View at: Publisher Site | Google Scholar
W. Hubbard, G. Bishop, T. Gowen, D. Hayter, and G. Innes, “Multispectral-polarimetric sensing for detection of difficult targets,” in Electro-Optical and Infrared Systems: Technology and Applications V, vol. 7113 of Proceedings of SPIE, International Society for Optics and Photonics, Wales, UK, October 2008.
View at: Publisher Site | Google Scholar
Q. Wang, J. Wang, D. Zhao, L. Ma, Z. Chen, and Z. Li, “Recognition of camouflage targets with hyper-spectral polarization imaging system,” in International Symposium on Photoelectronic Detection and Imaging 2013: Imaging Spectrometer Technologies and Applications, vol. 8910 of Proceedings of SPIE, International Society for Optics and Photonics, Beijing, China, August 2013.
View at: Publisher Site | Google Scholar
S. Kaplan, G. Simon, S. Woods, A. Carter, and T. Jung, “Calibration of IR test chambers with the missile defense transfer radiometer,” in 18th Technologies for Synthetic Environments: Hardware-in-the-Loop, vol. 8707 of Proceedings of SPIE, International Society for Optics and Photonics, Baltimore, Md, USA, April-May 2013.
View at: Google Scholar
M. Flusche, G. Gartley, and R. Schott, “Exploiting spectral and polarimetric data fusion to enhance target detection performance,” in Imaging Spectrometry XV, vol. 7812 of Proceedings of the SPIE, 78120C, p. 10, International Society for Optics and Photonics, August 2010.
View at: Publisher Site | Google Scholar
B. D. Bartlett and A. Schlamm, “Anomaly detection with varied ground sample distance utilizing spectropolarimetric imagery collected using a liquid crystal tunable filter,” Optical Engineering, vol. 50, no. 8, Article ID 081207, 9 pages, 2011.
View at: Publisher Site | Google Scholar
E. Namer, S. Shwartz, and Y. Y. Schechner, “Skyless polarimetric calibration and visibility enhancement,” Optics Express, vol. 17, no. 2, pp. 472–493, 2009.
View at: Publisher Site | Google Scholar
S. Fang, X. Xia, X. Huo, and C. Chen, “Image dehazing using polarization effects of objects and airlight,” Optics Express, vol. 22, no. 16, pp. 19523–19537, 2014.
View at: Publisher Site | Google Scholar
A. El-Saba, M. S. Alam, and W. A. Sakla, “Pattern recognition via multispectral, hyperspectral, and polarization-based imaging,” in Automatic Target Recognition XX; Acquisition, Tracking, Pointing, and Laser Systems Technologies XXIV; and Optical Pattern Recognition XXI, vol. 7696 of Proceedings of SPIE, April 2010.
View at: Publisher Site | Google Scholar
C. Chen, Y.-Q. Zhao, D. Liu, L. Luo, and Q. Pan, “Robust materials classification based on multispectral polarimetric BRDF imagery,” in International Symposium on Photoelectronic Detection and Imaging 2009: Advances in Imaging Detectors and Applications, vol. 7384 of Proceedings of SPIE, pp. 1–8, August 2009.
View at: Publisher Site | Google Scholar
O. Morel, C. Stolz, F. Meriaudeau, and P. Gorria, “Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging,” Applied Optics, vol. 45, no. 17, pp. 4062–4068, 2006.
View at: Publisher Site | Google Scholar
P. Boher, T. Leroux, T. Bignon, and V. Collomb-Patton, “Multispectral polarization viewing angle analysis of circular polarized stereoscopic 3D displays,” in 21st Stereoscopic Displays and Applications, vol. 7524 of Proceedings of SPIE, San Jose, Calif, USA, February 2010.
View at: Publisher Site | Google Scholar
R. Rantoson, C. Stolz, D. Fofi, and F. Mériaudeau, “3D reconstruction by polarimetric imaging method based on perspective model,” in Optical Measurement Systems for Industrial Inspection VI, vol. 7389 of Proceedings of SPIE, p. 12, Munich, Germany, June 2009.
View at: Publisher Site | Google Scholar
P. Garbat and J. Woźnicki, “Polarization imaging in 3D shape reconstruction,” in Image Processing and Communications Challenges 5, pp. 205–211, Springer International Publishing, Berlin, Germany, 2014.
View at: Google Scholar
W. Shurcliff, Polarized light. Production and Use, Harvard University Press, Cambridge, Mass, USA, 1966.
L. B. Wolff, “Polarization vision: a new sensory approach to image understanding,” Image and Vision Computing, vol. 15, no. 2, pp. 81–93, 1997.
View at: Publisher Site | Google Scholar
Z. Xu, D. K. P. Yue, L. Shen, and K. J. Voss, “Patterns and statistics of in-water polarization under conditions of linear and nonlinear ocean surface waves,” Journal of Geophysical Research: Oceans, vol. 116, no. 7, 2011.
View at: Publisher Site | Google Scholar
M. G. Gartley, S. D. Brown, A. D. Goodenough, N. J. Sanders, and J. R. Schott, “Polarimetric scene modeling in the thermal infrared,” in Polarization Science and Remote Sensing III, vol. 6682 of Proceedings of SPIE, International Society for Optics and Photonics, San Diego, Calif, USA, September 2007.
View at: Publisher Site | Google Scholar
B. Redding, Y. Pan, C. Wang, G. Videen, and H. Cao, “Polarization resolved angular optical scattering of aerosol particles,” in Advanced Environmental, Chemical, and Biological Sensing Technologies XI, vol. 9106 of Proceedings of SPIE, International Society for Optics and Photonics, May 2014.
View at: Publisher Site | Google Scholar
J. Shi, “Estimation of snow water equivalence with two Ku-band dual polarization radar,” in Proceedings of the International Geoscience and Remote Sensing Symposium, 2004.
View at: Google Scholar
L. Storrie, A. Hall, S. Hang et al., “Spectral profiling and imaging (SPI): extending L.I.F.E. technology for the remote exploration of life in ice caves (R.E.L.I.C.) on Earth and Mars,” in 14th Instruments, Methods, and Missions for Astrobiology, vol. 8152 of Proceedings of SPIE, International Society for Optics and Photonics, San Diego, Calif, USA, September 2011.
View at: Publisher Site | Google Scholar
H. Shingu, H. Kurosaki, K. Homma, T. Suzuki, and H. Yamamoto, “Earth observation system incorporating an LCTF spectropolarimeter,” in 6th Sensors, Systems, and Next-Generation Satellites, vol. 4881 of Proceedings of SPIE, pp. 503–510, International Society for Optics and Photonics, Crete, Greece, April 2003.
View at: Publisher Site | Google Scholar
R. Tawalbeh, D. Voelz, D. Glenar et al., “Infrared acousto-optic tunable filter point spectrometer for detection of organics on mineral surfaces,” Optical Engineering, vol. 52, no. 6, Article ID 063604, 2013.
View at: Publisher Site | Google Scholar
Y. Zhao, L. Zhang, and Q. Pan, “Spectropolarimetric imaging for anomaly epithelial tissue detection,” in Sequence and Genome Analysis: Methods and Applications (CreateSpace), pp. 297–330, 2011.
View at: Google Scholar
Y. Zhao, T. Yang, P. Wei, and Q. Pan, “Spectropolarimetric imaging for skin characteristics analysis,” in Medical Imaging and Informatics, pp. 322–329, Springer, Berlin, Germany, 2008.
View at: Google Scholar
G. Jie and Y. He, “An exeriment for high speed retrieval by ENVISAT-ASAR cross-polarized observations,” in Proceedings of the 32nd IEEE International Geoscience and Remote Sensing Symposium (IGARSS '12), pp. 2809–2812, Munich, Germany, July 2012.
View at: Publisher Site | Google Scholar
Y. Zhao, G. Zhang, F. Jie, N. Liu, L. Song, and Q. Pan, “Damage assessment using multi-band polarimetric imaging,” in Proceedings of the 15th Chinese Conference on Image and Graphics, 2010.
View at: Google Scholar
J. E. Vaillancourt and B. C. Matthews, “Submillimeter polarization of Galactic clouds: a comparison of 350 μm and 850 μm data,” The Astrophysical Journal, Supplement Series, vol. 201, no. 2, article 13, 2012.
View at: Publisher Site | Google Scholar
K. Knobelspiesse, B. van Diedenhoven, A. Marshak, S. Dunagan, B. Holben, and I. Slutsker, “Cloud thermodynamic phase detection with polarimetrically sensitive passive sky radiometers,” Atmospheric Measurement Techniques Discussions, vol. 7, no. 12, pp. 11991–12036, 2014.
View at: Publisher Site | Google Scholar
F. J. Crosby, “Stokes vector component versus elementary factor performance in a target detection algorithm,” in Polarization: Measurement, Analysis, and Remote Sensing VI, vol. 5432 of Proceedings of SPIE, pp. 1–11, Orlando, Fla, USA, April 2004.
View at: Publisher Site | Google Scholar
D. M. Kocak, F. R. Dalgleish, F. M. Caimi, and Y. Y. Schechner, “A focus on recent developments and trends in underwater imaging,” Marine Technology Society Journal, vol. 42, no. 1, pp. 52–67, 2008.
View at: Publisher Site | Google Scholar
D. Miyazaki, M. Kagesawa, and K. Ikeuchi, “Transparent surface modeling from a pair of polarization images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 73–82, 2004.
View at: Publisher Site | Google Scholar
K. Dana, R. Friedhoff, B. Maxwell, S. Bushell, and C. Smith, “Polarization-based shadow detection,” U.S. Patent 8,319,821, 2012.
View at: Google Scholar
S. K. Nayar, X.-S. Fang, and T. Boult, “Separation of reflection components using color and polarization,” International Journal of Computer Vision, vol. 21, no. 3, pp. 163–186, 1997.
View at: Publisher Site | Google Scholar
G. A. Atkinson and E. R. Hancock, “Recovery of surface orientation from diffuse polarization,” IEEE Transactions on Image Processing, vol. 15, no. 6, pp. 1653–1664, 2006.
View at: Publisher Site | Google Scholar
S.-S. Lin, K. M. Yemelyanov, E. N. Pugh Jr., and N. Engheta, “Separation and contrast enhancement of overlapping cast shadow components using polarization,” Optics Express, vol. 14, no. 16, pp. 7099–7108, 2006.
View at: Publisher Site | Google Scholar
N. Kong, Y.-W. Tai, and J. S. Shin, “A physically-based approach to reflection separation: from physical modeling to constrained optimization,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 36, no. 2, pp. 209–221, 2014.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2016 Yongqiang Zhao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

4795

Downloads

2180

Citations