Applications of Spectroscopy in Environmental Monitoring of Gases and AerosolsView this Special Issue
Analysis of ACAM Data for Trace Gas Retrievals during the 2011 DISCOVER-AQ Campaign
To improve the trace gas retrieval from Airborne Compact Atmospheric Mapper (ACAM) during the DSICOVER-AQ campaigns, we characterize the signal to noise ratio (SNR) of the ACAM measurement. From the standard deviations of the fitting residuals, the SNRs of ACAM nadir measurements are estimated to vary from ~300 at 310 nm to ~1000 in the blue spectral region; the zenith data are noisier due to reduced levels of illumination and lower system throughput and also show many more pixels with abrupt anomalous values; therefore, a new method is developed to derive a solar irradiance reference at the top of the atmosphere (TOA) from average nadir measurements, at instrument spectral resolution and including instrument calibration characteristics. Using this reference can significantly reduce fitting residuals and improve the retrievals. This approach derives an absolute reference for direct fitting algorithms involving radiative transfer calculations and thus can be applied to both aircraft and ground-based measurements. The comparison of ACAM radiance with simulations using coincident ozonesonde and OMI data shows large wavelength-dependent biases in ACAM data, varying from ~−19% at 310 nm to 5% at 360 nm. Correcting ACAM radiance in direct-fitting based ozone profile algorithm significantly improves the consistency with OMI total ozone.
The Airborne Compact Atmospheric Mapper (ACAM) is an Ultraviolet (UV)/visible/near-infrared spectrometer covering the spectral range 304–910 nm . It has been flown on board the NASA UC-12 aircraft in both nadir-viewing mode and much less frequently in zenith-sky mode during the DISCOVER-AQ campaigns as the primary airborne instrument to provide remote sensing column abundances of O3, NO2, and CH2O and explore column observations including profiles of partial O3 columns .
To retrieve O3 profiles or trace gas vertical column densities (VCDs) from ACAM data by directly fitting the radiance and using the optimal estimation inversion technique, it is critical to perform accurate radiometric calibration and characterize the signal to noise ratio (SNR) of the measurements as measurement constraint [3, 4]. Liu et al.  performed empirical radiometric calibration of OMI data by comparing measured radiance with simulated radiance using zonal mean Microwave Limb Sounder (MLS) O3 profiles in the stratosphere and climatological O3 profiles in the troposphere. A similar method can be applied to ACAM measurements but using simultaneously observed O3 sonde profiles during the DISCOVER-AQ campaigns. The SNR of ACAM measurements can be determined through examining the random part of the fitting residuals.
Because it is impossible to measure extraterrestrial solar irradiance spectrum with the same instrument for ground-based or aircraft UV/visible spectroscopic measurements, various methods have been used to obtain reference spectra for retrieving trace gas abundance from these measurements. The classical Langley extrapolation method derives the extraterrestrial solar irradiance by extrapolating measured irradiance to zero air mass to remove the effects of the atmosphere [5–7]. It has been commonly used for Brewer and Dobson measurements to measure O3 and aerosol optical depth, but it has to be done at a very clean atmospheric site (e.g., Mauna Loa, Hawaii) under very special conditions (e.g., cloudless, with little atmospheric variation during the measurement period of a few hours in the morning or afternoon). Atmospheric variability and instrument instability can cause errors in top of the atmosphere (TOA) solar irradiance derived by this way. A more widely used method, especially for retrieving trace gases from UV/visible spectra, is to use zenith-sky or clean background measurements as references [8–16]. Retrievals performed using such reference spectra result in differential quantities between measured and reference spectra. Statistical approaches like minimum-amount Langley extrapolation (MLE) and the bootstrap-estimation methods or other correlative measurements are often used to derive the offset in the reference spectra [9, 17]. In addition, it is more complicated to use such reference spectra in direct fitting of radiance with radiative transfer calculations to derive absolute quantities from both nadir and zenith-sky measurements. Tzortziou et al.  convolved calibrated high-resolution solar irradiance reference  with instrument slit functions to derive the extraterrestrial solar irradiance spectrum from ground-based Pandora measurements for retrieving absolute total O3. However, radiometric/wavelength calibration differences between high-resolution reference and measurements often cause large errors to minor trace gas determinations. In this paper, a novel technique is developed to derive TOA solar irradiance reference spectrum from aircraft nadir/zenith measurements.
The main purpose of this paper is to perform ACAM absolute radiometric calibration, characterize instrument measurement SNR, and derive proper TOA reference spectrum for improving trace gas retrievals from ACAM measurements during the 2011 Baltimore-Washington D.C. DISCOVER-AQ campaign. It is organized as follows. The ACAM instrument and data analysis are described in Section 2. Section 3 focuses on the wavelength and slit function calibration and characterization of ACAM SNR and identification of problematic spectral pixels. Section 4 presents a new method of deriving TOA solar irradiance reference spectrum. Section 5 concludes this study.
2. ACAM Instrument and Data Analysis
The Airborne Compact Atmospheric Mapper (ACAM) flown on board the NASA UC-12 aircraft was designed and built at the NASA Goddard Space Flight Center (GSFC). The science objectives of ACAM are to provide remote sensing observations of tropospheric and boundary layer pollutants to help understand some of the most important pollutants that directly affect the health of the population. The ACAM instrument includes two spectrographs, the air quality (AQ) spectrometer and the ocean color (OC) spectrograph. The first one, the UV/Visible AQ spectrometer, covers the 304 nm to 520 nm spectral region at a moderate resolution of 0.8 nm. It is optimized for the measurement of tropospheric pollutants and water vapor. The second one, the OC spectrograph, covers the spectral region ranging from 460 nm to 900 nm with a resolution of 1.5 nm optimized for ocean color, water vapor, and aerosols. They operate in two viewing modes, nadir and zenith view, with a spatial resolution of ~1.5 × 0.75 km2 for nadir view. A detailed description of ACAM instrument can be found in .
The SAO basic optical absorption spectroscopy (BOAS) trace gas fitting algorithm is adapted to perform wavelength and slit function calibration and spectral fitting of trace gases  and has been described in detail in Liu et al. . In this study, we use the derived broadened Gaussian slit function parameters from ACAM data  for preconvolution of trace gas cross sections. The fitting algorithm is quite sensitive to the input parameter settings such as retrieval fitting window, the order of polynomials which is used to remove the slow variation of observed spectrum, and the involved absorption of the other trace gases. In this study, through intensive investigations, O3, NO2, and HCHO are optimized mainly by using new fitting window 318–335 nm, 430–485 nm, and 324–457 nm, respectively.
3. Instrument SNR Characterizations and Radiometric Calibration
The fitting residuals contain a systematic component as well as a random component. The standard deviation (i.e., random component) of mean fitting residuals can generally be used to characterize the SNR of the ACAM measurements. Figure 1 shows standard deviations of fitting residuals for three fitting windows derived from one day of ACAM nadir viewing and zenith-sky data on July 21, 2011. In general, they reflect the SNR of ACAM spectral pixels except for some anomalous pixels, especially in the zenith-sky measurements. The SNR of nadir measurements increases from ~300 around 310 nm to ~700 at 340 nm and 1000 in the blue spectral region. Note that ACAM measurements have 8 samples per FWHM, which effectively enhances the SNR by a factor of 1.63 compared to measurements with 3 samples per FWHM (e.g., OMI). The zenith data are noisier due to reduced levels of illumination and lower system throughput through the zenith fiber port. The anomalous pixels in zenith data are probably linked to instrument radiometric calibration problems and suggest that the current quality of zenith data is inadequate as a reference for retrieving trace gases from nadir measurements. We have identified these pixels with spikes in a previous version of the nadir data and reported them to the ACAM calibration team. They informed us that most of these pixels are affected by inadequate dark current correction. As shown in Figure 1; most of these spikes have been removed in the latest version of ACAM nadir data. They might be removed from zenith measurements in the future.
In order to investigate the quality of ACAM radiometric calibration and perform necessary corrections to ACAM radiance for direct fitting of radiance with radiative calculations, we compare ACAM radiance with simulated radiance using the vector linearized discrete ordinate radiative transfer model (VLIDORT) , similar to the comparison described in Liu et al. . To improve the accuracy of the simulation, we use ozonesonde profiles measured at Beltsville (39.1°N, 76.9°W) and Edgewood (39.4°N, 76.3°W) during the 2011 DISCOVER-AQ flight campaign collocated with ACAM observations within 2 hours and 0.01° longitude and latitude below 100 hPa and scaled climatologically stratospheric ozone profiles from McPeters et al.  to match the daily overpass OMI O3 total ozone column (within 6 hours and 0.07° latitude and 1° longitude, 6 DU added to account for known systematic offset in the OMTO3 caused by the use of the Bass and Paur cross sections). A total of 158 collocations with 48 ozonesonde profiles are used in the simulations.
Figure 2(a) shows individual percentage differences between ACAM and simulated radiance in the spectral range 309–360 nm for all the collocations (in colors) and the average difference (black). The average difference varies from ~−19% to ~5% showing significant wavelength dependence. The difference is zero at 347.2 nm as we derive cloud information from this wavelength region by matching simulated and ACAM radiance. Thus, these are relative wavelength-dependent differences, which actually matter to the ozone profile algorithm . There is significant variability in the derived differences (~10% at 310 nm and ~5% at 360 nm) due to mismatch in time and location and uncertainties/errors in used ozone profiles. The presence of consistent overall features for these collocations indicates the existence of wavelength-dependent radiometric calibration errors in current ACAM data. The ACAM calibration team is currently revisiting ACAM’s absolute radiometric calibration for improvement, particularly in removing the stray light component which becomes increasingly important at wavelengths below 350 nm. To show the importance of applying this correction to the optimal estimation based ozone profile algorithm  modified for ACAM data, we apply an empirical correction to both ACAM radiance using the average difference and retrieve ozone profile from ACAM radiance in the spectral region 318–335 nm on July 21, 2011. Figure 2(b) compares the retrieved total ozone with and without applying this correction. After applying the correction, the total ozone is significantly reduced, by ~35 DU, more consistent with the overpass OMI total ozone column of 309 ± 0.6 DU, and appears to be less noisy.
4. Derived TOA Solar Irradiance Reference
A new method is developed to derive the TOA solar irradiance reference spectrum over a spectral window from ACAM nadir measurements. First, we choose several hundred nadir measurements with similar radiance and have relatively small SCDs (through initial spectral fitting) of the target trace gas (i.e., for NO2 and CH2O) and derive an average nadir radiance spectrum . The averaging of nadir measurements at similar radiance significantly reduces random noise in the measurements. Second, we use the high-resolution solar reference spectrum convolved with derived slit functions to fit over a fitting window larger than the target trace gas fitting window by ~2 nm on both sides while simulating the radiance spectrum. The fitted trace gas SCDs come from two parts: (a) the actual trace gas in the atmosphere contained in and (b) the artifacts from the use of , which introduces structures similar to some of the target trace gas. Typically, the former is much larger for O3, but the latter is much larger for minor trace gases. Third, by replacing with and applying all the fitted parameters in the reverse process, we can derive the TOA solar irradiance according to is the scaling parameter. , , and are the basis functions in initial add-on, Beer’s law, and second add-on modes, respectively, and , , and are the corresponding coefficients. The basis functions can include trace gas cross sections, Ring effect, undersampling spectra, and common residual spectra. Each basis function is typically included in only one of the modes (e.g., cross sections as , Ring effect (Chance and Spurr, 1997) as , and common mode as ). and are the scaling and baseline polynomials, respectively. An option to the above process is whether to apply of the target trace gas. Applying cancels the part in , leaving the artifact part in the . On the other hand, not applying cancels the artifact part, leaving the part from in the . contains a systematic offset from the target gas in either case. To reduce the systematic offset, we apply for O3 and do not apply for other minor trace gases.
The derived is a solar irradiance reference at instrument spectral resolution that includes instrument calibration characteristics. When it is used as a reference in the trace gas retrievals, it cancels most of the systematic instrument calibration features, leading to improved relative root mean square (RMS) values of the fitting residuals as shown in the next paragraph. It can be derived from either nadir or zenith measurements but, due to much more frequent nadir measurements and their higher qualities (as shown in Figure 1), we derive TOA solar reference using the nadir measurements. This method can also be applied to ground-based measurements or satellite measurements if high quality solar irradiance measurements are not available. Although it contains some systematic offset, it can be used as an absolute reference spectrum for direct fitting algorithms involving radiative calculations (e.g., ozone profile retrieval algorithm) from both nadir and zenith measurements.
To show the retrieval improvement using our derived , we compare retrievals of O3, CH2O, and NO2 SCDs using three references in Figure 3. The other two references for comparison are the average zenith-sky reference and the TOA solar irradiance reference by directly convolving the high-resolution solar irradiance spectrum with ACAM slit functions using (1). is very similar to our derived except that it does not contain ACAM calibration features. Using significantly reduces fitting RMS values and fitting uncertainties especially for CH2O and NO2 by more than a factor of 3 and 4. The average zenith reference gives better precision for CH2O fitting, comparable fitting precision and better RMS uncertainties for NO2 fitting, and worse precision for O3, compared to the . Although the zenith reference is also measured by the ACAM instrument, the large fitting RMS is likely due to the optical path difference of zenith port from the nadir port, by using additional optical fibers, systematic calibration differences between zenith and nadir data, and poorer SNR in the zenith data. Both TOA solar irradiance references are absolute references, giving actual SCDs in the atmosphere, while the average zenith reference is a relative reference, giving very small or even negative O3 SCDs especially when the solar zenith angle is small. However, for CH2O and NO2 fitting, using leads to large systematic offsets, ~2 × 1017 and ~1016 molecules cm−2 for CH2O and NO2, respectively, mainly due to artifacts from the convolved solar irradiance. Compared to , the zenith reference gives similar NO2 SCDs but larger CH2O SCDs by ~4 × 1016 molecules cm−2.
In this study we estimate the SNRs and identify anomalous spectral pixels in the data from standard deviations of the fitting residuals. The SNRs for ACAM nadir measurements increase from ~300 around 310 nm to ~700 at 340 nm and 1000 in the blue spectral region. The zenith data are noisier and show many more anomalous pixels, indicating dark current calibration problems. This also suggests that the current quality of zenith spectra is insufficient as reference spectra for trace gas retrievals. Using collocated ozonesonde measurements in the troposphere and climatological O3 in the stratosphere scaled to match overpass OMI total ozone column, we simulated radiance and compared them with ACAM radiance in the UV (~309–360 nm). The average differences show strong wavelength dependence, varying from ~−19% at 310 nm to 5% at 360 nm, indicating the presence of large wavelength-dependent radiometric calibrations errors in the current ACAM data. Using the average difference as the correction to ACAM radiance, we evaluated the impact of this correction on the retrieved total ozone using the optimal estimation based ozone profile algorithm. The correction reduces the total ozone by ~35 DU, making it more consistent with the coincident OMI total ozone.
We developed a new method to derive the TOA solar irradiance reference at instrument spectral resolution, including instrument calibration characteristics, from aircraft nadir measurements through reversing the calibration process. We compared the performance of retrieving O3, CH2O, and NO2 SCDs using this derived TOA reference with those using an average zenith reference and a TOA reference by directly convolving high-resolution solar irradiance with derived instrument slit functions. Using our derived TOA reference significantly reduces fitting RMS/uncertainty (by a factor of 3 and 4 for CH2O and NO2). It gives absolute O3 SCDs compared to the zenith reference and significantly reduces the artificial offsets in CH2O and NO2 SCDs compared to the directly convolved TOA reference. This method can be applied to both aircraft and ground-based measurements to derive retrieval reference spectra, which can serve as absolute reference for direct fitting algorithms involving radiative calculations, although it still causes systematic offsets in the derived quantities as do most of the conventional reference spectra for aircraft/ground-based measurements.
The current address for c. Liu is University of Science and Technology of China, Hefei, Anhui, China.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Funding for this work at SAO is provided by NASA Grants NNX11AH77G and NNX12AJ66G as part of the NASA Earth Venture-1 DISCOVER-AQ project and by the Smithsonian Institution. The authors thank Anne Thompson (NASA/GSFC) and Everette Joseph (Howard University) who provided the ozonesonde data from the Edgewood and Beltsville sites, respectively. They acknowledge James Crawford for his strong support on this work.
C. R. Nowlan, X. Liu, K. Chance et al., “Retrievals of sulfur dioxide from the global ozone monitoring experiment 2 (GOME-2) using an optimal estimation approach: algorithm and initial validation,” Journal of Geophysical Research: Atmospheres, vol. 116, no. 18, 2011.View at: Publisher Site | Google Scholar
J. Gröbner and J. B. Kerr, “Ground-based determination of the spectral ultraviolet extraterrestrial solar irradiance: providing a link between space-based and ground-based solar UV measurements,” Journal of Geophysical Research: Atmospheres, vol. 106, no. 7, Article ID 2000JD900756, pp. 7211–7217, 2001.View at: Publisher Site | Google Scholar
A. Cheymol, H. De Backer, W. Josefsson, and R. Stübi, “Comparison and validation of the aerosol optical depth obtained with the Langley plot method in the UV-B from Brewer Ozone Spectrophotometer measurements,” Journal of Geophysical Research: Atmospheres, vol. 111, no. 16, Article ID D16202, 2006.View at: Publisher Site | Google Scholar
J. Herman, A. Cede, E. Spinei, G. Mount, M. Tzortziou, and N. Abuhassan, “NO2 column amounts from ground-based Pandora and MFDOAS spectrometers using the direct-sun DOAS technique: intercomparisons and application to OMI validation,” Journal of Geophysical Research: Atmospheres, vol. 114, no. 13, Article ID D13307, 2009.View at: Publisher Site | Google Scholar
T. Vlemmix, A. J. M. Piters, A. J. C. Berkhout, L. F. L. Gast, P. Wang, and P. F. Levelt, “Ability of the MAX-DOAS method to derive profile information for NO2: can the boundary layer and free troposphere be separated?” Atmospheric Measurement Techniques, vol. 4, no. 12, pp. 2659–2684, 2011.View at: Publisher Site | Google Scholar
M. Tzortziou, J. R. Herman, A. Cede, and N. Abuhassan, “High precision, absolute total column ozone measurements from the Pandora spectrometer system: comparisons with data from a Brewer double monochromator and Aura OMI,” Journal of Geophysical Research: Atmospheres, vol. 117, no. 16, Article ID 16303, 2012.View at: Publisher Site | Google Scholar
K. Chance and R. L. Kurucz, “An improved high-resolution solar reference spectrum for earth's atmosphere measurements in the ultraviolet, visible, and near infrared,” Journal of Quantitative Spectroscopy and Radiative Transfer, vol. 111, no. 9, pp. 1289–1295, 2010.View at: Publisher Site | Google Scholar
C. Liu, X. M. G. Liu, S. J. Kowalewski et al., “Characterization and verification of ACAM slit functions for trace gas retrievals during the 2011 DISCOVER-AQ flight campaign,” Atmospheric Measurement Techniques, vol. 8, pp. 751–759, 2015.View at: Google Scholar
R. J. D. Spurr, “VLIDORT: a linearized pseudo-spherical vector discrete ordinate radiative transfer code for forward model and retrieval studies in multilayer multiple scattering media,” Journal of Quantitative Spectroscopy and Radiative Transfer, vol. 102, no. 2, pp. 316–342, 2006.View at: Publisher Site | Google Scholar