RESINC - Remote sensing of aerosols, clouds, and trace gases using synergy of AATSR, MERIS, and SCIAMACHY
Documents
Idea
Use spectral importance sampling method (mc_spectral_is) to simulate high
resolution SCIAMACHY spectra (NO2 channel 425-470 nm).
Calculations in directory
/usr/users/emde/projects/resinc/
SCIAMACHY
typical nadir spatial resolution: 30km x 60km (along/cross track)
S/N ratio for hyperspectral measurements 600 acc. to Alex
NO2 channel: 425-470 nm, FMHM (Gaussian) 0.44
To do
Molecular optical thickness file
The directory write_molecular_tau includes a script that
generates a molecular_tau_file for 425-470 nm from the uvspec verbose output.
This script has been validated by comparing disort clear sky calculations
with and without molecular_tau_file.
(In order to get accurate results the output format of the verbose output needed to be changed. → now committed)
The spectral resolution of the molecular_tau_file and hence of all calculations is 0.1 nm, resulting in 451 spectral points.
Clear sky test with high surface albedo
For this test the surface albedo was set to a high value (0.5) so that the NO2 absorption features are well visible.
<columns>

The relative difference between mystic (importance sampling) and disort is throughout the spectrum less than 0.05%. )
<newcolumn>

Same but with 1e9 photons and rayleigh_depol=0.0. With 1e8 photons there was still a visible spectral dependence, with 1e9 photons it finally vanishes.
</columns>
The noise in the relative difference is disort noise
For 1e6 photons (and also 1e8 photons) there is a spectral dependence in the relative difference. Not corrected is the spectral dependence of the Rayleigh depolarisation factor, but this is too small to explain this spectral dependence. The calculation with 1e9 photons shows that the spectral dependence is a statistical error which vanishes when a sufficient number of photons is used. Still it is not proven that the method also works correctly with cloud or aerosol scattering (importance sampling of total phase matrix and total single scattering albedo).
Moved importance sampling of single scattering albedo from escape_probability to scattering. Clearsky still works and the calculation time remains the same.
Tests with 1D cloud, Heney-Greenstein
Common settings for all following cloud tests:
Cloud tau=3
<columns>
<newcolumn>

The relative difference between mystic has a spectral dependance which is less pronounced when the phase function is also corrected by spectral importance sampling.)
</columns>
Cloud tau=10
<columns>
There is a spectral dependence in the relative difference between DISORT and MYSTIC. The correction of the calculation of the total phase function can be enabled or disabled.
Something still wrong with spectral importance sampling of Rayleigh scattering????
<newcolumn>

This plot shows the results of 100 calculations with 1e6 photons each (phase function corrected).
</columns>
Cloud tau=20
<columns>
<newcolumn>

Result for 1e6 photons with and without phasecorr.
</columns>
Tests with 1D cloud, Mie phase function
Cloud tau=10
<columns>
calculation wavelength: 450 nm
number of photons: 1e6
CPU time vroom nophasecorr: 16m 2s memory: 900
MB, CPU 1wvn 2m 18s
CPU time novroom: nophasecorr 39m 54s
standard deviation at 450 nm: 0.01%, without vroom 2.2% → spikes can follow and increase these values
CPU time DISORT: 35s, memory: 3.6GB
CPU time with vroom and approx exponential function exp(x) ~ 1+x: 14m 26s, saves less than 10%, so the approximation is not worth implementing!
VROOM does not work with phasecorrection yet. phasecorrection currently in scattering_probability_tot, which is without vroom only used before local estimate, with vroom in many other places, so I don't know what happens …
<newcolumn>

Calculation using VROOM (without phase correction).

Calculations without VROOM (without phase correction). The relative difference shows the spectral dependence of the Mie scattering phase function which is neglected in ALIS.
</columns>
Tests with cubic clouds
<columns>
<newcolumn>

3D calculation with cubic clouds. The sample grid is equal to the cloud grid. Interestingly in the 3D calculation the cloudy and the clearsky pixels result in smaller nadir radiances compared to 1D calculations. The explanation is that photons are scattered from the cloudy pixels into the clearsky pixels. In the clearsky pixels there is a shadow from the cloud pixels so that here also the radiance is decreased.
</columns>
<columns>
<newcolumn>

3D calculation with cubic clouds. Same as above but with sza=5°, which means that sciamachy sees less shadow. The 3D effect is here that photons are transported from the cloudy pixels towards the clearsky pixels, hence in the clearsky pixels the radiance in higher and in the cloudy pixels it is lower.
</columns>