Monitoring atmospheric composition & climate
Change log for f93i

The MACC NRT Analysis production run for AER and GRG (experiment f93i) was started on 2009-10-09 for the analysis cycle 20090901. It caught up with near-real-time on 2009-10-25. Main features are:

  • runs 1 day behind NRT
  • 96 h long forecast at 00
  • IFS cycle 36R1
  • branch: stj_CY36R1_MACC_NRT
  • model resolution T159L60; CTM resolution 1.875 degrees x 1.875 degrees, L60
  • Blacklist: black_ds_macc_nrt_36r1, black_ex_macc_nrt_36r1
  • analysis resolution T159/T95, using 12h 4D-Var and VarBC
  • time period 20090901 -20120930
  • monitoring plots in /gpfs/scratchrd/ecgems/f1kd/obtime/obtime_Retrieved_Gases
  • obstat statistics plots in /ws/scratch/rd/ecgems/ps/
  • biomass burning emissions from gfedv2 climatology 2001-2006
  • Assimilated observations of atmospheric composition:
    • SBUV-O3: partial columns
    • OMI-O3: total column
    • MLS-O3: ozone profiles
    • IASI-CO (Service d'Aeronomie ): total column
    • SCIAMACHY-O3: total column
  • Passive monitoring of observations of atmospheric composition:
    • OMI NO2: tropospheric column
    • GOME-2 NO2: tropospheric column
    • MOPITT CO (V4): total column
    • GOME-2-O3: total columns
    • SEVERI-O3: total columns
    • OMI SO2 (since 20110113)
  • Current observation cut-off times:
    • 13:45 for data between 21 UTC and 3UTC
    • 14:00 for data between 3 UTC and 9UTC
    • 1:45 for data between 9 UTC and 15UTC
    • 2:45 for data between 15 UTC and 21UTC

A list of the G-RG observations used in f93i can be found here.

Changes introduced during production affecting the quality of the products are:

real date exp date description of change
20091109 2009110812 Introduced aerosol updates in branch stj_CY36R1_MACC_NRT. This also changes the archiving of AOD slightly.
20091201 2009120100 Fix IFS to CTM feedback bug in MOZART. restart files should be ok now.
20100108 2010010800 Changed default fire emissions from 2003 to 2004
20100330 2010033000 Code changes to monitor MOPITT V4 data passively. MOPITT V4 data included in fetchobs.
20100426 2010042600 Change to GFAS fire emissions
20100512 2010051200 Change for assimilation of GOES-13 AMVs
20100519 2010051900 No IASI CO data available after Eumetsat data format change.
20100520 2010052000 Include aerosol in pressure level archiving
20100623 2010062200 Prereo3 failed because of new NOAA-19 SBUV data. Included NOAA-19 (ID=223) SBUV (ID=624) in prereo3. Data will be monitored passively at first.
20100714 2010071400 Add GOME-2 tropospheric NO2 data in fetchobs to monitor passively.
20100728 2010072700 Screening trajectory failed with Memory kill. Problem likely to be caused by aerosol, but not clear why. Reconfiguration took some time, but new configuration with THREADS increased to 16 worked.
20100801 2010080100 AOD archiving was changed to archive every 3 hours for the whole forecast range (up to 96 hours)
20100817 2010081600 IASI CO data back. Run 20100816 and 20100817 without varqc and fg-check for CO, so that data with high CO over Russia don't get rejected.
20100913 2010091300 Corrected missing archiving of model level cloud fields (introduced in restart at 2010090100)
20101004 2010100400 Thinning for SCIA O3 and GO3 and MOPITT CO increased to 1deg. Now all datasets are thinned consistently. Change in mklinks to get thin_macc file.
20101109 2010110900 Change mklinks to get 3 extra IASI channels (2908, 3050, 3056) for SO2 diagnostics.
20101110 2010110900 Problem with super-obbing script in CY36R1; not compatible with more than 1 SSMIS instrument. LSSMIS set to FALSE to remove all SMMIS observations.
20101216 2010111512 Problem with bad data in operational IASI bufr file. Removed IASI data from for this cycle. For future cycles correction will take place in operational data stream itself.
20101223 20101222, 0z Failure due to presence of MTSAT-2 data (ident=172). Milan introduced a fix in pregeos to filter data out from the bufr files.
20101226 2010122400 Ifstraj failed because of bad data in operational IASI bufr file. Removed IASI data for this cycle.
20101229 2010122812 Ifstraj failed because of bad data in operational IASI bufr file. Removed IASI data for this cycle.
20110107 2011010700 Edited the pregeos script to allow MTSAT winds to enter the assimilation. They were removed in December together with the radiances. Only the radiances caused problems though.
20110113 2011011300 Start monitoring of NRT OMI SO2 (mid troposphere product).
20110207 2011020700 Switched the near-real-time acquisition of MODIS aerosol from Nanuk to LANCE. LANCE products have been acquired from 20110206 onwards. Starting from 2011020700  the experiment will contain MODIS aerosol data from LANCE only.
20110509 2011050900 New version of KNMI SCIAMACHY ozone retrieval (TOSOMI v2).
20110706 2011070600 Bug fix in the IASI CO observation operator
20120222 20120221 MLS instrument offline after suspected Single Event Upset event that shut down the on-board computer at 18:39UTC on Sunday 19th February 2012. The current plan is for the instrument to return to normal science operations around Friday February 24th 2012. No data will be available during this period.
20120301 2012022900 Final trajectory failed because Mozart had archvied output for 29 Feb as 1 March. Files have been copied back to correct date.
20120315 2012031500 NO MLS data. AURA MLS Instrument has encountered an anomaly as of DOY 074 1834z and MLS has been off since 14/03. Due back on 21/03 according to JPL website
20120305 No MOPITT CO data (passive) because of hot calibration event between 5-16 March.
20120322 2012032200 MLS back. MLS Instrument has been stored to "Nominal" scan mode and it is now back on-line.
MLS Level 2 NRT Data are available again starting from 2012-03-21 18:10.
20120330 20120330 NO IASI CO data between ~14:00 - 21.00 because of problems with LATMOS data server.
20120416 20120408 No Envisat data (e.g. SCIAMACHY, MIPAS) since 8 April after contact with satellite was lost.
20120416 20120423 No IASI CO data. The IASI CO NRT processing will stop Monday, 23 April at 7 UTC because of a power outage. If all goes well, this will only last 48 to 72 hours and data will come back on Wednesday, 25 April.



Reduced MOPITT CO data numbers (passive) between 20120524-20120612 because bug in MOPITT processing chain led to many (but not all) files being generated with no data inside.

20120601 -


No MLS data. Tightening of security on NASA's EOSDIS User Registration System required a password change on 1 June 2012. By mistake this was not applied to the acquisition of MLS ozone until 11 June, and not data were picked up during this period.
20120627 20120627- LANCE-MLS Registered Users: Please expect gaps in the MLS Level 2 NRT data. There has been a resurgence in activity by the existing anomaly on the spacecraft, that Aura has been experiencing for the past couple years. GES DISC team continues to investigate the cause(s) of the gaps to recover as much NRT data as possible.
20120701 20120702 Planned OMI data outage between July 02, 2012 , 1749 UTC and
July 03, 2012, 1749 UTC
20120704 20120703 Bugfix for IASI CO observation errors. The errors had been read as relative error in % and set to max(5%, obserr)  in the BUFR software. They are however given as relative error in the original data files. This meant that prior to today all errors were a factor 100 too small and set to 5%. First observation with proper relative error is for 20120703 13:17:57.


Blacklist changes:

real date
description of change
20090911 20090901 Created black_ds_macc_nrt_36r1 from operational blacklist black_ds2006091300. Blacklist directory ec:/std/blacklist
20090916 20090916 Include operational change to whitelist SCIAMACHY O3 data.
20090921 20090921 Include operational blacklist change to blacklist NOAA-18 AMSU-A. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2009092100
20091125 20091125, 0z Include operational blacklist changes to blacklist Quikscat and JMA winds. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2009092500
20091208 20091208, 0z Include operational blacklist changes to whitelist JMA winds. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2009120800
20100112 20100112, 0z Include operational blacklist changes to activate NOAA-18 AMSU-A, setting NOAA-19 AMSU-A to passive, setting AIRS to passive. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2010011200
20100216 20100216, 0z Include operational blacklist changeto activate AIRS again. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2010021600
20100317 20100318, 0z Include operational blacklist change concerning GOES-13 data, active use of NOAA-19 MHS channels 4 and 5. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2010031700
20100419 20100419, 0z Change Modis blacklist criterion to assimilate data between 70N-70S (instead of 60N-60S). Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2010041900
20100421 20100421, 0z Exclude GOES-12 AMVs and CSRs.  Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2010042100
20100727 20100727, 0z Blacklist IASI CO data so that they get monitored passively first when they come back. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2010072700
20100811 20100811, 0z

Blacklist NOAA-18 data due to possible degradation during engineering tests on the gyro sub-system.  Blacklist MTSAT-1R CSRs and AMVs. Blacklist MTSAT-2 AMVs. Activate GOES-13 AMVs and CSRs. Old blacklist backed up as ec:/std/blacklist/black_ds_macc_nrt_36r1_before_2010081100. Blacklist Aqua CH 5.

20100816 20100816, 0z Activate IASI CO data. Old blacklist backed up as black_ds_macc_nrt_36r1_before_2010081600
20100831 20100831, 0z Reactivate NOAA-18 after tests on gyro subsystem have been completed. Old blacklist backed up as black_ds_macc_nrt_before_2010083100.
20101013 20101013, 0z Cautionary blacklisting of MTSAT-2 AMVs and TerraSAR-X GPSRO data. Old blacklist backed up as black_ds_macc_nrt_before_2010101300
20101026 20101026, 0z Blacklisting of SCIAMACHY O3 data and MERIS data before planned ENVISAT orbit manouvre. Old blacklist backed up as black_ds_macc_nrt_before_2010102600
20101028 20101027,12z Re-activation of MTSAT-1R AMVs due to ground processing failure of MTSAT-2. Old blacklist backed up as black_ds_macc_nrt_before_2010102712
20101109 20101109, 0z Change blacklist to blacklist extra IASI channels that are purely used for SO2 diagnostics. Old blacklist backed up as black_ds_macc_nrt_before_2010110900
20101110 20101110, 0z Blacklist change to re-activated MTSAT-1R CSR data. Old blacklist backed up as black_ds_macc_nrt_before_2010111000
20101202 20101202, 0z Precautionary bllacklisting of IASI CO data because of IASI L2 processing change on 2 Dec. Old blacklist backed up as black_ds_macc_nrt_before_2010120200.
20101215 20101215, 0z Re-activate SCIA O3 and MERIS data. Old blacklist backed up as black_ds_macc_nrt_before_20101215.
20101216 20101216, 0z Re-activate IASI CO. Old blacklist backed up as black_ds_macc_nrt_before_20101216.
20101229 20101229, 0z Blacklist NOAA-18 channel 9, MTSAT-1R retired from operations. Old blacklist backed up as black_ds_macc_nrt_before_20101229.
20110105 20110105, 0z Blacklist ASCAT data after an anomaly to monitor the data. Old blacklist backed up as black_ds_macc_nrt_before_20110105.
20110111 20110111, 0z Reactivate AMSU-A CH9 on NOAA-18, whitelist ASCAT, MTSAT-2 data back (but still filtered out in pregeos). Old blacklist backed up as black_ds_macc_nrt_before_20110111
20110412 20110411, 0z Precautionary blacklisting of MLS O3 data after instrument went into survival mode on 20110326. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110327.
20110510 20110510, 0z Re-activate MLS ozone data (data back since 20110420). Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110510.
20110622 20110622, 0z Activate assimilation of NOAA-19 SBUV/2. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110622
20110705 20110705,0z Blacklist Meteosat-9 AMVs and CSR. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110705
20110707 20110707, 0z Re-activateMeteosat-9. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110707
20110719 20110719, 0z Blacklist NOAA-17 SBUV/2 ozone data betwween 1.5S and 1 N. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110719.
20110815 20110804, 0z Cautionary blacklisting of MTSAT-2 CSR. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110804
20110823 20110822, 0z Reactivate MTSAT-2 . Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110823
20110928 20110928 Blacklist data from METOP-A because of in-plane manoevre. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20110928
20111003 20111003,0z Reactivate data from METOP-A. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111003.
20111006 20111005, 0z Blacklist AMSR-E after instrument failure.  Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111005.
20111006 20111006, 0z Blacklist AMSU-A, MHS data from the EARS stream due to geolocation errors in the data. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111006.
20111019 20111010, 0z Re-activate METOP, AMSU-A, MHS from EARS transmission. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111019.
20111101 20111101, 0z Blacklist MTSAT-2 MAVs and CSRs during ground system maintenance. Passive monitoring of CSRs from MTSAT-1R. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111101.
20111108 20111108, 0z Activate MTSAT-1R AMVs and CSRs. Passively monitor MET-9 CSRs due to EUMETSAT WV channels change. Blacklist MHS on METOP-A due to a swap of local oscillator. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111108.
20111109 20111109, 0z Reactivate METOP-A MHS data. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111109.
20111114 20111114, 0z Reactivate Met-9 CSR from 20111111. Old blacklist backed up as black_ds_macc_nrt_36r1_before_20111111.
20120426 20120426 Blacklisted HIRS on NOAA-19 due to increased noise.
20120503 20120503 Reactivate HIRS on NOAA-19 because noise went down again.
20120625 20120625 Blacklist MET-9 CSR, overcast and AMVs from 25th June due to MET-9 north south orbit inclination manoeuvre.