Downloader & cmorizer for NOAA GML surface flask trace gases #3847
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This work adds a downloader and a formatter to ESMValTool to download and CMORize surface flask measurements of trace gases (CH4, CO2, and N2O) from the Global Monitoring Lab (GML) of NOAA. This work contributes to the ongoing development of a recipe and diagnostic to evaluate model output of surface concentrations of trace gases against the NOAA GML station measurements #3838.
The downloader retrieves event-based and monthly station averages of surface flask measurements of CH4, CO2 and N2O (see NOAA-GML) as an archive. Only the monthly averages of each station are CMORized here and are already computed following the methodology described on NOAA's GML website from the event-based files also present in the downloaded archive. The dataset archives are downloaded separately for each trace gas.
The formatter CMORizes the station monthly averages for a given trace gas by creating a NetCDF file containing all stations for which a location was available in the corresponding event files. The NetCDF file holds a time series for each station with the coordinates station_id, latitude and longitude. The general dataset architecture is taken from #3227 which implemented a CMORizer for time series of surface station observations. This allows the access to all stations data in a single file, speeding up loading times and processing operations. The general formatting functions are implemented in a separate file from which a single function is then imported and called in the respective trace gases formatter files.
Note: the CMORized variables produced here (
ch4s
,co2s
,n2os
) are not available in the CMOR table CMIP6 - Amon. However, in the case of model outputs, they need to be derived from their 3D counterparts (ch4
,co2
,n2o
, see #2611) which are present in the corresponding CMOR table.Before you get started
Checklist
It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.
New or updated data reformatting script
To help with the number of pull requests: