generated from NOAA-OWP/owp-open-source-project-template
-
Notifications
You must be signed in to change notification settings - Fork 1
Output Format Description for CSV2
HankHerr-NOAA edited this page Jul 25, 2024
·
6 revisions
The WRES CSV is designed to facilitate use by machines. It emphasizes the use of a predictable set of columns, named appropriately (see below), to describe the output evaluation results, including metadata about the features (i.e., locations), variables, pooling windows for the pairs (statistics are computed for each pool), the metric and the statistic. Below, the expected output files are explained (two output files are generated), columns within the CSV file are defined, an example declaration is provided, and, finally, a partial example of an expected CSV is shown. The new CSV format contains all of the statistics for all declared metrics and, in that sense, is a “complete” format.
There is one CSV file per evaluation, which adopts a .csv.gz extension. Additionally, there is a .csvt file, which contains the data types of each column in the csv file. The .csvt file is used by GDAL-enabled software, such as QGIS to import the .csv file with the correct column classes. For example, when expanding the .csv.gz into a .csv and placing alongside the .csvt, you may drag-and-drop the .csv file into the QGIS “Layers” dialog and the CSV file will import (version tried: QGIS 3.10.2 Long-Term Release). If the CSV file contains a Well Known Text (WKT) representations of each evaluated geometry (e.g., if the evaluation requested data from the USGS National Water Information System, which reports the location of each river gauge), then the geometries should be imported directly and displayed as a map.
When generating the WRES CSV output, two files will be created:
evaluation.csv.gz: The evaluation output in a CSV format, columns defined below.
evaluation.csvt: A file defining the data types of each column for use in GDAL-enabled software, such as QGIS. The contents of the .csvt file is fixed across all evaluations (per CSV version) and is:
"String","String","String","String","String","Integer","String","String","WKT","Integer","String","String","WKT","Integer","String","String","WKT","Integer","String","String","String","String","String","String","String","String","String","String","String","String","Real","Real","String","Real","Real","String","String","String","Real","Real","String","Real","Real","String","String","String","String","String","String","Real","Real","Real","Integer","String","String","String","String","Real","Real","Real"
The column names and data types are summarized below. Where helpful, a brief description is also provided. In this context, LEFT refers to data provided in the observed input source and is typically observations or simulations; RIGHT refers to data provided in the predicted source and is typically forecasts or simulations; and BASELINE refers to data provided in the baseline source and is typically of the same type as the right.
| Column name | Data type | Description |
|---|---|---|
| LEFT VARIABLE NAME | String | For example, SQIN. |
| RIGHT VARIABLE NAME | String | |
| BASELINE VARIABLE NAME | String | |
| COVARIATE FILTERS | String | A string representation of the covariate filter(s) used to select the paired data. |
| POOL NUMBER | Integer | Evaluation pairs are gathered into pools for computing statistics. Each pool is assigned a number. |
| EVALUATION SUBJECT | String | The subject of the evaluation. This is typically the RIGHT dataset, but could be the BASELINE dataset when statistics are requested separately for the BASELINE dataset. |
| LEFT FEATURE NAME | String | For example, DRRC2 (an NWS feature name that corresponds to the Dolores River below Rico, CO). |
| LEFT FEATURE WKT | WKT-formatted String | A Well-Known Text (WKT) representation of a geometry for the LEFT dataset. See: https://en.wikipedia.org/wiki/Well-known_text_representation_of_geometry
|
| LEFT FEATURE SRID | Integer | A Spatial Reference Identifier (SRID) for the LEFT dataset WKT. See: https://en.wikipedia.org/wiki/Spatial_reference_system#Identifiers
|
| LEFT FEATURE DESCRIPTION | String | For example, DOLORES RIVER BELOW RICO, CO.
|
| RIGHT FEATURE NAME | String | |
| RIGHT FEATURE WKT | WKT-formatted String | Same as as LEFT FEATURE WKT, but for the right source. |
| RIGHT FEATURE SRID | Integer | Same as LEFT FEATURE SRID, but for the right source. |
| RIGHT FEATURE DESCRIPTION | String | |
| BASELINE FEATURE NAME | String | |
| BASELINE FEATURE WKT | WKT-formatted String | Same as LEFT FEATURE WKT, but for the baseline source. |
| BASELINE FEATURE SRID | Integer | Same as LEFT FEATURE SRID, but for the baseline source. |
| BASELINE FEATURE DESCRIPTION | String | |
| EARLIEST ISSUED TIME EXCLUSIVE | ISO-8601-formatted String | For the pool corresponding to this row, it is the lower bound on the forecast issued time (a.k.a., forecast time, T0, reference time, etc.), which is exclusive. A value of -1000000000-01-01T00:00:00Z implies that it was unbounded. |
| LATEST ISSUED TIME INCLUSIVE | ISO-8601-formatted String | For the pool corresponding to this row, it is the upper bound on the forecast issued time (a.k.a., forecast time, T0, reference time, etc.), which is inclusive. A value of +1000000000-01-01T00:00:00Z implies that it was unbounded. |
| EARLIEST VALID TIME EXCLUSIVE | ISO-8601-formatted String | For the pool corresponding to this row, it is the lower bound on the valid time (a.k.a., observation time, forecast valid time, etc.), which is exclusive. A value of -1000000000-01-01T00:00:00Z implies that it was unbounded. |
| LATEST VALID TIME INCLUSIVE | ISO-8601-formatted String | For the pool corresponding to this row, it is the upper bound on the valid time (a.k.a., observation time, forecast valid time, etc.), which is inclusive. A value of +1000000000-01-01T00:00:00Z implies that it was unbounded. |
| EARLIEST LEAD DURATION EXCLUSIVE | ISO-8601-formatted String | For the pool corresponding to this row, it is the lower bound on the forecast lead duration (a.k.a., lead time), which is exclusive. |
| LATEST LEAD DURATION INCLUSIVE | ISO-8601-formatted String | For the pool corresponding to this row, it is the upper bound on the forecast lead duration (a.k.a., lead time), which is inclusive. |
| TIME SCALE DURATION | ISO-8601-formatted String | In conjunction with the TIME SCALE FUNCTION, this defines the time scale at which the evaluation is performed. |
| TIME SCALE FUNCTION | String | In conjunction with the TIME SCALE DURATION, this defines the time scale at which the evaluation is performed. |
| EVENT THRESHOLD NAME | String | A user- or service-assigned name for the event threshold, such as BANKFULL. |
| EVENT THRESHOLD LOWER VALUE | Float | The lower bound of an event threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds), else the single bound. |
| EVENT THRESHOLD UPPER VALUE | Float | The upper bound of an event threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds). |
| EVENT THRESHOLD UNITS | String | For example, CMS. |
| EVENT THRESHOLD LOWER PROBABILITY | Float | The probability associated with the EVENT THRESHOLD LOWER VALUE, if applicable. |
| EVENT THRESHOLD UPPER PROBABILITY | Float | The probability associated with the EVENT THRESHOLD UPPER VALUE, if applicable. |
| EVENT THRESHOLD SIDE | String | The side(s) of data to which the event threshold refers. For example, LEFT AND RIGHT. |
| EVENT THRESHOLD OPERATOR | String | For example, GREATER. |
| DECISION THRESHOLD NAME | String | A user- or service-assigned name for the decision threshold, such as HIGH. The decision threshold is used to classify probability data into a binary outcome. |
| DECISION THRESHOLD LOWER VALUE | Float | The lower bound of a decision threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds), else the single bound. |
| DECISION THRESHOLD UPPER VALUE | Float | The upper bound of a decision threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds). |
| DECISION THRESHOLD UNITS | String | Always PROBABILITY. |
| DECISION THRESHOLD LOWER PROBABILITY | Float | The probability associated with the DECISION THRESHOLD LOWER VALUE, which is the same as the DECISION THRESHOLD LOWER VALUE where defined (the decision threshold is a probability classifier). |
| DECISION THRESHOLD UPPER PROBABILITY | Float | The probability associated with the DECISION THRESHOLD UPPER VALUE, which is the same as the DECISION THRESHOLD UPPER VALUE where defined (the decision threshold is a probability classifier). |
| DECISION THRESHOLD SIDE | String | The side of data to which the decision threshold refers. |
| DECISION THRESHOLD OPERATOR | String | |
| METRIC NAME | String | For example, CONTINUOUS RANKED PROBABILITY SCORE. |
| METRIC COMPONENT NAME | String | When a metric has several components, the name of the component described in this row of data is given here. For example, The QUANTILE QUANTILE DIAGRAM has two components: the OBSERVED QUANTILES and the PREDICTED QUANTILES. |
| METRIC COMPONENT QUALIFIER | String | When a metric has several identical components, this qualifier distinguishes them. For example, The ENSEMBLE QUANTILE QUANTILE DIAGRAM has two components for each ensemble member index: the OBSERVED QUANTILES and the PREDICTED QUANTILES. In this case, the METRIC COMPONENT QUALIFIER contains the ensemble member label. When the metric is computed for an ensemble average, this field contains the averaging function used, e.g., ENSEMBLE MEAN. Added in v5.11.
|
| METRIC COMPONENT UNITS | String | For example, CMS. |
| METRIC COMPONENT MINIMUM | Float | The smallest possible value of the statistic for this metric component. |
| METRIC COMPONENT MAXIMUM | Float | The largest possible value of the statistic for this metric component. |
| METRIC COMPONENT OPTIMUM | Float | The optimal value of the statistic for this metric component. For example, the optimal value of the PEARSON CORRELATION COEFFICIENT is 1.0. |
| STATISTIC GROUP NUMBER | Integer | A unique identifier for a group of statistics that belong together. For example, a BOX PLOT OF ERRORS BY FORECAST VALUE contains several whiskers, each one with a separate row. These whiskers belong together because they form one box and will have a common STATISTIC GROUP NUMBER. |
| SUMMARY STATISTIC NAME | String | The name of the metric used to calculate the summary statistic. For example, a HISTOGRAM. |
| SUMMARY STATISTIC COMPONENT NAME | String | The name of the metric component for the summary statistic. For example, a histogram is composed of two components, namely the BIN UPPER BOUND and the COUNT. |
| SUMMARY STATISTIC UNITS | String | The measurement units in which the summary statistic is expressed (e.g., CMS). |
| SUMMARY STATISTIC DIMENSION | String | The named dimension for which the summary statistic was computed (e.g., FEATURES represents all geographic features within the evaluation). |
| SUMMARY STATISTIC QUANTILE | Float | A value greater than zero and less than one that represents the quantile of the sampling distribution of the summary statistic. |
| SAMPLE QUANTILE | Float | A value greater than zero and less than one that represents the sample quantile associated with the statistic (i.e., the quantile within the sampling distribution of the statistic). This is only present when sampling uncertainties have been estimated explicitly and is otherwise empty. |
| STATISTIC | Float | The actual statistic. |
The following is an example of the declaration needed to instruct the WRES to output the CSV format:
output_formats: csv2
The csv2 refers to the WRES CSV output format. Other attributes impact the formatting of output written to the WRES CSV, as well as other output formats such as 'png':
decimal_format: The number of decimal places desired for output statistics. For example: 0.000000.
duration_format: The unit of time to use in the output, such as 'hours'.
decimal_format: '0.000000'
duration_format: hours
output_formats:
- csv2
- pngThe following is an example of the CSV2 output:
LEFT VARIABLE NAME,RIGHT VARIABLE NAME,BASELINE VARIABLE NAME,COVARIATE FILTERS,POOL NUMBER,EVALUATION SUBJECT,LEFT FEATURE NAME,LEFT FEATURE WKT,LEFT FEATURE SRID,LEFT FEATURE DESCRIPTION,RIGHT FEATURE NAME,RIGHT FEATURE WKT,RIGHT FEATURE SRID,RIGHT FEATURE DESCRIPTION,BASELINE FEATURE NAME,BASELINE FEATURE WKT,BASELINE FEATURE SRID,BASELINE FEATURE DESCRIPTION,EARLIEST ISSUED TIME EXCLUSIVE,LATEST ISSUED TIME INCLUSIVE,EARLIEST VALID TIME EXCLUSIVE,LATEST VALID TIME INCLUSIVE,EARLIEST LEAD DURATION EXCLUSIVE,LATEST LEAD DURATION INCLUSIVE,TIME SCALE DURATION,TIME SCALE FUNCTION,EVENT THRESHOLD NAME,EVENT THRESHOLD LOWER VALUE,EVENT THRESHOLD UPPER VALUE,EVENT THRESHOLD UNITS,EVENT THRESHOLD LOWER PROBABILITY,EVENT THRESHOLD UPPER PROBABILITY,EVENT THRESHOLD SIDE,EVENT THRESHOLD OPERATOR,DECISION THRESHOLD NAME,DECISION THRESHOLD LOWER VALUE,DECISION THRESHOLD UPPER VALUE,DECISION THRESHOLD UNITS,DECISION THRESHOLD LOWER PROBABILITY,DECISION THRESHOLD UPPER PROBABILITY,DECISION THRESHOLD SIDE,DECISION THRESHOLD OPERATOR,METRIC NAME,METRIC COMPONENT NAME,METRIC COMPONENT QUALIFIER,METRIC COMPONENT UNITS,METRIC COMPONENT MINIMUM,METRIC COMPONENT MAXIMUM,METRIC COMPONENT OPTIMUM,STATISTIC GROUP NUMBER,SUMMARY STATISTIC NAME,SUMMARY STATISTIC COMPONENT NAME,SUMMARY STATISTIC UNITS,SUMMARY STATISTIC DIMENSION,SUMMARY STATISTIC QUANTILE,SAMPLE QUANTILE,STATISTIC
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,COEFFICIENT OF DETERMINATION,MAIN,,DIMENSIONLESS,0.0,1.0,1.0,1,,,,,,,0.1534782395406544
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,PEARSON CORRELATION COEFFICIENT,MAIN,,DIMENSIONLESS,-1.0,1.0,1.0,2,,,,,,,-0.3917629889877991
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,3,,,,,,,0.08557104128471933
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,ROOT MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,4,,,,,,,0.2925252831546691
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,BIAS FRACTION,MAIN,,DIMENSIONLESS,-Infinity,Infinity,0.0,5,,,,,,,1.5979759616040214
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ABSOLUTE ERROR,MAIN,,CMS,0.0,Infinity,0.0,6,,,,,,,0.2916527890656166
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ERROR,MAIN,,CMS,-Infinity,Infinity,0.0,7,,,,,,,0.2916527890656166
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,SAMPLE SIZE,MAIN,,COUNT,-Infinity,Infinity,0.0,8,,,,,,,24.0
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,COEFFICIENT OF DETERMINATION,MAIN,,DIMENSIONLESS,0.0,1.0,1.0,9,,,,,,,0.4242742314172851
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,PEARSON CORRELATION COEFFICIENT,MAIN,,DIMENSIONLESS,-1.0,1.0,1.0,10,,,,,,,0.6513633635823288
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,11,,,,,,,0.09739978853406782
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,ROOT MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,12,,,,,,,0.31208939189608453
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,BIAS FRACTION,MAIN,,DIMENSIONLESS,-Infinity,Infinity,0.0,13,,,,,,,1.7343376726368764
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ABSOLUTE ERROR,MAIN,,CMS,0.0,Infinity,0.0,14,,,,,,,0.31185468821686363
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ERROR,MAIN,,CMS,-Infinity,Infinity,0.0,15,,,,,,,0.31185468821686363
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,SAMPLE SIZE,MAIN,,COUNT,-Infinity,Infinity,0.0,16,,,,,,,24.0
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,COEFFICIENT OF DETERMINATION,MAIN,,DIMENSIONLESS,0.0,1.0,1.0,17,,,,,,,NaN
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,PEARSON CORRELATION COEFFICIENT,MAIN,,DIMENSIONLESS,-1.0,1.0,1.0,18,,,,,,,NaN
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,19,,,,,,,0.49567358637098435
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,ROOT MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,20,,,,,,,0.7040408982232385
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,BIAS FRACTION,MAIN,,DIMENSIONLESS,-Infinity,Infinity,0.0,21,,,,,,,4.810818740041824
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ABSOLUTE ERROR,MAIN,,CMS,0.0,Infinity,0.0,22,,,,,,,0.7037211298396339
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ERROR,MAIN,,CMS,-Infinity,Infinity,0.0,23,,,,,,,0.7037211298396339
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,SAMPLE SIZE,MAIN,,COUNT,-Infinity,Infinity,0.0,,,,,,,24,19.0
In a table format, it would appear as follows:
| LEFT VARIABLE NAME | RIGHT VARIABLE NAME | BASELINE VARIABLE NAME | COVARIATE FILTERS | POOL NUMBER | EVALUATION SUBJECT | LEFT FEATURE NAME | LEFT FEATURE WKT | LEFT FEATURE SRID | LEFT FEATURE DESCRIPTION | RIGHT FEATURE NAME | RIGHT FEATURE WKT | RIGHT FEATURE SRID | RIGHT FEATURE DESCRIPTION | BASELINE FEATURE NAME | BASELINE FEATURE WKT | BASELINE FEATURE SRID | BASELINE FEATURE DESCRIPTION | EARLIEST ISSUED TIME EXCLUSIVE | LATEST ISSUED TIME INCLUSIVE | EARLIEST VALID TIME EXCLUSIVE | LATEST VALID TIME INCLUSIVE | EARLIEST LEAD DURATION EXCLUSIVE | LATEST LEAD DURATION INCLUSIVE | TIME SCALE DURATION | TIME SCALE FUNCTION | EVENT THRESHOLD NAME | EVENT THRESHOLD LOWER VALUE | EVENT THRESHOLD UPPER VALUE | EVENT THRESHOLD UNITS | EVENT THRESHOLD LOWER PROBABILITY | EVENT THRESHOLD UPPER PROBABILITY | EVENT THRESHOLD SIDE | EVENT THRESHOLD OPERATOR | DECISION THRESHOLD NAME | DECISION THRESHOLD LOWER VALUE | DECISION THRESHOLD UPPER VALUE | DECISION THRESHOLD UNITS | DECISION THRESHOLD LOWER PROBABILITY | DECISION THRESHOLD UPPER PROBABILITY | DECISION THRESHOLD SIDE | DECISION THRESHOLD OPERATOR | METRIC NAME | METRIC COMPONENT NAME | METRIC COMPONENT QUALIFIER | METRIC COMPONENT UNITS | METRIC COMPONENT MINIMUM | METRIC COMPONENT MAXIMUM | METRIC COMPONENT OPTIMUM | STATISTIC GROUP NUMBER | SUMMARY STATISTIC NAME | SUMMARY STATISTIC COMPONENT NAME | SUMMARY STATISTIC UNITS | SUMMARY STATISTIC DIMENSION | SUMMARY STATISTIC QUANTILE | SAMPLE QUANTILE | STATISTIC |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | COEFFICIENT OF DETERMINATION | MAIN | DIMENSIONLESS | 0.0 | 1.0 | 1.0 | 1 | 0.1534782395406544 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | PEARSON CORRELATION COEFFICIENT | MAIN | DIMENSIONLESS | –1.0 | 1.0 | 1.0 | 2 | – | 0.3917629889877991 | ||||||||||||||||||||||||||||
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN SQUARE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 3 | 0.08557104128471933 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | ROOT MEAN SQUARE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 4 | 0.2925252831546691 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | BIAS FRACTION | MAIN | DIMENSIONLESS | -Infinity | Infinity | 0.0 | 5 | 1.5979759616040214 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN ABSOLUTE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 6 | 0.2916527890656166 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN ERROR | MAIN | CMS | -Infinity | Infinity | 0.0 | 7 | 0.2916527890656166 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 1 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT17H | PT17H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | SAMPLE SIZE | MAIN | COUNT | -Infinity | Infinity | 0.0 | 8 | 24.0 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | COEFFICIENT OF DETERMINATION | MAIN | DIMENSIONLESS | 0.0 | 1.0 | 1.0 | 9 | 0.4242742314172851 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | PEARSON CORRELATION COEFFICIENT | MAIN | DIMENSIONLESS | –1.0 | 1.0 | 1.0 | 10 | 0.6513633635823288 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN SQUARE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 11 | 0.09739978853406782 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | ROOT MEAN SQUARE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 12 | 0.31208939189608453 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | BIAS FRACTION | MAIN | DIMENSIONLESS | -Infinity | Infinity | 0.0 | 13 | 1.7343376726368764 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN ABSOLUTE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 14 | 0.31185468821686363 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN ERROR | MAIN | CMS | -Infinity | Infinity | 0.0 | 15 | 0.31185468821686363 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 2 | RIGHT | 07160500 | POINT ( –97.5850471 36.06004045 ) | 4326 | Skeleton Creek near Lovell, OK | 251482 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT10H | PT10H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | SAMPLE SIZE | MAIN | COUNT | -Infinity | Infinity | 0.0 | 16 | 24.0 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | COEFFICIENT OF DETERMINATION | MAIN | DIMENSIONLESS | 0.0 | 1.0 | 1.0 | 17 | NaN | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | PEARSON CORRELATION COEFFICIENT | MAIN | DIMENSIONLESS | –1.0 | 1.0 | 1.0 | 18 | NaN | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN SQUARE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 19 | 0.49567358637098435 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | ROOT MEAN SQUARE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 20 | 0.7040408982232385 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | BIAS FRACTION | MAIN | DIMENSIONLESS | -Infinity | Infinity | 0.0 | 21 | 4.810818740041824 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN ABSOLUTE ERROR | MAIN | CMS | 0.0 | Infinity | 0.0 | 22 | 0.7037211298396339 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | MEAN ERROR | MAIN | CMS | -Infinity | Infinity | 0.0 | 23 | 0.7037211298396339 | |||||||||||||||||||||||||||||
| streamflow | streamflow | 3 | RIGHT | 07160350 | POINT ( –97.8003332 36.3761449 ) | 4326 | Skeleton Creek at Enid, OK | 250456 | 2017-08-07T23:59:59Z | 2017-08-08T23:00:00Z | 2017-08-07T00:00:00Z | 2017-08-10T00:00:00Z | PT15H | PT15H | PT1M | UNKNOWN | -Infinity | LEFT AND RIGHT | GREATER | SAMPLE SIZE | MAIN | COUNT | -Infinity | Infinity | 0.0 | 24 | 19.0 |
The WRES Wiki
-
Options for Deploying and Operating the WRES
- Obtaining and using the WRES as a standalone application
- WRES Local Server
- WRES Web Service (under construction)
-
- Format Requirements for CSV Files
- Format Requirements for NetCDF Files
- Introductory Resources on Forecast Verification
- Instructions for Human Interaction with a WRES Web-service
- Instructions for Programmatic Interaction with a WRES Web-service
- Output Format Description for CSV2
- Posting timeseries data directly to a WRES web‐service as inputs for a WRES job
- WRES Scripts Usage Guide