User Tools

Site Tools


start:hype_file_reference:info.txt:criteria

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
start:hype_file_reference:info.txt:criteria [2016/01/08 13:13]
cpers
start:hype_file_reference:info.txt:criteria [2024/01/25 11:37] (current)
Line 1: Line 1:
 ====== Available performance criteria ====== ====== Available performance criteria ======
  
-Performance criteria that can be chosen as objective function for calibration in [[start:​hype_file_reference:​info.txt#​performance_criteria_options|info.txt]]. The criteria are calculated for the model domain, based on performances at individual subbasins where observations exists. ​Three kinds of combination of the individual subbasins are used:+Performance criteria that can be chosen as objective function for calibration in [[start:​hype_file_reference:​info.txt#​performance_criteria_options|info.txt]]. The criteria are calculated for the model domain, based on performances at individual subbasins where observations exists. ​Four kinds of combination of the individual subbasins are used:
   * **average/​median:​** criteria calculated in subbasins individually,​ and then combined (equal weight to each station, irrespective of time series length)   * **average/​median:​** criteria calculated in subbasins individually,​ and then combined (equal weight to each station, irrespective of time series length)
   * **regional:​** criteria calculated on a combined long time series over all subbasins (thus weighted by data lengths)   * **regional:​** criteria calculated on a combined long time series over all subbasins (thus weighted by data lengths)
   * **spatial:​** time series att each subbasin is collapsed to a single long-term average, these averages are then combined to a "​spatial series"​ over all subbasins, and the criteria calculated over those   * **spatial:​** time series att each subbasin is collapsed to a single long-term average, these averages are then combined to a "​spatial series"​ over all subbasins, and the criteria calculated over those
 +  * **weighted average:** criteria calculated in subbasins individually,​ and then combined as an weighted average with different weight (based on trust) to each station. The use of weighted average instead of arithmetic average is decided by a flag in info.txt (''​weightsub''​).
 +
 +Available performance criteria for domain-wide model evaluation are listed in the table below. The following criteria will use weighted average in case of flag set for weighted subbasins; ''​MR2'',​ ''​MRA'',​ ''​MRE'',​ ''​MRS'',​ ''​MCC'',​ ''​AKG'',​ ''​MNW'',​ ''​ASK'',​ ''​TAU'',​ and ''​MAR''​. Equation definitions for criteria calculation are described ​ [[start:​hype_file_reference:​info.txt:​criteria_equations#​criteria_equations_for_a_model_domain_several_stations|here]].
 +
 +**Note**: Kling-Gupta efficiency criteria can only be used on positive variables.
 +
 +**Note**: As described in [[start:​hype_file_reference:​info.txt#​performance_criteria_options|info.txt]],​ up to 100 performance criteria can be combined for model evaluation. However, for HYPE-internal computational reasons, **criteria ''​TAU'',​ ''​MRA'',​ ''​RRA'',​ and ''​SRA''​ criteria must be defined as one of the first four criteria in info.txt** (e.g. as ''​crit 1 criterion MRA''​). ​
  
-Performance criteria are chosen among the following. **Note:** ''​TAU''​ and any of the ''​RA''​ criteria only can be chosen as the 4 first criteria. Definitions of equations for calculating the criteria is found here. 
  
 /** /**
Line 19: Line 25:
  
 <​sortable>​ <​sortable>​
-^ Criterion ID ^ Description ^ Equation ID ^ +^ Criterion ID  ^ Description ​                                                                                                                                                                         ^ Equation ID   ​
-|''​MR2''​| average of Nash-Sutcliffe efficiency for all subbasins with observations.|//​AVNSE//​| +| ''​MR2'' ​      ​| average of Nash-Sutcliffe efficiency for all subbasins with observations. ​                                                                                                           | //​AVNSE// ​    ​
-|''​MRE''​| average of the relative bias for all subbasins (Note: fraction, not %).|//​AVRB//​| +| ''​MRE'' ​      ​| average of the relative bias for all subbasins (Note: fraction, not %).                                                                                                              | //​AVRB// ​     
-|''​MRA''​| average value of subbasin values of efficiency (RA) similar to Nash-Sutcliffe with coefficient //a// instead of a square.|//​AVRA//​| +| ''​MRA'' ​      ​| average value of subbasin values of efficiency (RA) similar to Nash-Sutcliffe with coefficient //a// instead of a square. ​                                                           | //​AVRA// ​     
-|''​MCC''​| Pearson correlation coefficient,​ average of all subbasins with observations.|//​AVCC//​| +| ''​MCC'' ​      ​| Pearson correlation coefficient,​ average of all subbasins with observations. ​                                                                                                        ​| //​AVCC// ​     
-|''​MRS''​| error in standard deviation, average of all subbasins with observations.|//​AVRSB//​| +| ''​MRS'' ​      ​| error in standard deviation, average of all subbasins with observations. ​                                                                                                            ​| //​AVRSB// ​    ​
-|''​MAR ''​| average of absolute relative bias for all subbasins (Note: fraction, not %).|//​AVARB//​| +| ''​MAR '' ​     | average of absolute relative bias for all subbasins (Note: fraction, not %).                                                                                                         ​| //​AVARB// ​    | 
-|''​RR2 ''​| regional Nash-Sutcliffe efficiency (all data combined in one long time series).|//​REGNSE//​| +| ''​MNW'' ​      | average of Nash-Sutcliffe efficiency adjusted for bias for all subbasins with observations. ​                                                                                         | //​AVNSEW// ​   | 
-|''​RRE ''​| regional relative bias (all data combined in one long time series).|//​REGRB//​| +| ''​AKG'' ​      | average of Kling-Gupta efficiency for all subbasins with observations. ​                                                                                                              | //​AVKGE// ​    | 
-|''​RRA ''​| regional efficiency similar to Nash-Sutcliffe with coefficient //a// instead of a square.|//​REGRA//​| +| ''​ASK'' ​      | average of rescaled Kling-Gupta efficiency for all subbasins with observations. ​                                                                                                     | //​ASCKGE// ​   ​
-|''​MD2 ''​| median of Nash-Sutcliffe efficiency for all subbasins with observations.|//​MEDNSE//​| +| ''​RR2 '' ​     | regional Nash-Sutcliffe efficiency (all data combined in one long time series). ​                                                                                                     | //​REGNSE// ​   
-|''​MDA ''​| median of all subbasins’ RA (efficiency similar to Nash-Sutcliffe with coefficient //a// instead of a square). |//​MEDRA//​| +| ''​RRE '' ​     | regional relative bias (all data combined in one long time series). ​                                                                                                                 | //​REGRB// ​    ​
-|''​MKG ''​| median of all subbasins’ Kling-Gupta efficiency.|//​MEDKGE//​| +| ''​RRA '' ​     | regional efficiency similar to Nash-Sutcliffe with coefficient //a// instead of a square. ​                                                                                           | //​REGRA// ​    ​
-|''​MNR ''​| median of all subbasins’ normalised RMSE.|//​MEDNE//​| +| ''​MD2 '' ​     | median of Nash-Sutcliffe efficiency for all subbasins with observations. ​                                                                                                            ​| //​MEDNSE// ​   
-|''​SR2 ''​| spatial Nash-Sutcliffe efficiency calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) to calculate the Nash-Sutcliffe efficiency.|//​SPATNSE//​| +| ''​MDA '' ​     | median of all subbasins’ RA (efficiency similar to Nash-Sutcliffe with coefficient //a// instead of a square). ​                                                                      ​| //​MEDRA// ​    ​
-|''​SRA ''​|Spatial efficiency similar to Nash-Sutcliffe with coefficient //a// instead of a square.|//​SPATRA//​| +| ''​MKG '' ​     | median of all subbasins’ Kling-Gupta efficiency. ​                                                                                                                                    ​| //​MEDKGE// ​   
-|''​TAU ''​| average of Kendall'​s rank correlation coefficient (Tau) value for all subbasins.|//​AVTAU//​|+| ''​MNR '' ​     | median of all subbasins’ normalised RMSE.                                                                                                                                            | //​MEDNE// ​    ​
 +| ''​SR2 '' ​     | spatial Nash-Sutcliffe efficiency calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) to calculate the Nash-Sutcliffe efficiency. ​ | //​SPATNSE// ​  ​
 +| ''​SRA '' ​     | Spatial efficiency similar to Nash-Sutcliffe with coefficient //a// instead of a square. ​                                                                                            ​| //​SPATRA// ​   | 
 +| ''​SNR '' ​     | Spatial RMSE.                                                                                                                                                                        | //​SPATRMSE// ​ | 
 +| ''​SMB '' ​     | Spatial mean absolute scaled bias on log transformed values. ​                                                                                                                        | //​SPATASB// ​  
 +| ''​TAU '' ​     | average of Kendall'​s rank correlation coefficient (Tau) value for all subbasins. ​                                                                                                    ​| //​AVTAU// ​    ​|
 </​sortable>​ </​sortable>​
start/hype_file_reference/info.txt/criteria.1452255227.txt.gz · Last modified: 2023/11/16 14:28 (external edit)