User Tools

Site Tools


start:hype_file_reference:simass.txt

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
start:hype_file_reference:simass.txt [2015/05/04 17:03]
cpers
start:hype_file_reference:simass.txt [2024/02/13 14:15] (current)
cpers
Line 1: Line 1:
 ====== simass.txt ====== ====== simass.txt ======
  
-This is a file with simulation assessment, summarising performance criteria over model domain. The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder. The file contains values of most [[start:​hype_file_reference:​info.txt:​criteria|performance criteria]] of the selected variables in the objective function. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated criterion are indicated by -9999. ​All information from the simass-files can also be found in the hyss.log+This is a file with simulation assessment, summarising performance criteria over model domain. The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder. The file contains values of most [[start:​hype_file_reference:​info.txt:​criteria|performance criteria]] of the selected variables in the objective function. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated criterion are indicated by -9999. ​The above mentioned ​information from the simass-file can also be found in the [[start:​hype_file_reference:​hyss_yymmddhhmm.log|hyss.log]]. Both files also give the value of the objective function, but in the simass-file information of the individual criterion is written.
  
-When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>​0) are written to files named simassX_00I.txt, where //n// is defined by ''​num_ens''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]. ​+When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>​0) are written to files named simassX_00I.txt. For a Monte Carlo calibration ​//n// is defined by ''​num_ens''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]. ​For a DE calibration //n// is ''​num_ngen''​ plus one, where the first one is a simulation with median of the others parameter values.  ​
  
 +For the calculation of criterion for lake water stage, the combination of variables ''​wcom''​ and ''​wstr''​ are exchanged for the internal variables ''​clwc''​ and ''​clws''​ by the program. These variables are the water stages cleaned from ''​w0ref''​ reference level (''​clwc''​=''​wcom''​-''​w0ref'',​ ''​clws''​=''​wstr''​-''​w0ref''​). This makes the criterion calculation more accurate, but note that relative criteria, e.g. relative bias, are relative to the smaller cleaned water stage level.
  
  
-The following performance criteria may be calculated: corresponding code for info – description+The following performance criteria may be calculated: ​Code is corresponding code for [[start:​hype_file_reference:​info.txt|info.txt]]. Definitions of equations for calculating the criteria is found [[start:​hype_file_reference:​info.txt:​criteria_equations|here]]
-Regional NSERR2 regional Nash-Sutcliffe ​R2 (all data combined in one long time-series) + 
-Regional RARRA regional Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value  +/** 
-Regional RERRE regional relative ​error (all data combined in one long time-series)  + * ____________IMPORTANT!__________IMPORTANT!________________IMPORTANT!_______________________IMPORTANT!______________ 
-Regional MAE- regional absolute error (all data combined in one long time-series) + * 
-Average NSEMR2 average of all Nash-Sutcliffe ​R2s for all subbasins with observations + * The table below is maintained in spreadsheed file '​file_reference_tables.xlsx'​ 
-Average RAMRA average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value + * in the wiki back-up folder on our server. 
-Average REMRE average of the relative ​errors ​for all subbasins (Note: fraction, not %) + * Please edit table contents there and then copy-paste the updated full table to this page. Ask René if something is  
-Average RSDEMRS – error in standard deviation, average of all subbasins with observations + * unclear. Thanks. 
-Average CCMCC – Pearson correlation coefficient,​ average of all subbasins with observations + * ___________________________________________________________________________________________________________________ 
-Average AREMAR – mean absolute of relative errors for all subbasins (Note: fraction, not %) + */ 
-Spatial NSESR2 spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) + 
-Spatial RA: SRA - Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value   ​ +<​sortable>​ 
-Spatial RE- spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) +^ Criterion ^ Code ^ Description ^ 
-Kendalls TauTAU average of Kendall'​s Tau value for all subbasins ​  ​ +|''​Regional NSE''​|''​RR2''​|regional Nash-Sutcliffe ​efficiency ​(all data combined in one long time-series)| 
-Median NSEMD2 median of Nash-Sutcliffe ​R2 for all subbasins with observations +|''​Regional RA''​|''​RRA''​|regional Nash-Sutcliffe ​efficiency ​like criteria where the square is exchanged with a coefficient value | 
-Median RAMDA median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value) +|''​Regional RE''​|''​RRE''​|regional relative ​bias (all data combined in one long time-series)| 
-Median KGEMKG median of all subbasins Kling-Gupta ​Efficiency +|''​Regional MAE''​|''​-''​|regional absolute error (all data combined in one long time-series)| 
-Median NRMSEMNR median of all subbasins normalised RMSE+|''​Average NSE''​|''​MR2''​|average of Nash-Sutcliffe ​efficiencies ​for all subbasins with observations| 
 +|''​Average RA''​|''​MRA''​|average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value| 
 +|''​Average RE''​|''​MRE''​|average of the relative ​bias for all subbasins (Note: fraction, not %)| 
 +|''​Average RSDE''​|''​MRS''​|error in standard deviation, average of all subbasins with observations| 
 +|''​Average CC''​|''​MCC''​|Pearson correlation coefficient,​ average of all subbasins with observations| 
 +|''​Average ARE''​|''​MAR''​|mean absolute of relative errors for all subbasins (Note: fraction, not %)| 
 +|''​Average KGE''​|''​AKG''​|average of KGE for all subbasins with observations| 
 +|''​Average scalKGE''​|''​ASK''​|average of KGE rescaled to the interval [-1,1] by eq. KGE/​(2-KGE)| 
 +|''​Spatial NSE''​|''​SR2''​|spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| 
 +|''​Spatial RA''​|''​RRA''​|Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value | 
 +|''​Spatial RE''​|''​-''​|spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| 
 +|''​Spatial Bias''​|''​SMB''​|spatial mean absolute scaled bias on log transformed values| 
 +|''​Spatial RMSE''​|''​SNR''​|spatial root mean square error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| 
 +|''​Kendalls Tau''​|''​TAU''​|average of Kendall'​s Tau value for all subbasins| 
 +|''​Median NSE''​|''​MD2''​|median of Nash-Sutcliffe ​efficiency ​for all subbasins with observations| 
 +|''​Median RA''​|''​MDA''​|median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)| 
 +|''​Median KGE''​|''​MKG''​|median of all subbasins Kling-Gupta ​efficiency| 
 +|''​Median NRMSE''​|''​MNR''​|median of all subbasins normalised RMSE
 +|''​Mean NSEW''​|''​MNW''​|average of Nash-Sutcliffe efficiencies adjusted for bias for all subbasins with observations| 
 +|''​Number of data for regional criterion''​|''​-''​|number of data points included in calculation of regional criteria| 
 +|''​Number of areas in mean/median criterion''​|''​-''​|number of areas (subbasins/​outregions) which criteria is included in mean and median criteria calculations| 
 +</​sortable>​ 
 + 
 +**Note:** If several RA criteria have been selected, only the last of them will be printed to file. 
  
start/hype_file_reference/simass.txt.1430751806.txt.gz · Last modified: 2023/11/16 14:28 (external edit)