User Tools

Site Tools


start:hype_file_reference:simass.txt

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
start:hype_file_reference:simass.txt [2015/05/04 17:16]
cpers
start:hype_file_reference:simass.txt [2024/02/13 14:15] (current)
cpers
Line 1: Line 1:
 ====== simass.txt ====== ====== simass.txt ======
  
-This is a file with simulation assessment, summarising performance criteria over model domain. The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder. The file contains values of most [[start:​hype_file_reference:​info.txt:​criteria|performance criteria]] of the selected variables in the objective function. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated criterion are indicated by -9999. ​All information from the simass-files can also be found in the [[start:​hype_file_reference:​hyss_yymmddhhmm.txt|hyss_yymmddHHMM.log]]. ​+This is a file with simulation assessment, summarising performance criteria over model domain. The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder. The file contains values of most [[start:​hype_file_reference:​info.txt:​criteria|performance criteria]] of the selected variables in the objective function. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated criterion are indicated by -9999. ​The above mentioned ​information from the simass-file can also be found in the [[start:​hype_file_reference:​hyss_yymmddhhmm.log|hyss.log]]. Both files also give the value of the objective function, but in the simass-file information of the individual criterion is written.
  
-When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>​0) are written to files named simassX_00I.txt, where //n// is defined by ''​num_ens''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]. ​+When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>​0) are written to files named simassX_00I.txt. For a Monte Carlo calibration ​//n// is defined by ''​num_ens''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]. ​For a DE calibration //n// is ''​num_ngen''​ plus one, where the first one is a simulation with median of the others parameter values.  ​
  
 +For the calculation of criterion for lake water stage, the combination of variables ''​wcom''​ and ''​wstr''​ are exchanged for the internal variables ''​clwc''​ and ''​clws''​ by the program. These variables are the water stages cleaned from ''​w0ref''​ reference level (''​clwc''​=''​wcom''​-''​w0ref'',​ ''​clws''​=''​wstr''​-''​w0ref''​). This makes the criterion calculation more accurate, but note that relative criteria, e.g. relative bias, are relative to the smaller cleaned water stage level.
  
  
-The following performance criteria may be calculated: corresponding code for [[start:​hype_file_reference:​info.txt|info.txt]].+The following performance criteria may be calculated: ​Code is corresponding code for [[start:​hype_file_reference:​info.txt|info.txt]]. Definitions of equations for calculating the criteria is found [[start:​hype_file_reference:​info.txt:​criteria_equations|here]].
  
 +/**
 + * ____________IMPORTANT!__________IMPORTANT!________________IMPORTANT!_______________________IMPORTANT!______________
 + *
 + * The table below is maintained in spreadsheed file '​file_reference_tables.xlsx'​
 + * in the wiki back-up folder on our server.
 + * Please edit table contents there and then copy-paste the updated full table to this page. Ask René if something is 
 + * unclear. Thanks.
 + * ___________________________________________________________________________________________________________________
 + */
  
 +<​sortable>​
 +^ Criterion ^ Code ^ Description ^
 +|''​Regional NSE''​|''​RR2''​|regional Nash-Sutcliffe efficiency (all data combined in one long time-series)|
 +|''​Regional RA''​|''​RRA''​|regional Nash-Sutcliffe efficiency like criteria where the square is exchanged with a coefficient value |
 +|''​Regional RE''​|''​RRE''​|regional relative bias (all data combined in one long time-series)|
 +|''​Regional MAE''​|''​-''​|regional absolute error (all data combined in one long time-series)|
 +|''​Average NSE''​|''​MR2''​|average of Nash-Sutcliffe efficiencies for all subbasins with observations|
 +|''​Average RA''​|''​MRA''​|average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value|
 +|''​Average RE''​|''​MRE''​|average of the relative bias for all subbasins (Note: fraction, not %)|
 +|''​Average RSDE''​|''​MRS''​|error in standard deviation, average of all subbasins with observations|
 +|''​Average CC''​|''​MCC''​|Pearson correlation coefficient,​ average of all subbasins with observations|
 +|''​Average ARE''​|''​MAR''​|mean absolute of relative errors for all subbasins (Note: fraction, not %)|
 +|''​Average KGE''​|''​AKG''​|average of KGE for all subbasins with observations|
 +|''​Average scalKGE''​|''​ASK''​|average of KGE rescaled to the interval [-1,1] by eq. KGE/​(2-KGE)|
 +|''​Spatial NSE''​|''​SR2''​|spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)|
 +|''​Spatial RA''​|''​RRA''​|Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value |
 +|''​Spatial RE''​|''​-''​|spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)|
 +|''​Spatial Bias''​|''​SMB''​|spatial mean absolute scaled bias on log transformed values|
 +|''​Spatial RMSE''​|''​SNR''​|spatial root mean square error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)|
 +|''​Kendalls Tau''​|''​TAU''​|average of Kendall'​s Tau value for all subbasins|
 +|''​Median NSE''​|''​MD2''​|median of Nash-Sutcliffe efficiency for all subbasins with observations|
 +|''​Median RA''​|''​MDA''​|median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)|
 +|''​Median KGE''​|''​MKG''​|median of all subbasins Kling-Gupta efficiency|
 +|''​Median NRMSE''​|''​MNR''​|median of all subbasins normalised RMSE|
 +|''​Mean NSEW''​|''​MNW''​|average of Nash-Sutcliffe efficiencies adjusted for bias for all subbasins with observations|
 +|''​Number of data for regional criterion''​|''​-''​|number of data points included in calculation of regional criteria|
 +|''​Number of areas in mean/median criterion''​|''​-''​|number of areas (subbasins/​outregions) which criteria is included in mean and median criteria calculations|
 +</​sortable>​
  
 +**Note:** If several RA criteria have been selected, only the last of them will be printed to file. 
  
start/hype_file_reference/simass.txt.1430752605.txt.gz · Last modified: 2023/11/16 14:28 (external edit)