====== simass.txt ====== This is a file with simulation assessment, summarising performance criteria over model domain. The file is located in the [[start:hype_file_reference:info.txt&#model_options|resultdir]] folder. The file contains values of most [[start:hype_file_reference:info.txt:criteria|performance criteria]] of the selected variables in the objective function. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated criterion are indicated by -9999. The above mentioned information from the simass-file can also be found in the [[start:hype_file_reference:hyss_yymmddhhmm.log|hyss.log]]. Both files also give the value of the objective function, but in the simass-file information of the individual criterion is written. When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>0) are written to files named simassX_00I.txt. For a Monte Carlo calibration //n// is defined by ''num_ens'' in [[start:hype_file_reference:optpar.txt|optpar.txt]]. For a DE calibration //n// is ''num_ngen'' plus one, where the first one is a simulation with median of the others parameter values. For the calculation of criterion for lake water stage, the combination of variables ''wcom'' and ''wstr'' are exchanged for the internal variables ''clwc'' and ''clws'' by the program. These variables are the water stages cleaned from ''w0ref'' reference level (''clwc''=''wcom''-''w0ref'', ''clws''=''wstr''-''w0ref''). This makes the criterion calculation more accurate, but note that relative criteria, e.g. relative bias, are relative to the smaller cleaned water stage level. The following performance criteria may be calculated: Code is corresponding code for [[start:hype_file_reference:info.txt|info.txt]]. Definitions of equations for calculating the criteria is found [[start:hype_file_reference:info.txt:criteria_equations|here]]. /** * ____________IMPORTANT!__________IMPORTANT!________________IMPORTANT!_______________________IMPORTANT!______________ * * The table below is maintained in spreadsheed file 'file_reference_tables.xlsx' * in the wiki back-up folder on our server. * Please edit table contents there and then copy-paste the updated full table to this page. Ask René if something is * unclear. Thanks. * ___________________________________________________________________________________________________________________ */ ^ Criterion ^ Code ^ Description ^ |''Regional NSE''|''RR2''|regional Nash-Sutcliffe efficiency (all data combined in one long time-series)| |''Regional RA''|''RRA''|regional Nash-Sutcliffe efficiency like criteria where the square is exchanged with a coefficient value | |''Regional RE''|''RRE''|regional relative bias (all data combined in one long time-series)| |''Regional MAE''|''-''|regional absolute error (all data combined in one long time-series)| |''Average NSE''|''MR2''|average of Nash-Sutcliffe efficiencies for all subbasins with observations| |''Average RA''|''MRA''|average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value| |''Average RE''|''MRE''|average of the relative bias for all subbasins (Note: fraction, not %)| |''Average RSDE''|''MRS''|error in standard deviation, average of all subbasins with observations| |''Average CC''|''MCC''|Pearson correlation coefficient, average of all subbasins with observations| |''Average ARE''|''MAR''|mean absolute of relative errors for all subbasins (Note: fraction, not %)| |''Average KGE''|''AKG''|average of KGE for all subbasins with observations| |''Average scalKGE''|''ASK''|average of KGE rescaled to the interval [-1,1] by eq. KGE/(2-KGE)| |''Spatial NSE''|''SR2''|spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| |''Spatial RA''|''RRA''|Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value | |''Spatial RE''|''-''|spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| |''Spatial Bias''|''SMB''|spatial mean absolute scaled bias on log transformed values| |''Spatial RMSE''|''SNR''|spatial root mean square error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| |''Kendalls Tau''|''TAU''|average of Kendall's Tau value for all subbasins| |''Median NSE''|''MD2''|median of Nash-Sutcliffe efficiency for all subbasins with observations| |''Median RA''|''MDA''|median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)| |''Median KGE''|''MKG''|median of all subbasins Kling-Gupta efficiency| |''Median NRMSE''|''MNR''|median of all subbasins normalised RMSE| |''Mean NSEW''|''MNW''|average of Nash-Sutcliffe efficiencies adjusted for bias for all subbasins with observations| |''Number of data for regional criterion''|''-''|number of data points included in calculation of regional criteria| |''Number of areas in mean/median criterion''|''-''|number of areas (subbasins/outregions) which criteria is included in mean and median criteria calculations| **Note:** If several RA criteria have been selected, only the last of them will be printed to file.