This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
start:hype_file_reference:simass.txt [2015/05/04 17:00] cpers |
start:hype_file_reference:simass.txt [2024/02/13 14:15] (current) cpers |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== simass.txt ====== | ====== simass.txt ====== | ||
- | The file is located in the resultdir folder. The file contains values of most performance criteria of the selected variables in the optimisation criteria. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated values are indicated by -9999. | + | This is a file with simulation assessment, summarising performance criteria over model domain. The file is located in the [[start:hype_file_reference:info.txt&#model_options|resultdir]] folder. The file contains values of most [[start:hype_file_reference:info.txt:criteria|performance criteria]] of the selected variables in the objective function. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated criterion are indicated by -9999. The above mentioned information from the simass-file can also be found in the [[start:hype_file_reference:hyss_yymmddhhmm.log|hyss.log]]. Both files also give the value of the objective function, but in the simass-file information of the individual criterion is written. |
+ | When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>0) are written to files named simassX_00I.txt. For a Monte Carlo calibration //n// is defined by ''num_ens'' in [[start:hype_file_reference:optpar.txt|optpar.txt]]. For a DE calibration //n// is ''num_ngen'' plus one, where the first one is a simulation with median of the others parameter values. | ||
- | This is a file with an assessment of each subbasin's performance. The file is located in the [[start:hype_file_reference:info.txt&#model_options|resultdir]] folder. One file is printed for each [[start:hype_file_reference:info.txt:criteria|performance criterion]] included in the objective function given in [[start:hype_file_reference:info.txt|info.txt]]. X is the ordinal number of the performance criterion and the subbasin assessment is calculated for the same variables as that performace criterion. If more than nine criteria are included, the following are denoted by capital letters. | + | For the calculation of criterion for lake water stage, the combination of variables ''wcom'' and ''wstr'' are exchanged for the internal variables ''clwc'' and ''clws'' by the program. These variables are the water stages cleaned from ''w0ref'' reference level (''clwc''=''wcom''-''w0ref'', ''clws''=''wstr''-''w0ref''). This makes the criterion calculation more accurate, but note that relative criteria, e.g. relative bias, are relative to the smaller cleaned water stage level. |
- | When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>0) are written to files named subassX_00I.txt, where //n// is defined by ''num_ens'' in [[start:hype_file_reference:optpar.txt|optpar.txt]]. | ||
+ | The following performance criteria may be calculated: Code is corresponding code for [[start:hype_file_reference:info.txt|info.txt]]. Definitions of equations for calculating the criteria is found [[start:hype_file_reference:info.txt:criteria_equations|here]]. | ||
+ | /** | ||
+ | * ____________IMPORTANT!__________IMPORTANT!________________IMPORTANT!_______________________IMPORTANT!______________ | ||
+ | * | ||
+ | * The table below is maintained in spreadsheed file 'file_reference_tables.xlsx' | ||
+ | * in the wiki back-up folder on our server. | ||
+ | * Please edit table contents there and then copy-paste the updated full table to this page. Ask René if something is | ||
+ | * unclear. Thanks. | ||
+ | * ___________________________________________________________________________________________________________________ | ||
+ | */ | ||
- | The following performance criteria may be calculated: corresponding code for info – description. | + | <sortable> |
- | Regional NSE: RR2 - regional Nash-Sutcliffe R2 (all data combined in one long time-series) | + | ^ Criterion ^ Code ^ Description ^ |
- | Regional RA: RRA - regional Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value | + | |''Regional NSE''|''RR2''|regional Nash-Sutcliffe efficiency (all data combined in one long time-series)| |
- | Regional RE: RRE - regional relative error (all data combined in one long time-series) | + | |''Regional RA''|''RRA''|regional Nash-Sutcliffe efficiency like criteria where the square is exchanged with a coefficient value | |
- | Regional MAE: - regional absolute error (all data combined in one long time-series) | + | |''Regional RE''|''RRE''|regional relative bias (all data combined in one long time-series)| |
- | Average NSE: MR2 - average of all Nash-Sutcliffe R2s for all subbasins with observations | + | |''Regional MAE''|''-''|regional absolute error (all data combined in one long time-series)| |
- | Average RA: MRA - average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value | + | |''Average NSE''|''MR2''|average of Nash-Sutcliffe efficiencies for all subbasins with observations| |
- | Average RE: MRE - average of the relative errors for all subbasins (Note: fraction, not %) | + | |''Average RA''|''MRA''|average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value| |
- | Average RSDE: MRS – error in standard deviation, average of all subbasins with observations | + | |''Average RE''|''MRE''|average of the relative bias for all subbasins (Note: fraction, not %)| |
- | Average CC: MCC – Pearson correlation coefficient, average of all subbasins with observations | + | |''Average RSDE''|''MRS''|error in standard deviation, average of all subbasins with observations| |
- | Average ARE: MAR – mean absolute of relative errors for all subbasins (Note: fraction, not %) | + | |''Average CC''|''MCC''|Pearson correlation coefficient, average of all subbasins with observations| |
- | Spatial NSE: SR2 - spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) | + | |''Average ARE''|''MAR''|mean absolute of relative errors for all subbasins (Note: fraction, not %)| |
- | Spatial RA: SRA - Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value | + | |''Average KGE''|''AKG''|average of KGE for all subbasins with observations| |
- | Spatial RE: - spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) | + | |''Average scalKGE''|''ASK''|average of KGE rescaled to the interval [-1,1] by eq. KGE/(2-KGE)| |
- | Kendalls Tau: TAU - average of Kendall's Tau value for all subbasins | + | |''Spatial NSE''|''SR2''|spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| |
- | Median NSE: MD2 - median of Nash-Sutcliffe R2 for all subbasins with observations | + | |''Spatial RA''|''RRA''|Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value | |
- | Median RA: MDA - median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value) | + | |''Spatial RE''|''-''|spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| |
- | Median KGE: MKG - median of all subbasins Kling-Gupta Efficiency | + | |''Spatial Bias''|''SMB''|spatial mean absolute scaled bias on log transformed values| |
- | Median NRMSE: MNR - median of all subbasins normalised RMSE | + | |''Spatial RMSE''|''SNR''|spatial root mean square error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| |
+ | |''Kendalls Tau''|''TAU''|average of Kendall's Tau value for all subbasins| | ||
+ | |''Median NSE''|''MD2''|median of Nash-Sutcliffe efficiency for all subbasins with observations| | ||
+ | |''Median RA''|''MDA''|median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)| | ||
+ | |''Median KGE''|''MKG''|median of all subbasins Kling-Gupta efficiency| | ||
+ | |''Median NRMSE''|''MNR''|median of all subbasins normalised RMSE| | ||
+ | |''Mean NSEW''|''MNW''|average of Nash-Sutcliffe efficiencies adjusted for bias for all subbasins with observations| | ||
+ | |''Number of data for regional criterion''|''-''|number of data points included in calculation of regional criteria| | ||
+ | |''Number of areas in mean/median criterion''|''-''|number of areas (subbasins/outregions) which criteria is included in mean and median criteria calculations| | ||
+ | </sortable> | ||
+ | |||
+ | **Note:** If several RA criteria have been selected, only the last of them will be printed to file. | ||