User Tools

Site Tools


start:hype_file_reference:simass.txt

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
start:hype_file_reference:simass.txt [2015/05/04 17:00]
cpers
start:hype_file_reference:simass.txt [2024/02/13 14:15] (current)
cpers
Line 1: Line 1:
 ====== simass.txt ====== ====== simass.txt ======
  
-The file is located in the resultdir folder. The file contains values of most performance criteria of the selected variables in the optimisation criteria. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated ​values ​are indicated by -9999.+This is a file with simulation assessment, summarising performance criteria over model domain. ​The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder. The file contains values of most [[start:​hype_file_reference:​info.txt:​criteria|performance criteria]] of the selected variables in the objective function. Note: If several RA criteria have been selected, only the last of them will be printed to file. Not calculated ​criterion ​are indicated by -9999. The above mentioned information from the simass-file can also be found in the [[start:​hype_file_reference:​hyss_yymmddhhmm.log|hyss.log]]. Both files also give the value of the objective function, but in the simass-file information of the individual criterion is written.
  
 +When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>​0) are written to files named simassX_00I.txt. For a Monte Carlo calibration //n// is defined by ''​num_ens''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]. For a DE calibration //n// is ''​num_ngen''​ plus one, where the first one is a simulation with median of the others parameter values.  ​
  
-This is a file with an assessment of each subbasin'​s performance. The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder. One file is printed for each [[start:​hype_file_reference:​info.txt:​criteria|performance ​criterion]] included in the objective function given in [[start:​hype_file_reference:​info.txt|info.txt]]. X is the ordinal number ​of the performance criterion ​and the subbasin assessment is calculated ​for the same variables ​as that performace criterionIf more than nine criteria ​are included, the following ​are denoted by capital letters.+For the calculation of criterion ​for lake water stage, ​the combination ​of variables ''​wcom'' ​and ''​wstr''​ are exchanged ​for the internal ​variables ​''​clwc''​ and ''​clws''​ by the programThese variables ​are the water stages cleaned from ''​w0ref''​ reference level (''​clwc''​=''​wcom''​-''​w0ref''​''​clws''​=''​wstr''​-''​w0ref''​). This makes the criterion calculation more accurate, but note that relative criteria, e.g. relative bias, are relative to the smaller cleaned water stage level.
  
-When ensemble or sequence simulations are made, the results from simulations (I=1 .. //n// or I=sequence number>​0) are written to files named subassX_00I.txt,​ where //n// is defined by ''​num_ens''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]. ​ 
  
 +The following performance criteria may be calculated: Code is corresponding code for [[start:​hype_file_reference:​info.txt|info.txt]]. Definitions of equations for calculating the criteria is found [[start:​hype_file_reference:​info.txt:​criteria_equations|here]].
  
 +/**
 + * ____________IMPORTANT!__________IMPORTANT!________________IMPORTANT!_______________________IMPORTANT!______________
 + *
 + * The table below is maintained in spreadsheed file '​file_reference_tables.xlsx'​
 + * in the wiki back-up folder on our server.
 + * Please edit table contents there and then copy-paste the updated full table to this page. Ask René if something is 
 + * unclear. Thanks.
 + * ___________________________________________________________________________________________________________________
 + */
  
-The following performance criteria may be calculated: corresponding code for info – description. +<​sortable>​ 
-Regional NSERR2 regional Nash-Sutcliffe ​R2 (all data combined in one long time-series) +^ Criterion ^ Code ^ Description ^ 
-Regional RARRA regional Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value  +|''​Regional NSE''​|''​RR2''​|regional Nash-Sutcliffe ​efficiency ​(all data combined in one long time-series)| 
-Regional RERRE regional relative ​error (all data combined in one long time-series)  +|''​Regional RA''​|''​RRA''​|regional Nash-Sutcliffe ​efficiency ​like criteria where the square is exchanged with a coefficient value | 
-Regional MAE- regional absolute error (all data combined in one long time-series) +|''​Regional RE''​|''​RRE''​|regional relative ​bias (all data combined in one long time-series)| 
-Average NSEMR2 average of all Nash-Sutcliffe ​R2s for all subbasins with observations +|''​Regional MAE''​|''​-''​|regional absolute error (all data combined in one long time-series)| 
-Average RAMRA average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value +|''​Average NSE''​|''​MR2''​|average of Nash-Sutcliffe ​efficiencies ​for all subbasins with observations| 
-Average REMRE average of the relative ​errors ​for all subbasins (Note: fraction, not %) +|''​Average RA''​|''​MRA''​|average value of subbasin values of Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value| 
-Average RSDEMRS – error in standard deviation, average of all subbasins with observations +|''​Average RE''​|''​MRE''​|average of the relative ​bias for all subbasins (Note: fraction, not %)| 
-Average CCMCC – Pearson correlation coefficient,​ average of all subbasins with observations +|''​Average RSDE''​|''​MRS''​|error in standard deviation, average of all subbasins with observations| 
-Average AREMAR – mean absolute of relative errors for all subbasins (Note: fraction, not %) +|''​Average CC''​|''​MCC''​|Pearson correlation coefficient,​ average of all subbasins with observations| 
-Spatial NSESR2 spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) +|''​Average ARE''​|''​MAR''​|mean absolute of relative errors for all subbasins (Note: fraction, not %)| 
-Spatial RA: SRA - Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value   ​ +|''​Average KGE''​|''​AKG''​|average of KGE for all subbasins with observations| 
-Spatial RE- spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) +|''​Average scalKGE''​|''​ASK''​|average of KGE rescaled to the interval [-1,1] by eq. KGE/​(2-KGE)| 
-Kendalls TauTAU average of Kendall'​s Tau value for all subbasins ​  ​ +|''​Spatial NSE''​|''​SR2''​|spatial R2 calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| 
-Median NSEMD2 median of Nash-Sutcliffe ​R2 for all subbasins with observations +|''​Spatial RA''​|''​RRA''​|Spatial Nash-Sutcliffe like criteria where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value | 
-Median RAMDA median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value) +|''​Spatial RE''​|''​-''​|spatial relative error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| 
-Median KGEMKG median of all subbasins Kling-Gupta ​Efficiency +|''​Spatial Bias''​|''​SMB''​|spatial mean absolute scaled bias on log transformed values| 
-Median NRMSEMNR median of all subbasins normalised RMSE+|''​Spatial RMSE''​|''​SNR''​|spatial root mean square error calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data)| 
 +|''​Kendalls Tau''​|''​TAU''​|average of Kendall'​s Tau value for all subbasins| 
 +|''​Median NSE''​|''​MD2''​|median of Nash-Sutcliffe ​efficiency ​for all subbasins with observations| 
 +|''​Median RA''​|''​MDA''​|median of all subbasins RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)| 
 +|''​Median KGE''​|''​MKG''​|median of all subbasins Kling-Gupta ​efficiency| 
 +|''​Median NRMSE''​|''​MNR''​|median of all subbasins normalised RMSE
 +|''​Mean NSEW''​|''​MNW''​|average of Nash-Sutcliffe efficiencies adjusted for bias for all subbasins with observations| 
 +|''​Number of data for regional criterion''​|''​-''​|number of data points included in calculation of regional criteria| 
 +|''​Number of areas in mean/median criterion''​|''​-''​|number of areas (subbasins/​outregions) which criteria is included in mean and median criteria calculations| 
 +</​sortable>​ 
 + 
 +**Note:** If several RA criteria have been selected, only the last of them will be printed to file. 
  
start/hype_file_reference/simass.txt.1430751626.txt.gz · Last modified: 2023/11/16 14:28 (external edit)