User Tools

Site Tools


start:hype_file_reference:bestsims.txt

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
start:hype_file_reference:bestsims.txt [2018/09/25 16:31]
cpers
start:hype_file_reference:bestsims.txt [2024/01/25 11:38] (current)
Line 3: Line 3:
 When performing calibrations that generate several simulations as results (e.g. Monte Carlo simulation) a number of best results (''​num_ens''​ defined in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]) are saved to //​bestsims.txt//,​ one row per simulation. The simulation with best objective function value (column ''​CRIT''​) is first. The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder given in [[start:​hype_file_reference:​info.txt|info.txt]]. ​ When performing calibrations that generate several simulations as results (e.g. Monte Carlo simulation) a number of best results (''​num_ens''​ defined in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]) are saved to //​bestsims.txt//,​ one row per simulation. The simulation with best objective function value (column ''​CRIT''​) is first. The file is located in the [[start:​hype_file_reference:​info.txt&#​model_options|resultdir]] folder given in [[start:​hype_file_reference:​info.txt|info.txt]]. ​
  
-For DEMC calibrations (''​task DE''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]),​ //​bestsims.txt//​ contains parameter values of the last generations ​of all populations plus one row (first row in the file) with median values ​over all populations. **Note**: ​These parameter sets are the last ones accepted by the DEMC algorithm (column ''​iacc == 1''​ in the [[start:​hype_file_reference:​allsim.txt|allsim.txt]] result file). +For DEMC calibrations (''​task DE''​ in [[start:​hype_file_reference:​optpar.txt|optpar.txt]]),​ //​bestsims.txt//​ contains parameter values of the last generation ​of all populations plus one row (first row in the file) with median values ​of this last generation. **Note**: ​The population ​parameter sets are the last ones accepted by the DEMC algorithm (column ''​iacc == 1''​ in the [[start:​hype_file_reference:​allsim.txt|allsim.txt]] result file). ​**Note 2**: The median is here, for npop>3 and even npop, equal to the smaller of the two middle values, i.e. not the midpoint of them.
 ==== File content ==== ==== File content ====
  
-The first row contains column headings. The first column is the ordinal number, and the second is the value of the objective function on which the simulations are sorted. The closest following columns are a set of performance criteria (se table below and [[start:​hype_file_reference:​info.txt:​criteria_equations|equations]]). When several criteria are given in [[start:​hype_file_reference:​info.txt|info.txt]] to be used together as the objective function, the columns with performance information will be repeated once per such criteria. The last columns contain parameter values. ​+The first row contains column headings. The first column is the ordinal number, and the second is the value of the objective function on which the simulations are sorted. The closest following columns are a set of performance criteria (se table below and [[start:​hype_file_reference:​info.txt:​criteria_equations|equations]]). When several criteria are given in [[start:​hype_file_reference:​info.txt|info.txt]] to be used together as the objective function, the columns with performance information will be repeated once per such criteria. ​ 
 + 
 +The last columns contain parameter values. Only the parameters calibrated are included in the file. The heading of these columns is the parameter name. Thus for parameters that is not general parameters, several columns with the same name may occur. The number of those columns is the number of soil types, land uses etc. calibrated for that parameter.
  
 The value of a performance criterion will be given if it has been calculated during the simulation. Which criterion that is calculated is determined by the choice of objective function. Criterion that can be deduced from the calculations of the objective function are saved, but no additional ones are calculated. Missing values are indicated with -9999. If the objective function is composed of several criteria comparing the same variables, e.g. both NSE and RE of discharge, there will be still be several (two for the example) sets of performance criteria columns in the file, but they will have the same values since they are comparing the same variables. **Note:** If several RA criteria have been selected, only the last of them will be printed to file.  The value of a performance criterion will be given if it has been calculated during the simulation. Which criterion that is calculated is determined by the choice of objective function. Criterion that can be deduced from the calculations of the objective function are saved, but no additional ones are calculated. Missing values are indicated with -9999. If the objective function is composed of several criteria comparing the same variables, e.g. both NSE and RE of discharge, there will be still be several (two for the example) sets of performance criteria columns in the file, but they will have the same values since they are comparing the same variables. **Note:** If several RA criteria have been selected, only the last of them will be printed to file. 
Line 44: Line 45:
 |''​mrs''​|average of error in standard deviation for subbasins| |''​mrs''​|average of error in standard deviation for subbasins|
 |''​mcc''​|Pearson correlation coefficient,​ average of all subbasins with observations| |''​mcc''​|Pearson correlation coefficient,​ average of all subbasins with observations|
-|''​mkg''​|median of Kling-Gupta efficiency for subbasins|+|''​mdkg''​|median of Kling-Gupta efficiency for subbasins
 +|''​akg''​|average of Kling-Gupta efficiency for subbasins| 
 +|''​asckg''​|average of Kling-Gupta Efficiency rescaled to the interval [-1,1]|
 |''​mar''​|average of absolute relative bias for subbasins (Note: fraction. not %)| |''​mar''​|average of absolute relative bias for subbasins (Note: fraction. not %)|
-|''​mnr''​|median of normalised RMSE for subbasins|+|''​mdnr''​|median of normalised RMSE for subbasins|
 |''​mnw''​|average of Nash-Sutcliffe efficiencies adjusted for bias for subbasins| |''​mnw''​|average of Nash-Sutcliffe efficiencies adjusted for bias for subbasins|
 +|''​snr''​|spatial root mean square error|
 +|''​smb''​|spatial mean absolute scaled bias on natural log transformed values|
 |''​numrc''​|number of data points included in calculation of regional criteria| |''​numrc''​|number of data points included in calculation of regional criteria|
 |''​nummc''​|number of areas (subbasins/​outregions) which criteria is included in mean and median criteria calculations| |''​nummc''​|number of areas (subbasins/​outregions) which criteria is included in mean and median criteria calculations|
Line 54: Line 59:
  
 Example of //​bestsims.txt//:​ Example of //​bestsims.txt//:​
-  NO,​CRIT,​rr2,​sr2,​mr2,​rmae,​sre,​rre,​mre,​rra,​sra,​mra,​tau,​md2,​mda,​mrs,​mcc,​mdkg,​mare,mnr,​mnw,​numrc,​nummc,​cevp,​wcfc,​rrcs1,​rivvel,​damp +  NO,​CRIT,​rr2,​sr2,​mr2,​rmae,​sre,​rre,​mre,​rra,​sra,​mra,​tau,​md2,​mda,​mrs,​mcc,​mdkg,​akg,asckg,​mar,​mdnr,mnw,snr,smb,​numrc,​nummc,​cevp,​wcfc,​rrcs1,​rivvel,​damp 
-  1,-0.15274,0.66997,-9999,0.15274,37.45872,-9999,-0.30995,-0.30442,​-9999,​-9999,​-9999,​-9999,​0.21835,-9999,-0.38166,0.63855,0.24106,0.31151,0.12787,0.15274,20,3,0.26006,0.0856,​0.4202,​1.97909,​0.19939 +  1,-0.20237763,0.70495784,-9999,0.20237763,35.02048492,-9999,-0.27154529,-0.25385103,​-9999,​-9999,​-9999,​-9999,​0.18291715,-9999,-0.41173482,0.65588838,0.29082537,0.32529864,0.21824078,0.29653594,0.12578303,0.37322822,​-9999,​-9999,​8760,24,0.10426278,0.07934671,0.23716953,1.46884918,0.12412609 
-  2,​-0.15625,​0.66977,-9999,​0.15625,​37.16421,-9999,-0.3007,-0.283,​-9999,​-9999,​-9999,​-9999,0.21904,-9999,-0.37735,0.63432,0.25736,​0.31274,​0.1269,​0.15625,​25,​3,​0.14034,​0.25485,​0.26864,​0.74202,0.55459 +    
start/hype_file_reference/bestsims.txt.1537885905.txt.gz · Last modified: 2023/11/16 14:28 (external edit)