User Tools

Site Tools


start:hype_file_reference:bestsims.txt

This is an old revision of the document!


bestsims.txt

When performing calibrations that generate several simulations as results (e.g. Monte Carlo simulation) a number of best results (num_ens defined in optpar.txt) are saved to bestsims.txt, one row per simulation. The simulation with best objective function value (column CRIT) is first. The file is located in the resultdir folder given in info.txt.

For DEMC calibrations (task DE in optpar.txt), bestsims.txt contains parameter values of the last generations of all populations plus one row (first row in the file) with median values over all populations. Note: These parameter sets are the last ones accepted by the DEMC algorithm (column iacc == 1 in the allsim.txt result file).

File content

The first row contains column headings. The first column is the ordinal number, and the second the objective function on which the simulations are sorted. The closest following columns are a set of performance criteria (se table below and equations). When several criteria are given in info.txt to be used together as the objective function, the columns with performance information will be repeated once per such criteria. The last columns contain parameter values.

The value of a performance criterion will be given if it has been calculated during the simulation. Which criterion that is calculated is determined by the choice of objective function. Criterion that can be deduced from the calculations of the objective function are saved, but no additional is calculated. Missing values are indicated with -9999. If the objective function is composed of several criteria comparing the same variables, e.g. both NSE and RE of discharge, there will be still be several (two for the example) sets of performance criteria columns in the file, but they will have the same values since they are comparing the same variables. Note: If several RA criteria have been selected, only the last of them will be printed to file.

The columns of bestsims.txt:

Col Heading Description
1NOrow number
2CRITvalue of objective function
3rr2regional Nash-Sutcliffe efficiency (data from all subbasins combined in one data series)
4sr2spatial Nash-Sutcliffe efficiency, calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) to form one data series to calculate the Nash-Sutcliffe efficiency on
5mr2average of Nash-Sutcliffe efficiencies for subbasins
6rmaeregional mean absolute error (data from all subbasins combined in one data series)
7srespatial relative bias (calculated on annual means for all subbasins)
8rreregional relative bias (data from all subbasins combined in one data series)
9mreaverage of the relative bias for all subbasins (Note: fraction, not %)
10rraregional RA, similar to regional NSE, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged with a coefficient value
11sraspatial RA, similar to spatial NSE, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value
12mraaverage value of RA for subbasins, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged with a coefficient value
13tauaverage of Kendall's Tau value for subbasins
14md2median of Nash-Sutcliffe efficiency for subbasins
15mdamedian of all subbasins’ RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)
16mrsaverage of error in standard deviation for subbasins
17mccPearson correlation coefficient, average of all subbasins with observations
18mdkgmedian of Kling-Gupta efficiency (MKG in info.txt) for subbasins
19mareaverage of absolute relative bias for subbasins (Note: fraction. not %) (MAR in info.txt)
20mnrmedian of normalised RMSE for subbasins
21mnwaverage of Nash-Sutcliffe efficiencies adjusted for bias for subbasins
22numrcnumber of data points included in calculation of regional criteria
23nummcnumber of areas (subbasins/outregions) which criteria is included in mean and median criteria calculations
24-parnameparameter(s) that has been calibrated (one or several columns)

Example of bestsims.txt:

NO,CRIT,rr2,sr2,mr2,rmae,sre,rre,mre,rra,sra,mra,tau,md2,mda,mrs,mcc,mdkg,mare,mnr,mnw,numrc,nummc,cevp,wcfc,rrcs1,rivvel,damp
1,-0.15274,0.66997,-9999,0.15274,37.45872,-9999,-0.30995,-0.30442,-9999,-9999,-9999,-9999,0.21835,-9999,-0.38166,0.63855,0.24106,0.31151,0.12787,0.15274,20,3,0.26006,0.0856,0.4202,1.97909,0.19939
2,-0.15625,0.66977,-9999,0.15625,37.16421,-9999,-0.3007,-0.283,-9999,-9999,-9999,-9999,0.21904,-9999,-0.37735,0.63432,0.25736,0.31274,0.1269,0.15625,25,3,0.14034,0.25485,0.26864,0.74202,0.55459
start/hype_file_reference/bestsims.txt.1499239423.txt.gz · Last modified: 2023/11/16 14:28 (external edit)