====== allsim.txt ======

If a Monte Carlo simulation is chosen and configured so that all performance results will be written to file (''task WA'' defined in [[start:hype_file_reference:optpar.txt|optpar.txt]]), the results are written to //allsim.txt//, one simulation per row. The file is located in the [[start:hype_file_reference:info.txt&#model_options|resultdir]] folder given in [[start:hype_file_reference:info.txt|info.txt]]. The format is similar to that of [[start:hype_file_reference:bestsims.txt|bestsims.txt]]. Missing values are indicated as -9999.

==== File content ====

The first row contains column headings. The first column is the ordinal number, and the second the value of the  objective function on which the simulations are sorted. The closest following columns are a set of performance criteria (se table below and [[start:hype_file_reference:info.txt:criteria_equations|equations]]). When several criteria are given in [[start:hype_file_reference:info.txt|info.txt]] to be used together as the objective function, the columns with performance information will be repeated once per such criteria. 

The last columns contain parameter values. Only the parameters calibrated are included in the file. The heading of these columns is the parameter name. Thus for parameters that is not general parameters, several columns with the same name may occur. The number of those columns is the number of soil types, land uses etc. calibrated for that parameter.

The criterion value will be given if it has been calculated during the simulation. Which criterion that is calculated is determined by the choice of objective function. Criterion that can be deduced from the calculations of the objective function are saved, but no additional ones are calculated. Missing values are indicated with -9999. **Note:** If several RA criteria have been selected, only the last of them will be printed to file. 

The columns of //allsim.txt//:

/**
 * ____________IMPORTANT!__________IMPORTANT!________________IMPORTANT!_______________________IMPORTANT!______________
 *
 * The table below is maintained in spreadsheed file 'file_reference_tables.xlsx'
 * in the wiki back-up folder on our server.
 * Please edit table contents there and then copy-paste the updated full table to this page. Ask René if something is 
 * unclear. Thanks.
 * ___________________________________________________________________________________________________________________
 */

<sortable>
^ Column ^ Description ^
|''NO''|row number|
|''CRIT''|value of objective function|
|''rr2''|regional Nash-Sutcliffe efficiency (data from all subbasins combined in one data series)|
|''sr2''|spatial Nash-Sutcliffe efficiency, calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) to form one data series to calculate the Nash-Sutcliffe efficiency on|
|''mr2''|average of Nash-Sutcliffe efficiencies for subbasins|
|''rmae''|regional mean absolute error (data from all subbasins combined in one data series)|
|''sre''|spatial relative bias (calculated on annual means for all subbasins)|
|''rre''|regional relative bias (data from all subbasins combined in one data series)|
|''mre''|average of the relative bias for all subbasins (Note: fraction, not %)|
|''rra''|regional RA, similar to regional NSE, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged with a coefficient value|
|''sra''|spatial RA, similar to spatial NSE, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value|
|''mra''|average value of RA for subbasins, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged with a coefficient value|
|''tau''|average of Kendall's Tau value for subbasins|
|''md2''|median of Nash-Sutcliffe efficiency for subbasins|
|''mda''|median of all subbasins’ RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)|
|''mrs''|average of error in standard deviation for subbasins|
|''mcc''|Pearson correlation coefficient, average of all subbasins with observations|
|''mdkg''|median of Kling-Gupta efficiency for subbasins|
|''akg''|average of Kling-Gupta efficiency for subbasins|
|''asckg''|average of Kling-Gupta Efficiency rescaled to the interval [-1,1]|
|''mar''|average of absolute relative bias for subbasins (Note: fraction. not %)|
|''mdnr''|median of normalised RMSE for subbasins|
|''mnw''|average of Nash-Sutcliffe efficiencies adjusted for bias for subbasins|
|''snr''|spatial root mean square error|
|''smb''|spatial mean absolute scaled bias on natural log transformed values|
|''numrc''|number of data points included in calculation of regional criteria|
|''nummc''|number of areas (subbasins/outregions) which criteria is included in mean and median criteria calculations|
|''//parname//''|parameter(s) that has been calibrated (one or several columns)|
|''jpop''|population index in DEMC-simulation|
|''igen''|generation index in DEMC-simulation|
|''iacc''|acceptance code in DEMC-simulation (1=accepted)|
</sortable>