This is an old revision of the document!

Criteria equations

Performance criteria are used in several files. Different criterion is given in subass.txt and simass.txt files. In addition criteria can be selected in info.txt. Below is listed the code/heading used in each file together with the equation identificator. Further down all the equations are defined.

Code to equation coupling

Equation IDs for subbasin assessment criteria (subassX.txt):

Heading	Description	Equation ID
`NSE`	Nash-Sutcliffe efficiency	NSE
`CC`	Pearson correlation coefficient (Kling-Gupta efficiency, part 1)	CC
`RE(%)`	relative bias in percent	RE%
`RSDE(%)`	relative error in standard deviation in percent	RS%
`Sim`	average of simulated variable	cm
`Rec`	average of observed variable	rm
`SDSim`	standard deviation of simulated variable	cd
`SDRec`	standard deviation of observed variable	rd
`MAE`	mean absolute error	MAE
`RMSE`	root mean square error	RMSE
`Bias`	bias	Bias
`SDE`	Error of standard deviation	ES
`KGE`	Kling-Gupta efficiency	KGE
`KGESD`	Kling-Gupta efficiency, part 2	KGESD
`KGEM`	Kling-Gupta efficiency, part 3	KGEM
`NRMSE`	normalised root mean square error	NE
`NSEW`	Nash-Sutcliffe efficiency adjusted for bias	NSEW

Equation IDs for simulation assessment criteria (simass.txt):

Name	Code	Equation ID
Regional NSE	`RR2`	REGNSE
Regional RA	`RRA`	REGRA
Regional RE	`RRE`	REGRB
Regional MAE	`-`	REGMAE
Average NSE	`MR2`	AVNSE
Average RA	`MRA`	AVRA
Average RE	`MRE`	AVRB
Average RSDE	`MRS`	AVRSB
Average CC	`MCC`	AVCC
Average ARE	`MAR`	AVARB
Spatial NSE	`SR2`	SPATNSE
Spatial RA	`RRA`	SPATRA
Spatial RE	`-`	SPATRB
Kendalls Tau	`TAU`	AVTAU
Median NSE	`MD2`	MEDNSE
Median RA	`MDA`	MEDRA
Median KGE	`MKG`	MEDKGE
Median NRMSE	`MNR`	MEDNE
Mean NSEW	`MNW`	AVNSEW

Equation IDs for calibration simulation assessment criteria (bestsims.txt and allsim.txt):

Heading	Description	Equation ID
`rr2`	regional Nash-Sutcliffe efficiency (data from all subbasins combined in one data series)	REGNSE
`sr2`	spatial Nash-Sutcliffe efficiency, calculated using annual means for all subbasins (requires at least 5 years and 5 subbasins with data) to form one data series to calculate the Nash-Sutcliffe efficiency on	SPATNSE
`mr2`	average of Nash-Sutcliffe efficiencies for subbasins	AVNSE
`rmae`	regional mean absolute error (data from all subbasins combined in one data series)	REGMAE
`sre`	spatial relative bias (calculated on annual means for all subbasins)	SPATRB
`rre`	regional relative bias (data from all subbasins combined in one data series)	REGRB
`mre`	average of the relative bias for all subbasins (Note: fraction, not %)	AVRB
`rra`	regional RA, similar to regional NSE, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged with a coefficient value	REGRA
`sra`	spatial RA, similar to spatial NSE, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged for a coefficient value	SPATRA
`mra`	average value of RA for subbasins, RA is a Nash-Sutcliffe like criterion where the square in the Nash-Sutcliffe formula is exchanged with a coefficient value	AVRA
`tau`	average of Kendall's Tau value for subbasins	AVTAU
`md2`	median of Nash-Sutcliffe efficiency for subbasins	MEDNSE
`mda`	median of all subbasins’ RA (Nash-Sutcliffe like criteria where the square is exchanged with a coefficient value)	MEDRA
`mrs`	average of error in standard deviation for subbasins	AVRSB
`mcc`	Pearson correlation coefficient, average of all subbasins with observations	AVCC
`mdkg`	median of Kling-Gupta efficiency (MKG in info.txt) for subbasins	MEDKGE
`mare`	average of absolute relative bias for subbasins (Note: fraction. not %) (MAR in info.txt)	AVARB
`mnr`	median of normalised RMSE for subbasins	MEDNE
`mnw`	average of Nash-Sutcliffe efficiencies adjusted for bias for subbasins	AVNSEW

Equation IDs for performance criteria set in info.txt are tabled here.

Equation definitions

Denotations

c	computed value
r	recorded value
i	index for time steps with observations in a time series of a station
mi	number of values in a time series of a station
j	index of stations
mj	number of stations
ij	index over time steps with observations for all stations
mij	number of time steps with obsevations for all stations
cm	average value of $c_{i}, i=1,mi$ for a station
rm	average value of $r_{i}, i=1,mi$ for a station
cd	standard deviation of $c_{i}, i=1,mi$ for a station
rd	standard deviation of $r_{i}, i=1,mi$ for a station

Basic equations

Average value for a time series of a station:

$xm = {1/mi} sum{i=1}{mi}{x_{i}}$ x=r or c

Standard deviation of a time series of a station:

$xd = sqrt{{1/mi} sum{i=1}{mi}{{x_{i}}^2}-xm^2}$ x=r or c

Criteria equations for a time series of a station

Nash-Sutcliffe Efficiency (NSE or R2):

$NSE = 1-{sum{i=1}{mi}{(c_{i}-r_{i})^2}}/{sum{i=1}{mi}{(r_{i}-rm)^2}}$

Efficiency with coefficient a (RA):

$RA = 1-{sum{i=1}{mi}{delim{|} {c_{i}-r_{i}} {|}^a}}/{sum{i=1}{mi}{delim{|} {r_{i}-rm} {|}^a}}$

Bias:

$Bias = {sum{i=1}{mi}{(c_{i}-r_{i})}}/mi$

Relative bias (RB or RE):

$RB = {sum{i=1}{mi}{(c_{i}-r_{i})}}/{delim{|}{sum{i=1}{mi}{r_{i}}}{|}}$

Relative bias in percent (RE%):

$RE% = RB*100 = {{sum{i=1}{mi}{(c_{i}-r_{i})}}/{delim{|}{sum{i=1}{mi}{r_{i}}}{|}}}*100$

Error of standard deviation (ES):

ES = {cd-rd}

Relative error of standard deviation (RS):

RS = {{cd-rd}/rd}

Relative error of standard deviation in percent (RS%):

RS% = RS*100 = {{cd-rd}/rd}*100

Mean absolute error (MAE):

$MAE = {sum{i=1}{mi}{delim{|}{c_{i}-r_{i}}{|}}}/mi$

Kling-Gupta efficiency (KGE):

$KGE = 1-sqrt{(CC-1)^2+(cd/rd-1)^2+(cm/rm-1)^2}$

Pearson correlation coefficient, Kling-Gupta efficiency part 1 (CC):

$CC = {{1/mi} sum{i=1}{mi}{({r_{i}}*{c_{i}})}-cm*rm}/{cd*rd}$

Kling-Gupta efficiency part 2 (KGESD):

KGESD = cd/rd

Kling-Gupta efficiency part 3 (KGEM):

KGEM = cm/rm

Root mean square error (RMSE):

$RMSE = sqrt{{1/mi sum{i=1}{mi}{({c_{i}}-{r_{i}})^2}}}$

Normalised root mean square error (NE):

$NE = sqrt{{1/mi sum{i=1}{mi}{({c_{i}}-{r_{i}})^2}}}/{max{(r_{i}})}$

Kendalls rank correlation coefficient, tau-b, with adjustments for ties (TAU):

$TAU = {n_{c}-n_{d}}/{sqrt{(n_{0}-n_{1})(n_{0}-n_{2})}}$

Nash-Sutcliffe Efficiency adjusted for bias (NSEW). Introduced in Lindström (2016):

NSEW = NSE-Bias^2/rd^2

where

$n_{c}$ = number of concordant pairs ( $c_{i}<c_{k} and r_{i}<r_{k} or c_{i}>c_{k} and r_{i}>r_{k}, i=1,mi k=1,mi$ )

$n_{d}$ = number of discordant pairs ( $c_{i}<c_{k} and r_{i}>r_{k} or c_{i}>c_{k} and r_{i}<r_{k}, i=1,mi k=1,mi$ )

$n_{0}$ = number of compared pairs

$n_{1}$ = number of compared pairs that ties in the computed values

$n_{2}$ = number of compared pairs that ties in the recorded values

Criteria equations for a model domain (several stations)

Average Nash-Sutcliffe efficiency (AVNSE):

$AVNSE = {1/mj sum{j=1}{mj}{NSE_{j}}}$

Median Nash-Sutcliffe efficiency (MEDNSE):

$MEDNSE = median delim{lbrace}{{NSE_{j}},{j=1..mj}}{rbrace}$

Spatial Nash-Sutcliffe efficiency (SPATNSE):

$SPATNSE = 1-{sum{j=1}{mj}{(cm_{j}-rm_{j})^2}}/{sum{j=1}{mj}{(rm_{j}-{1/mj} sum{j=1}{mj}{rm_{j}})^2}}$

Regional Nash-Sutcliffe efficiency (REGNSE):

$REGNSE = 1-{sum{ij=1}{mij}{(c_{ij}-r_{ij})^2}}/{sum{ij=1}{mij}{(r_{ij}-{1/mij} sum{ij=1}{mij}{r_{ij}})^2}}$

Average efficiency with coefficient a (AVRA):

$AVRA = {1/mj sum{j=1}{mj}{RA_{j}}}$

Median efficiency with coefficient a (MEDRA):

$MEDRA = median delim{lbrace}{{RA_{j}},{j=1..mj}}{rbrace}$

Spatial efficiency with coefficient a (SPATRA):

$SPATRA = 1-{sum{j=1}{mj}{delim{|}{cm_{j}-rm_{j}}{|}^a}}/{sum{j=1}{mj}{delim{|}{rm_{j}-{1/mj} sum{j=1}{mj}{rm_{j}}}{|}^a}}$

Regional efficiency with coefficient a (REGRA):

$REGRA = 1-{sum{ij=1}{mij}{delim{|}{c_{ij}-r_{ij}}{|}^a}}/{sum{ij=1}{mij}{delim{|}{r_{ij}-{1/mij} sum{ij=1}{mij}{r_{ij}}}{|}^a}}$

Average relative bias (AVRB):

$AVRB = {1/mj sum{j=1}{mj}{RB_{j}}}$

Regional relative bias (REGRB):

$REGRB = {sum{ij=1}{mij}{(c_{ij}-r_{ij})}}/{delim{|}{sum{ij=1}{mij}{r_{ij}}}{|}}$

Spatial relative bias (SPATRB):

$SPATRB = {sum{j=1}{mj}{(cm_{j}-rm_{j})}}/{delim{|}{sum{j=1}{mj}{rm_{j}}}{|}}$

Median Kling-Gupta efficiency (MEDKGE):

$MEDKGE = median delim{lbrace}{{KGE_{j}},{j=1..mj}}{rbrace}$

Median of Normalised root mean square error (MEDNE):

$MEDNE = median delim{lbrace}{{NE_{j}},{j=1..mj}}{rbrace}$

Average of absolute relative bias (AVARB):

$AVARB = {1/mj sum{j=1}{mj}{delim{|}{RB_{j}}{|}}}$

Average Pearson correlation coefficient (AVCC):

$AVCC = {1/mj sum{j=1}{mj}{CC_{j}}}$

Average relative error of standard deviation (AVRSB):

$AVRSB = {1/mj sum{j=1}{mj}{RS_{j}}}$

Average Kendalls rank correlation coefficient (AVTAU):

$AVTAU = {1/mj sum{j=1}{mj}{TAU_{j}}}$

Regional mean absolute error (REGMAE):

$REGMAE = {sum{ij=1}{mij}{delim{|}{c_{ij}-r_{ij}}{|}}}/mij$

Average Nash-Sutcliffe efficiency adjusted for bias (AVNSEW):

$AVNSEW = {1/mj sum{j=1}{mj}{NSEW_{j}}}$

References

Lindström, G., 2016. Lake water levels for calibration of the S-HYPE model. Hydrology Research 47.4:672-682. doi: 10.2166/nh.2016.019.

HYPE Model Documentation

Sidebar

Navigation

HYPE Documentation

HYPE links

Wiki editing/maintenance

Table of Contents

Criteria equations

Code to equation coupling