Journal article · 2020 · Open access

Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis

Paloma Mara de Lima Ferreira, Adriano Rolim da Paz, Juan Martín Bravo

Revista Brasileira de Recursos Hídricos, 25 · Published 1 January 2020 · DOI 10.1590/2318-0331.252020190155

Free PDFView at the publisherCite this paper

In brief

“Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis” is a 2020 journal article by Paloma Mara de Lima Ferreira and 2 co-authors, published in Revista Brasileira de Recursos Hídricos. OpenAlex counts 37 citations as of 15 November 2026, which puts it in the top 7% of works published in 2020 by citations. It is open access under a CC BY licence: the full text is free to read at Revista Brasileira de Recursos Hídricos.

Citations
37
Most cited in
2023 (10)
Field-weighted impact
1.40
References
51
Authors
3

Abstract

Hydrological models (HMs) can be applied for different purposes, and a key step is model calibration using objective functions (OF) to quantify the agreement between observed and calculated discharges. Fully understanding the OF is important to properly take advantage of model calibration and interpret the results. This study evaluates 36 OF proposed in the literature, considering two watersheds of different hydrological regimes. Daily simulated streamflow time-series, using a distributed hydrological model (MGB-IPH), and ten daily streamflow synthetic time-series, generated from the observed and calculated streamflows, were used in the analysis of each watershed. These synthetic data were used to evaluate how does each metric evaluate hypothetical cases that present isolated very well known error behaviors. Despite of all NSE-derived (Nash-Sutcliffe efficiency) metrics that use the square of the residuals in their formulation have shown higher sensitivity to errors in high flows, the ones that use daily and monthly averages of flow rates in absolute terms were more stringent than the others to assess HMs performance. Low flow errors were better evaluated by metrics that use the flow logarithm. The constant presence of zero flow rates deteriorate them significantly, with the exception of the metrics TRMSE (Transformed root mean square error) did not demonstrate this problem. An observed limitation of the formulations of some metrics was that the errors of overestimation or underestimation are compensated. Our results reassert that each metric should be interpreted specifically thinking about the aspects it has been proposed for, and simultaneously taking into account a set of metrics would lead to a broader evaluation of HM ability (e.g. multiobjective model evaluation). We recommend that the use of synthetic time series as those proposed in this work could be useful as an auxiliary step towards better understanding the evaluation of a calibrated hydrological model for each study case, taking into account model capabilities and observed hydrologic regime characteristics.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Ferreira, P. M. D. L., da Paz, A. R., & Bravo, J. M. (2020). Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis. Revista Brasileira de Recursos Hídricos, 25. https://doi.org/10.1590/2318-0331.252020190155

MLA 9

Ferreira, Paloma Mara de Lima, et al. “Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis.” Revista Brasileira de Recursos Hídricos, vol. 25, 2020. https://doi.org/10.1590/2318-0331.252020190155.

Chicago

Ferreira, Paloma Mara de Lima, Adriano Rolim da Paz, and Juan Martín Bravo. 2020. “Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis.” Revista Brasileira de Recursos Hídricos 25. https://doi.org/10.1590/2318-0331.252020190155.

Harvard

Ferreira, P. M. D. L., da Paz, A. R. and Bravo, J. M. (2020) ‘Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis’, Revista Brasileira de Recursos Hídricos, 25. doi:10.1590/2318-0331.252020190155.

IEEE

P. M. D. L. Ferreira, A. R. da Paz, and J. M. Bravo, “Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis,” Revista Brasileira de Recursos Hídricos, vol. 25, 2020, doi: 10.1590/2318-0331.252020190155.

BibTeX

@article{ferreira2020objective,
  title     = {{Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis}},
  author    = {Ferreira, Paloma Mara de Lima and da Paz, Adriano Rolim and Bravo, Juan Martín},
  journal   = {Revista Brasileira de Recursos Hídricos},
  year      = {2020},
  volume    = {25},
  doi       = {10.1590/2318-0331.252020190155},
  url       = {https://doi.org/10.1590/2318-0331.252020190155}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202122
202266
20231010
20241010
202577
202622

Its field-weighted citation impact is 1.40: it has been cited 1.40 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies

  • hydrological model evaluation
  • objective function
  • performance indicators
  • Nash-Sutcliffe efficiency
  • streamflow simulation
  • zero flow
  • model calibration

Work with this paper

Most-cited papers in Environmental Science

All highly cited Environmental Science papers

Questions about this paper

How do I cite this paper in APA style?

Ferreira, P. M. D. L., da Paz, A. R., & Bravo, J. M. (2020). Objective functions used as performance metrics for hydrological models: state-of-the-art and critical analysis. Revista Brasileira de Recursos Hídricos, 25. https://doi.org/10.1590/2318-0331.252020190155

How many times has this paper been cited?

37 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Revista Brasileira de Recursos Hídricos.

Who wrote this paper?

Paloma Mara de Lima Ferreira, Adriano Rolim da Paz, Juan Martín Bravo.

What is the DOI of this paper?

10.1590/2318-0331.252020190155. The permanent link is https://doi.org/10.1590/2318-0331.252020190155.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.