Hydrology and Earth System Sciences www.hydrol-earth-syst-sci.net 1027-5606 1607-7938 12 2 2008 10.5194/hess-12-657-2008 http://www.hydrol-earth-syst-sci.net/12/657/2008/ http://www.hydrol-earth-syst-sci.net/12/657/2008/hess-12-657-2008.html http://www.hydrol-earth-syst-sci.net/12/657/2008/hess-12-657-2008.pdf 657 667 2008-04-09 Towards model evaluation and identification using Self-Organizing Maps M. Herbst herbstm@uni-trier.de M. C. Casper Department of Physical Geography, University of Trier, Germany The reduction of information contained in model time series through the use of aggregating statistical performance measures is very high compared to the amount of information that one would like to draw from it for model identification and calibration purposes. It has been readily shown that this loss imposes important limitations on model identification and -diagnostics and thus constitutes an element of the overall model uncertainty. In this contribution we present an approach using a Self-Organizing Map (SOM) to circumvent the identifiability problem induced by the low discriminatory power of aggregating performance measures. Instead, a Self-Organizing Map is used to differentiate the spectrum of model realizations, obtained from Monte-Carlo simulations with a distributed conceptual watershed model, based on the recognition of different patterns in time series. Further, the SOM is used instead of a classical optimization algorithm to identify those model realizations among the Monte-Carlo simulation results that most closely approximate the pattern of the measured discharge time series. The results are analyzed and compared with the manually calibrated model as well as with the results of the Shuffled Complex Evolution algorithm (SCE-UA). In our study the latter slightly outperformed the SOM results. The SOM method, however, yields a set of equivalent model parameterizations and therefore also allows for confining the parameter space to a region that closely represents a measured data set. This particular feature renders the SOM potentially useful for future model identification applications. Alhoniemi, E., Hollmén, J., Simula, O., and Vesanto, J.: Process Monitoring and Modeling using the Self-Organizing Map, Integr. Comput.-Aid. E., 6, 3–14, 1999. Allinson, N. M. and Yin, H.: Self-Organising Maps for Pattern Recognition, in: Kohonen Maps, edited by: Oja, E. and Kaski, S., Elsevier, Amsterdam, 111–120, 1999. Ambroise, B., Perrin, J. L., and Reutenauer, D.: Multicriterion validation of a semidistributed conceptual model of the water cycle in the Fecht Catchment (Vosges Massif, France), Water Resour. Res., 31, 1467–1482, 1995. Beven, K. J. and Binley, A.: The future of distributed models: model calibration and uncertainty prediction, Hydrol. Process., 6, 279-298, 1992. Boyle, D. P., Gupta, H. V., and Sorooshian, S.: Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods, Water Resour. Res., 36, 3663-3674, 2000. Cho, J.: Multiple Modelling and Control of Nonlinear Systems with Self-Organizing Maps, PhD Thesis, University of Florida, 130 pp., 2004. Clemen, T.: Zur Wavelet-gestützten Validierung von Simulationsmodellen in der Ökologie, Dissertation, Institut für Informatik und Praktische Mathematik, Christian-Albrechts-Universität, Kiel, 111 pp., 1999. Duan, Q., Gupta, V. K., and Sorooshian, S.: Shuffled complex evolution approach for effective and efficient global minimization, J. Optimiz. Theory App., 76, 501–521, 1993. Franks, S. W., Gineste, P., Beven, K. J., and Merot, P.: On constraining the predictions of a distributed model: the incorporation of fuzzy estimates of saturated areas into the calibration process, Water Resour. Res., 34, 787–797, 1998. Gupta, H. V., Sorooshian, S., and Yapo, P. O.: Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information, Water Resour. Res., 34, 751–764, 1998. Gupta, H. V., Sorooshian, S., Hogue, T. S., and Boyle, D. P.: Advances in Automatic Calibration of Watershed Models, in: Calibration of Watershed Models, edited by: Duan, Q., Gupta, H. V., Sorooshian, S., Rousseau, A. N., and Turcotte, R., Water Science and Application, AGU, Washington D.C., 9–28, 2003. Haykin, S.: Neural networks – a comprehensive foundation, 2nd ed., New Jersey, 842 pp., 1999. Hsu, K.-l., Gupta, H. V., Gao, X., Sorooshian, S., and Imam, B.: Self-organizing linear output map (SOLO): An artificial neural network suitable for hydrologic modeling and analysis, Water Resour. Res., 38, 1302, doi:10.1029/2001WR000795, 2002. Hydrotec: Rainfall-Runoff-Model NASIM – program documentation (in German), Hydrotec Ltd., Aachen, 579 pp., 2005. Kalteh, A. M. and Berndtsson, R.: Interpolating monthly precipitation by self-organizing map (SOM) and multilayer perceptron (MLP), Hydrolog. Sci. J., 52, 305–317, 2007. Kohonen, T.: Self-Organizing Maps, 3rd ed., Information Sciences, Berlin, Heidelberg, New York, 501 pp., 2001. Lamb, R., Beven, K., and Myrabø, S.: Use of spatially distributed water table observations to constrain uncertainty in a rainfall-runoff model, Adv. Water Resour., 22(4), 305–317, 1998. Lane, S. N.: Assessment of rainfall-runoff models based upon wavelet analysis, Hydrol. Process., 21, 586–607, 2007. Legates, D. R. and McCabe Jr., G. J.: Evaluating the use of "goodness-of-fit" measures in hydrologic and hydroclimatic model validation, Water Resour. Res., 35, 233–241, 1999. Lischeid, G.: A decision support system for mountain basin management using sparse data, EGU General Assembly 2006, Vienna, Geophys. Res. Abstr., 8, EGU06-A-04223, 2006. Montanari, A. and Toth, E.: Calibration of hydrological models in the spectral domain: An opportunity for scarcely gauged basins?, Water Resour. Res., 43, W05434, doi:10.1029/2006WR005184, 2007. Peeters, L., Bação, F., Lobo, V., and Dassargues, A.: Exploratory data analysis and clustering of multivariate spatial hydrogeological data by means of GEO3DSOM, a variant of Kohonen's Self-Organizing Map, Hydrol. Earth Syst. Sci., 11, 1309–1321, 2007. Principe, J. C., Wang, L., and Motter, M. A.: Local dynamic modeling with self-organizing maps and applications to nonlinear system identification and control, P. IEEE, 86, 2240–2258, 1998. Schütze, N., Schmitz, G. H., and Petersohn, U.: Self-organizing maps with multiple input-output option for modeling the Richards equation and its inverse solution, Water Resour. Res., 41, W03022, doi:10.1029/2004WR003630, 2005. Seibert, J.: Multi-criteria calibration of a conceptual runoff model using a genetic algorithm, Hydrol. Earth Syst. Sci., 4, 215–224, 2000. Simula, O., Vesanto, J., Alhoniemi, E., and Hollmén, J.: Analysis and Modeling of Complex Systems Using the Self-Organizing Map, in: Neuro-Fuzzy Techniques for Intelligent Information Systems, edited by: Kasabov, N., and Kozma, R., Physica Verlag (Springer Verlag), 3–22, 1999. Vesanto, J.: Using the SOM and Local Models in Time-Series Prediction, Workshop on Self-Organizing Maps (WSOM'97), Espoo, Finland, 1997, 209–214, 1997. Vesanto, J., Himberg, J., Alhoniemi, E., and Parhankangas, J.: SOM Toolbox for Matlab 5, Helsinki University of Technology, Espoo, 60 pp., 2000. Vrugt, J. A., Gupta, H. V., Bastidas, L. A., Bouten, W., and Sorooshian, S.: Effective and efficient algorithm for multiobjective optimization of hydrologic models, Water Resour. Res., 39(4), 1214, doi:10.1029/2002WR001746, 2003. Wagener, T., Wheater, H. S., and Gupta, H. V.: Identification and Evaluation of Watershed Models, in: Calibration of Watershed Models, edited by: Duan, Q., Gupta, H. V., Sorooshian, S., Rousseau, A. N., and Turcotte, R., Water Science and Application, AGU, Washington D.C., 29–47, 2003. Wagener, T., Wheater, H. S., and Gupta, H. V.: Rainfall-Runoff Modelling in Gauged and Ungauged Basins, Imperial College Press, London, 306 pp., 2004. Willmott, C. J.: On the validation of models, Phys. Geogr., 2, 184–194, 1981. Willmott, C. J.: Some Comments on the Evaluation of Model Performance, B. Am. Meteorol. Soc., 63, 1309–1313, 1982. Yapo, P. O., Gupta, H. V., and Sorooshian, S.: Multi-objective global optimization for hydrologic models, J. Hydrol., 204, 83–97, 1998.