Do Internals of Neural Networks Make Sense in the Context of Hydrology?

Mani Manavalan

doi:10.18034/ajase.v7i1.48

Authors

Mani Manavalan Technical Project Manager, Larsen & Toubro Infotech (LTI), Mumbai, INDIA

Keywords:

Neural Networks

Hydrology

Hydroinformatics system

Abstract

As of recent times, neural networks have drawn in a lot of attention and popularity because of their application to numerous dimensions, including computer visioning and the processing of natural language. Nevertheless, when it comes to the science applicable to the immediate environment, such as the run-off of rainfall modeling in the field of hydrology, and so being, neural networks have the tendency to have a surprisingly demeaning reputation. This bad record can be blamed on the reality that they are black-boxed in primal nature, as well as to the complication or impossibility to comprehend internals that culminates in a forecast. Neural systems make up a computational technology tailored for hydrological predictions. In spite of being extensively utilized in many other fields of research and application, the number of hydrologists that favor the methodology may be lower than expected. That’s as a result of the neural network’s data-driven nature for the applied challenges looking to be solved. Also, neural systems make provision for a modeling footprint that comes in handy when there is a sufficiency of raw information to connect X with Y, particularly in the cases where there is a need for real-time results. With this paper, we are introducing neural ecosystem challenges in generality, setting them in more extensive modeling in a relational context with hydrology. This study explores the internals of the learned networks for different basin sets from the sundrily obtainable dataset known as CAMELS. Also, it utilizes local sensing data in the symbolism of patterns in alignment with our comprehension of the system of hydrology. Demonstratively, we showcase that internally, LSTMs learned to interpret patterns that align with our comprehension of the hydrological system. For snow-carried catchments, for instance, the network grows specific memory cells with the capacity to imitate conceptual snow memories with yearly dynamics. This is known and accepted for the catchment models based on processes.

References

Abrahart, R.J. 2003. Neural network rainfall-runoff forecasting based on continuous resampling. Journal of Hydroinformatics 5(1): 51–61. DOI: https://doi.org/10.2166/hydro.2003.0004

Beven, K. & Feyen, J. 2002. The future of distributed modelling – Special Issue editorial. Hydrological Processes 16(2): 169–172. DOI: https://doi.org/10.1002/hyp.325

Bowden, G.J., Maier, H.R. & Dandy, G.C. 2002. Optimal division of data for neural network models in water resources applications. Water Resources Research 38(2): 1–11. DOI: https://doi.org/10.1029/2001WR000266

Bynagari, N. B. (2014). Integrated Reasoning Engine for Code Clone Detection. ABC Journal of Advanced Research, 3(2), 143-152. https://doi.org/10.18034/abcjar.v3i2.575 DOI: https://doi.org/10.18034/abcjar.v3i2.575

Bynagari, N. B. (2015). Machine Learning and Artificial Intelligence in Online Fake Transaction Alerting. Engineering International, 3(2), 115-126. https://doi.org/10.18034/ei.v3i2.566 DOI: https://doi.org/10.18034/ei.v3i2.566

Bynagari, N. B. (2016). Industrial Application of Internet of Things. Asia Pacific Journal of Energy and Environment, 3(2), 75-82. https://doi.org/10.18034/apjee.v3i2.576 DOI: https://doi.org/10.18034/apjee.v3i2.576

Bynagari, N. B. (2017). Prediction of Human Population Responses to Toxic Compounds by a Collaborative Competition. Asian Journal of Humanity, Art and Literature, 4(2), 147-156. https://doi.org/10.18034/ajhal.v4i2.577 DOI: https://doi.org/10.18034/ajhal.v4i2.577

Cameron, D., Kneale, P. & See, L. 2002. An evaluation of a traditional and a neural net modelling approach to flood forecasting for an upland catchment. Hydrological Processes 16: 1033–1046. DOI: https://doi.org/10.1002/hyp.317

Chen, S., Cowan, C.F.N. & Grant, P.M. 1991. Orthogonal least squares learning algorithm for radial basis function networks. IEEE Transactions on Neural Networks 2(2): 302–309. DOI: https://doi.org/10.1109/72.80341

Donepudi, P. K. (2014a). Technology Growth in Shipping Industry: An Overview. American Journal of Trade and Policy, 1(3), 137-142. https://doi.org/10.18034/ajtp.v1i3.503 DOI: https://doi.org/10.18034/ajtp.v1i3.503

Donepudi, P. K. (2014b). Voice Search Technology: An Overview. Engineering International, 2(2), 91-102. https://doi.org/10.18034/ei.v2i2.502 DOI: https://doi.org/10.18034/ei.v2i2.502

Donepudi, P. K. (2015). Crossing Point of Artificial Intelligence in Cybersecurity. American Journal of Trade and Policy, 2(3), 121-128. https://doi.org/10.18034/ajtp.v2i3.493 DOI: https://doi.org/10.18034/ajtp.v2i3.493

Donepudi, P. K. (2016). Influence of Cloud Computing in Business: Are They Robust?. Asian Journal of Applied Science and Engineering, 5(3), 193-196. Retrieved from https://journals.abc.us.org/index.php/ajase/article/view/1181

Donepudi, P. K. (2017a). AI and Machine Learning in Banking: A Systematic Literature Review. Asian Journal of Applied Science and Engineering, 6(3), 157-162. Retrieved from https://journals.abc.us.org/index.php/ajase/article/view/1180

Donepudi, P. K. (2017b). Machine Learning and Artificial Intelligence in Banking. Engineering International, 5(2), 83-86. https://doi.org/10.18034/ei.v5i2.490 DOI: https://doi.org/10.18034/ei.v5i2.490

Dooge, J.C.I. 1977. Problems and methods of rainfall-runoff modeling. In T.A. Cirani, U. Maione & J.R. Wallis (Eds.) Mathematical Models for Surface Water Hydrology (pp. 71–108). Chichester: John Wiley.

Fadziso, T., & Manavalan, M. (2017). Identical by Descent (IBD): Investigation of the Genetic Ties between Africans, Denisovans, and Neandertals. Asian Journal of Humanity, Art and Literature, 4(2), 157-170. https://doi.org/10.18034/ajhal.v4i2.582 DOI: https://doi.org/10.18034/ajhal.v4i2.582

Fischler, M.A. & Firschein, O. (Eds.) 1987. Readings in computer vision: Issues, problems, principles, and paradigms. Morgan Kaufmann Publishers.

Freeze, R.A. & Harlan, R.L. 1969. Blueprint for a physically-based, digitally simulated hydrologic response model. Journal of Hydrology 9: 237–258. DOI: https://doi.org/10.1016/0022-1694(69)90020-1

French, M.N., Krajewski, W.F. & Cuykendall, R.R. 1992. Rainfall forecasting in space and time using a neural network. Journal of Hydrology 137: 1–31. DOI: https://doi.org/10.1016/0022-1694(92)90046-X

Hall, M.J. & Minns, A.W. 1993. Rainfall-runoff modelling as a problem in artificial intelligence: experience with a neural network. Proceedings of the Fourth National Hydrological Symposium, Cardiff, 5.51–5.57.

Hsu, K.L., Gupta, H.V. & Sorooshian, S. 1995. Artificial neural network modelling of the rainfall runoff process. Water Resources Research 31: 2517–2530. DOI: https://doi.org/10.1029/95WR01955

Kohonen, T. 1995. Self-Organizing Maps. Heidelberg: Springer-Verlag. DOI: https://doi.org/10.1007/978-3-642-97610-0

Lek, S. & Guegan, J.F. 1999. Artificial neural networks as a tool in ecological modelling, an introduction. Ecological Modelling 120(2–3): 65–73. DOI: https://doi.org/10.1016/S0304-3800(99)00092-7

Leonard, J.A., Kramer, M.A. & Ungar, L.H. 1992. Using radial basis functions to approximate a function and its error bounds. IEEE Transactions on Neural Networks 3(4): 624–627. DOI: https://doi.org/10.1109/72.143377

Manavalan, M. (2014). Fast Model-based Protein Homology Discovery without Alignment. Asia Pacific Journal of Energy and Environment, 1(2), 169-184. https://doi.org/10.18034/apjee.v1i2.580 DOI: https://doi.org/10.18034/apjee.v1i2.580

Manavalan, M. (2016). Biclustering of Omics Data using Rectified Factor Networks. International Journal of Reciprocal Symmetry and Physical Sciences, 3, 1–10. Retrieved from https://upright.pub/index.php/ijrsps/article/view/40

Manavalan, M., & Bynagari, N. B. (2015). A Single Long Short-Term Memory Network can Predict Rainfall-Runoff at Multiple Timescales. International Journal of Reciprocal Symmetry and Physical Sciences, 2, 1–7. Retrieved from https://upright.pub/index.php/ijrsps/article/view/39

Manavalan, M., & Donepudi, P. K. (2016). A Sample-based Criterion for Unsupervised Learning of Complex Models beyond Maximum Likelihood and Density Estimation. ABC Journal of Advanced Research, 5(2), 123-130. https://doi.org/10.18034/abcjar.v5i2.581 DOI: https://doi.org/10.18034/abcjar.v5i2.581

Masters, T. 1995. Neural, Novel & Hybrid Algorithms for Time Series Prediction. New York: John Wiley & Sons.

McCulloch, W.S. & Pitts, W. 1943. A logic calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics 5: 115–133. DOI: https://doi.org/10.1007/BF02478259

Price, R.K. 2000. Hydroinformatics and urban drainage: an agenda for the beginning of the 21st century. Journal of Hydroinformatics 2: 85–86. DOI: https://doi.org/10.2166/hydro.2000.0011

Rumelhart, D.E., Hinton, G.E. & Williams, R.J. 1986. Learning internal representations by error propagations. In D.E. Rumelhart & J.L. McClelland, (Eds.), Parallel Distributed Processing: Explorations in the Microstructures of Cognition 1 (pp. 318–362). Cambridge, MA: MIT Press.

Smith, J. & Eli, R.N. 1995. Neural-network models of rainfall-runoff process. Journal of Water Resources Planning and Management 121: 499–509. DOI: https://doi.org/10.1061/(ASCE)0733-9496(1995)121:6(499)

SNNS Group. 2003. Stuttgart Neural Network Simulator. URL http://wwwra.informatik.uni-tuebingen.de/SNNS/ (August 2003).

Taylor, J.G. 1993. The Promise of Neural Networks. London: Springer-Verlag. DOI: https://doi.org/10.1007/978-1-4471-0395-0

Tokar, S.A. & Johnson, P.A. 1999. Rainfall-runoff modeling using artificial neural networks. Journal of Hydrologic Engineering 4(3): 232–239. DOI: https://doi.org/10.1061/(ASCE)1084-0699(1999)4:3(232)

Tveter, D.R. 2003. Backpropagator’s Review. Last modified: 14/1/2003. URL http://www.dontveter.com/bpr/bpr.html. (August 2003).

Wilby, R.L., Abrahart, R.J. & Dawson, C.W. 2003. Detection of conceptual model rainfall-runoff processes inside an artificial neural network. Hydrological Sciences Journal 48(2): 163–181. DOI: https://doi.org/10.1623/hysj.48.2.163.44699

Zhang, B. & Govindaraju, R.S. 2000. Modular neural network for watershed runoff. In R.S. Govindaraju & R.A. Ramanchandra (Eds.), Artificial Neural Networks in Hydrology. Kluwer Academic Publishers, The Netherlands. DOI: https://doi.org/10.1007/978-94-015-9341-0_5