Prediction of Heavy Metals Concentration in the Groundwater Resources in Razan Plain: Extreme Learning Machine vs. Artificial Neural Network and Multivariate Adaptive Regression Spline

authors:

avatar Meysam Alizamir 1 , * , avatar Soheil Sobhanardakani 2 , avatar Amin Hasanalipour Shahrabadi 3

Department of Civil Engineering, Hamedan Branch, Islamic Azad University, Hamedan, Iran
Department of the Environment, College of Basic Sciences, Hamedan Branch, Islamic Azad University, Hamedan, Iran
Department of Civil Engineering, University of Sistan and Baluchestan, Zahedan, Iran
Annals of Military and Health Sciences Research: Vol.17, issue 4; e98554
published online: December 18, 2019
article type: Research Article
received: October 1, 2019
revised: November 13, 2019
accepted: November 30, 2019
DOI: https://doi.org/10.5812/amh.98554

how to cite: Alizamir M, Sobhanardakani S , Hasanalipour Shahrabadi A . Prediction of Heavy Metals Concentration in the Groundwater Resources in Razan Plain: Extreme Learning Machine vs. Artificial Neural Network and Multivariate Adaptive Regression Spline. Ann Mil Health Sci Res. 2019;17(4):e98554. https://doi.org/10.5812/amh.98554.

Abstract

Background:

The groundwater is known as a major water source for domestic, industrial and agricultural purposes in the Razan Plain. Therefore, the prediction of toxic and essential elements (arsenic, lead, and zinc) content in groundwater resources of this area is important.

Objectives:

The main aim of this study was to investigate the extreme learning machine model as a novel model for the prediction of heavy metals concentration at Razan Plain, Hamedan province, Iran.

Methods:

In this descriptive study, a total of 60 groundwater specimens were collected from 20 semi-deep and deep wells across the studied area. After preparing the specimens in the laboratory, the elements’ content was detected using inductively coupled plasma-optical emission spectrometry (ICP-OES) in three replicates. In the next step, three types of machine learning methods, including, extreme learning machine (ELM), artificial neural network (ANN) and multivariate adaptive regression spline (MARS) were used to predict the heavy metals concentration in groundwater resources in Razan Plain, Hamedan, Iran. The models were trained using training data (the first 80% of the data) to find optimum values for weights and biases followed by testing using testing data (the first 20% of the data) collected from the study area. The used data were representative of the concentration of the As, Zn and Pb in Razan Plain. Three evaluation measures, correlation coefficient (r), coefficient of determination (R2) and root mean square error (RMSE) were applied to investigate the accuracy of models in estimation of heavy metals concentration.

Results:

The results showed that the mean content (µg/L) of the analyzed elements in groundwater samples of Razan Plain was 6.35 for As, 5.24 for Pb, and 32.4 for Zn. In addition, based on the findings the superiority of ELM was confirmed compared with the ANN and MARS models. ELM model decreased RMSE for ANN and MARS by 39.8% and 47.8% for As, 38.5% and 59.8% for Zn, and 64.4% and 75.5% for Pb, respectively. The results indicated that the ELM model can be successfully utilized for predicting heavy metals concentration in groundwater resources.

Conclusions:

The developed ELM approach can be successfully applied to estimate the concentration of As, Pb, and Zn in Razan Palin.

1. Background

Nowadays, due to the discharge of different kinds of hazardous materials, especially toxic heavy metals to the surface and groundwater resources through industrial, urban, agricultural and mining effluents and also fuel combustion, evaluation of the groundwater contamination by toxic and essential elements is vital (1-5).

Since heavy metals are not biodegradable they are deposited. They are also characterized by their long persistence or long half-life, assimilated or incorporated in water. They have bioaccumulation potential in the tissues of living organisms, as well. Accordingly heavy metals can cause adverse effects on human health (6, 7). Metals, such as Fe, Cu, Mn, Mo, and Zn are known as an essential elements and play a vital role in biological systems, whereas other elements, such as As, Pb, Cr, Cd, Hg and V are non-essential metals, and due to their toxic characteristics are known as hazardous substances for living organisms (8). Arsenic is a carcinogenic agent to human with no possible beneficial metabolic functions. Exposure to this element can cause some adverse health effects, including anorexia, fever, hair loss, fluid loss, headache, muscle spasms, decrease in the production of blood cells, herpes, nausea, weakness, vomiting, darkening of the skin and, especially liver and kidney failure (9-11). Lead (Pb) as a major global environmental health risk agent can cause serious adverse effects on human health. It has been proved that the consumption of food is the main route for Pb intake into the human body (12, 13). Disruption of the delicate antioxidant balance between the cells and oxidative stress, and also headache, anemia, brain damage, colic, learning disabilities, reduced IQ, hyperactivity, slow growth, and central nervous system disorders are the main adverse health effects of exposure to Pb (14, 15). Zinc (Zn) as an essential element has a functional and structural role in biological systems (16, 17). Exposure to high amounts of Zn can cause nephritis, anuria and also extensive lesions in the kidneys (3, 14, 18).

In the last decade, soft computing models have been successfully applied in solving complex systems in environmental problems. One of the recent methods for training single hidden layer feedforward neural networks (SLFNs) is the extreme learning machine (ELM) suggested by Huang et al. (19) that can significantly enhance the learning process on the networks. Yurtsever et al. (20) applied a fast artificial neural network (ANN) for simulating the removal process of Cd (II) ions by valonia resin. The results indicated that the implemented ANN had better performance compared with the conventional methods. Lima et al. (21) studied the performance of ELM as a reliable method in environmental sciences. Keskin et al. (22) analyzed the application of ANN methods for the estimation of water pollution sources in several stations in Turkey. The results showed the appropriate generalization performance of the ANN model in the prediction of water pollutants. Hossain and Piantanakulchai (23) in 2016 proposed a two-stage approach based on geographic information system (GIS) and classification tree methods to study groundwater resource contamination (heavy metals concentration) risk. The results demonstrated the effectiveness of the two-phase model to predict the degree of accumulation of heavy metals in groundwater resources. Alizamir and Sobhanardakani (24) studied the performance accuracy of an ANN based on the optimization approach of the imperialist competitive algorithm (ANN-ICA) for the prediction of heavy metals contamination in groundwater resources of the Ghahavand Plain. The results of this study indicated that the ANN-ICA model was able to yield high accuracy outputs. Alizamir and Sobhanardakani in 2018 (25) suggested a conjoined methodology based on ANN and particle swarm optimization to simulate heavy metals concentration of Toyserkan Plain. They found that this hybrid model can be effectively utilized for environmental management programs.

To the best of the authors’ knowledge, no study has yet been conducted to estimate heavy metals concentration in Razan Plain using ELM. Therefore, the main aim of this study was to develop an ELM-based model for accurate estimation of heavy metals concentration in groundwater resources of Razan Plain. Besides ELM model, ANN and multivariate adaptive regression spline (MARS) models were also used.

2. Objectives

About 90% of the required water for Razan Plain for domestic and agricultural purposes is provided by groundwater resources. Therefore, this study was conducted to predict toxic and essential elements (As, Pb, and Zn) content in groundwater resources of Razan Plain.

3. Methods

3.1. Study Area

Razan Plain with an aquifer area of about 4810 km2 is located between 49º 20’ eastern longitude and 35º 23’ northern latitude in the northeast of Hamedan, west of Iran. The average annual precipitation of this region is varied from 230 to 300 mm (15).

3.2. Sampling and Sample Preparation

In this descriptive study, a total of 60 groundwater specimens were collected from 20 semi-deep and deep wells along the study area. The specimens were taken in 200 mL polyethylene bottles. Then the collected specimens were filtered through Whatman filter paper No. 42, preserved with 6N of nitric acid (Sigma-Aldrich, Spain) and kept in the refrigerator (4ºC) for further analysis (4). Finally, the contents of As, Pb and Zn were determined using inductively coupled plasma - optical emission spectrometry (ICP-OES; 710-ES, Varian, Australia) in three replicates (4, 7). The statistical parameters (maximum, minimum, mean and standard deviation) of the data are presented in Table 1.

Table 1.

Descriptive Statistics of the Heavy Metals Content (μg/L) in Groundwater Resources of Razan Plain

ElementMinMaxMeanSD
As1.111.836.352.42
Zn8.5585.9132.3916.94
Pb1.49.555.241.58

3.3. Extreme Learning Machine

Huang et al. in 2006 (19) developed a new training algorithm, an ELM for SLFNs to overcome the difficulties of using conventional training schemes. ELM is faster than gradient-based learning implementations and the determination of output weights is based on analytical calculations. Based on the good generalization performance of ELM, this algorithm showed satisfactory accuracy in benchmark problems. ELM using the Moore-Penrose generalized inverse (MPGI) and the minimum norm least-squares solution (MNLS) solves the general linear system Ax = y. The MPGI matrix of A (G) can be defined as:

Equation 1.AGA = A; GAG = G; (AG)T = AG; (GA)T = GA

Also, MNLS for a general linear system can be formulated as:

Equation 2.|Ax^-y|=minx⁡|Ax-y|

Where, || || is a norm in the space of Euclidean.

Generally, a standard SLFN with N hidden nodes as well as transfer function g(x) can be described as:

Equation 3.∑i=1Nβig(xk,;ci,ai)=yk,k=1,2,...,M

Where, ci and βi are random bias and weight vector for connecting the hidden nodes to the output nodes. H was defined as:

Equation 4.H=g(x1;c1,w1)⋯g(x1;cm,wM)g(xN;c1,w1)⋯g(xN;cM,wM)N*M
Equation 5.Hβ=(β1Tβ2T,...,βLT)m*MT

Equation 1 can be written as:

Hβ = Y

By applying the MPGI (H+) of the hidden layer matrix, the weights of outputs can be calculated using MNLS:

Equation 6.β=H+Y

In this study, for the ELM model, the sigmoidal activation function was used and the number of hidden nodes was set to 10. This number was obtained using trial and error process.

3.4. Multi-Layer Perceptron Artificial Neural Network

Multi-layer perceptron artificial neural network (MLPANN) is one of the popular soft computing methods, which has been extensively used in different fields of study. MLPANN consists of an input layer, one or more hidden layers and an output layer (26). The neurons are the main processing factor of a neural network. These elements by computing a weighted sum of N input parameters as well as applying transfer functions can yield output values. These models are able to perform complex calculations and yield satisfactory results from experimental data or field observation. In this research, MLPANN was applied for heavy metals concentration prediction in the Razan Plain. In addition, MLPANN with one single layer and Log-Sigmoid as the activation function were also employed for the estimation of heavy metals concentration in Razan Plain. Moreover, the efficient algorithm of Levenburg-Marquardt used to accelerate the convergence process of the network (27).

3.5. Adaptive Regression Spline

Friedman in 1991 (28) introduced an MARS as a nonlinear and nonparametric regression approach. This method applies high dimensional parameters for mapping a group of inputs to the output variables (29). At the first step, MARS, by dividing predictors into the subgroups, generated a basic function for each subgroup. The basic functions handle data properties of the one or several input parameters and they make the relation between independent and dependent parameters (28). It can be noted that the basic functions are placed between two points, beginning and end, which are called knote (30). The MARS model can be expressed as:

Equation 7.Y=∑j=1P∑b=1Bψjb(+)Max(0,xi-Kbj)+ψjb(-)Max(0,Kbj-xj)

Where, Y is the output parameter, P and B are the number of inputs and basic functions, respectively. ψjb indicates the coefficient of basic functions and K shows knots (30).

3.6. Evaluation Criteria

In this study, three reliable statistical indicators were applied to investigate performance evaluation using soft computing models for the estimation of heavy metals concentration in Razan Plain.

1) Coefficient of determination (R2) (Equation 8)

Equation 8.R2=∑i=1nOi-Oi¯⋅Pi-Pi¯2∑i=1nOi-Oi¯⋅∑i=1nPi-Pi¯

2) Pearson correlation coefficient (r) (Equation 9)

Equation 9.r=n∑i=1nOi⋅Pi-∑i=1nOi⋅∑i=1nPin∑i=1nOi2-∑i=1nOi2⋅n∑i=1nPi2-∑i=1nPi2

3) Root mean square error (RMSE) (Equation 10)

Equation 10.RMSE=∑i=1n(Pi-Oi)2n

Where, n is the total number of data and Pi and Oi are the simulated heavy metals concentration values by the developed methods and measured values, respectively.

4. Results

ELM models were developed for predicting heavy metals concentration in Razan Plain. Previous data of Zn, As and Pb were used as input parameters to the ELM models. As mentioned before, for comparing the results of the developed models, three reliable statistical indicators were used using RMSE, correlation coefficient and coefficient of determination to obtain the best model. ELM, ANN and MARS models were compared for the training and testing phases in Table 2. Various numbers on hidden nodes were tried for ELM and ANN models to find the optimum ELM and ANN structures. For example, in the ANN model, 500 iterations, 10 hidden nodes, and sigmoid transfer function for the hidden and output nodes led to the optimum results. Based on Tables 2-4, it is clear that the ELM model performed better than the ANN and adaptive regression models in the testing phases to estimate three heavy metals concentration. The lowest RMSE and highest R2 and r values were gained by the ELM models. The concentration estimates of the ELM, ANN and MARS models in the training and testing phases are illustrated in Figures 1-3 for As, Zn, and Pb concentration. According to these figures, the superiority of the ELM model over ANN and MARS models is quite evident. For the ELM, ANN and MARS implementations, program codes were written in MATLAB (R2014b) environment.

The observed and estimated As concentration using ELM, ANN and MARS models during the training and testing phases
The observed and estimated As concentration using ELM, ANN and MARS models during the training and testing phases
Figure 1.

The observed and estimated As concentration using ELM, ANN and MARS models during the training and testing phases

The observed and estimated Zn concentration using ELM, ANN and MARS model during the training and testing phases
The observed and estimated Zn concentration using ELM, ANN and MARS model during the training and testing phases
Figure 2.

The observed and estimated Zn concentration using ELM, ANN and MARS model during the training and testing phases

The observed and estimated Pb concentration by the ELM, ANN, and MARS model during the training and testing phases
The observed and estimated Pb concentration by the ELM, ANN, and MARS model during the training and testing phases
Figure 3.

The observed and estimated Pb concentration by the ELM, ANN, and MARS model during the training and testing phases

Table 2.

The RMSE, r and R2 Statistics of the Optimum Models for As Concentration

Heavy Metal ConcentrationMethodsTrainingTesting
RMSErR2RMSErR2
AsELM0.6930.9600.9220.7880.9300.866
ANN1.2290.8690.7561.3100.8190.672
Adaptive regression spline1.7960.6920.4791.5120.6790.461
Table 3.

The RMSE, r, and R2 Statistics of the Optimum Models for Zn Concentration

Heavy Metal ConcentrationMethodsTrainingTesting
RMSErR2RMSErR2
ZnELM4.7290.9380.8818.3050.9310.868
ANN5.7070.9090.82713.5160.8190.672
Adaptive regression spline8.6120.7780.60620.6800.6470.419
Table 4.

The RMSE, r, and R2 Statistics of the Optimum Models for Pb Concentration

Heavy Metal ConcentrationMethodsTrainingTesting
RMSErR2RMSErR2
PbELM0.5240.9480.8990.3620.9480.899
ANN0.8960.8400.7071.0170.8410.708
Adaptive regression spline1.0420.7770.6041.4820.7300.533

5. Discussion

To investigate the applicability of the developed ELMs, after obtaining the optimal architecture and parameters of each model, they were trained to find the best biases and weights to yield the lowest error values. Comparisons of the results showed that the ELM model with the sigmoid activation function yielded the best results in both training and testing phases (Table 2) for the studied heavy metals concentration. Figure 1A and B shows the predicted and observed concentration of the As in both training and testing phases using the ELM model. As displayed in this figure, it is quite evident that during the training phase, the ELM model predicted the concentration of As better than the testing phase. The estimates of ANN and MARS are shown in Figure 1C - F. As can be seen in Table 2, the prediction of the ELM model with the RMSE, r, and R2 of 0.788, 0.93, and 0.866 was more favorable than ANN and MARS with the RMSE, r, and R2 of 1.31, 0.819, and 0.672 and 1.512, 0.679, and 0.461, respectively.

For Zn concentration, the results of the ELM, ANN and MARS are given in Table 3. The highest RMSE and the lowest r and R2 values were obtained by MARS, whereas the highest R2 value was achieved by ELM model. It can be said that the ELM model was more effective in predicting Zn concentration. The estimates of the ELM model for both training and testing phases are demonstrated in Figure 2A. Also, Figure 2B and C shows the results obtained by ANN and adaptive regression models. The figures emphasize the better performance of the ELM model compared with the ANN and adaptive regression models. According to Table 3, the ELM model estimated the Zn concentration in testing phase with R2 = 0.868, RMSE = 8.305 and r = 0.931, the ANN model predicted with R2 = 0.819, RMSE = 13.516 and r = 0.819, and the MARS model forecasted with R2 = 0.419, RMSE = 20.68 and r = 0.647. In general, the ELM model seems to be more adequate than the ANN and adaptive regression models for the prediction of Zn concentration.

The results of ELM, ANN and adaptive regression spline to estimate Pb concentration in the training and testing phases are provided in Table 4. The highest r and R2 and the lowest RMSE values were obtained by ELM for the estimation of Pb concentration. Among the ELM, ANN, and adaptive regression spline, the MARS yielded the worst results. Figure 3 demonstrates the results of three machine learning models in both training and testing phases. The ELM model significantly outperforms the ANN and MARS models. The ELM predicted Pb concentration with R2 = 0.899, RMSE = 0.362 and r = 0.948 and improved the prediction accuracy by 64% and 75%, compared with the ANN and adaptive regression models, respectively.

Yadav et al. (31) have reported a good generalization performance of the ELM approach in surface water management. Heddam and Kisi (32), have stated that an ELM model is suited for the prediction of water quality parameters using the observed data. Also, Alizamir et al. (33) have applied the ELM approach for efficient modeling water level fluctuations using hydro-climatic parameters. In another study, Kisi and Alizamir in 2018 (34) have reported that the ELM model can yield satisfactory results compared with the conventional soft computing models. Based on the results, it is clear that the ELM model can be utilized as a robust artificial intelligence approach to estimate the concentration of various heavy metals in Razan Plain. The findings of this study suggested the ELM model as a reliable alternative to investigate environmental variables, such as groundwater resource contaminations. Using the suggested ELM model in other environmental problems is suggested to establish sustainable policies to facilitate the protection of the environment.

5.1. Conclusions

This study investigated the effectiveness of ELM approach to estimate heavy metals concentration in Razan Plain using the collected data. ELM approach was compared with ANN and MARS models using RMSE, correlation coefficient, and coefficient of determination. Comparison of the results showed that the effectiveness of ELM model compared with the ANN and MARS models. By applying the ELM models, the RMSEs were reduced in comparison with ANN and MARS models. Totally, it was found that the concentration of heavy metals in groundwater resources could be successfully predicted by ELM using the available data in the Razan Plain.

References

  • 1.

    Baghvand A, Nasrabadi T, Bidhendi GN, Vosoogh A, Karbassi A, Mehrdadi N. Groundwater quality degradation of an aquifer in Iran central desert. Desalination. 2010;260(1-3):264-75. https://doi.org/10.1016/j.desal.2010.02.038.

  • 2.

    Nasrabadi T, Bidabadi NS. Evaluating the spatial distribution of quantitative risk and hazard level of arsenic exposure in groundwater, case study of Qorveh County, Kurdistan Iran. Iranian J Environ Health Sci Eng. 2013;10(1):30. [PubMed ID: 23574885]. [PubMed Central ID: PMC3642021]. https://doi.org/10.1186/1735-2746-10-30.

  • 3.

    Sobhanardakani S, Jafari S. Assessment of heavy metals (Cu, Pb and Zn) in different tissues of common carp (Cyprinus carpio) caught from Shirinsu Wetland, Western Iran. J Chem Health Risks. 2014;4.

  • 4.

    Sobhanardakani S, Taghavi L, Shahmoradi B, Jahangard A. Groundwater quality assessment using the water quality pollution indices in Toyserkan Plain. Environ Health Eng Manage. 2016;4(1):21-7. https://doi.org/10.15171/ehem.2017.04.

  • 5.

    Nazari S, Sobhanardakani S. Assessment of pollution index of heavy metals in groundwater resources of Qaleh Shahin plain (2013-2014). J Kermanshah Univ Med Sci. 2015;19.

  • 6.

    Rezaei Raja O, Sobhanardakani S, Cheraghi M. Health risk assessment of citrus contaminated with heavy metals in Hamedan city, potential risk of Al and Cu. Environ Health Eng Manage. 2016;3(3):131-5. https://doi.org/10.15171/ehem.2016.11.

  • 7.

    Sobhanardakani S. Arsenic health risk assessment through groundwater drinking (case study: Qaleeh Shahin Agricultural Region, Kermanshah Province, Iran). Pollution. 2018;4(1):77-82.

  • 8.

    Sobhanardakani S. Tuna fish and common kilka: Health risk assessment of metal pollution through consumption of canned fish in Iran. J Consum Prot Food Safe. 2017;12(2):157-63. https://doi.org/10.1007/s00003-017-1107-z.

  • 9.

    Nasrabadi T, Abbasi Maedeh P, Sirdari ZZ, Shirani Bidabadi N, Solgi S, Tajik M. Analyzing the quantitative risk and hazard of different waterborne arsenic exposures: Case study of Haraz River, Iran. Environ Earth Sci. 2015;74(1):521-32. https://doi.org/10.1007/s12665-015-4058-7.

  • 10.

    Jan AT, Azam M, Siddiqui K, Ali A, Choi I, Haq QM. Heavy metals and human health: Mechanistic insight into toxicity and counter defense system of antioxidants. Int J Mol Sci. 2015;16(12):29592-630. [PubMed ID: 26690422]. [PubMed Central ID: PMC4691126]. https://doi.org/10.3390/ijms161226183.

  • 11.

    Sobhan Ardakani S. Assessment of Pb and Ni contamination in the topsoil of ring roads' green spaces in the city of Hamadan. Pollution. 2018;4(1):43-51.

  • 12.

    Krejpcio Z, Sionkowski S, Bartela J. Safety of fresh fruits and juices available on the Polish market as determined by heavy metal residues. Pol J Environ Stud. 2005;14(6):877.

  • 13.

    Liu P, Wang CN, Song XY, Wu YN. Dietary intake of lead and cadmium by children and adults - Result calculated from dietary recall and available lead/cadmium level in food in comparison to result from food duplicate diet method. Int J Hyg Environ Health. 2010;213(6):450-7. [PubMed ID: 20705508]. https://doi.org/10.1016/j.ijheh.2010.07.002.

  • 14.

    Hosseini SV, Sobhanardakani S, Miandare HK, Harsij M, Regenstein JM. Determination of toxic (Pb, Cd) and essential (Zn, Mn) metals in canned tuna fish produced in Iran. J Environ Health Sci Eng. 2015;13:59. [PubMed ID: 26266037]. [PubMed Central ID: PMC4531440]. https://doi.org/10.1186/s40201-015-0215-x.

  • 15.

    Sobhan Ardakani S, Maanijou M, Asadi H. Investigation of Pb, Cd, Cu and Mg concentrations in groundwater resources of Razan Plain. Avic J Clin Med. 2015;21(4):319-29.

  • 16.

    Ibrahim HS, Ibrahim MA, Samhan FA. Distribution and bacterial bioavailability of selected metals in sediments of Ismailia Canal, Egypt. J Hazard Mater. 2009;168(2-3):1012-6. [PubMed ID: 19342171]. https://doi.org/10.1016/j.jhazmat.2009.02.132.

  • 17.

    Sobhanardakani S. Analysis of contamination levels of Cu, Pb, and Zn and population health risk via consumption of processed meat products. Jundishapur J Health Sci. 2018;10(1). https://doi.org/10.5812/jjhs.14059.

  • 18.

    Abou-Arab A. Characteristic levels of some pesticides and heavy metals in imported fish. Food Chem. 1996;57(4):487-92. https://doi.org/10.1016/s0308-8146(96)00040-4.

  • 19.

    Huang GB, Zhu QY, Siew CK. Extreme learning machine: Theory and applications. Neurocomputing. 2006;70(1-3):489-501. https://doi.org/10.1016/j.neucom.2005.12.126.

  • 20.

    Yurtsever U, Yurtsever M, Şengil İA, Kıratlı Yılmazçoban N. Fast artificial neural network (FANN) modeling of Cd(II) ions removal by valonia resin. Desal Water Treat. 2014;56(1):83-96. https://doi.org/10.1080/19443994.2014.937756.

  • 21.

    Lima AR, Cannon AJ, Hsieh WW. Nonlinear regression in environmental sciences using extreme learning machines: A comparative evaluation. Environ Model Software. 2015;73:175-88. https://doi.org/10.1016/j.envsoft.2015.08.002.

  • 22.

    Keskin TE, Düğenci M, Kaçaroğlu F. Prediction of water pollution sources using artificial neural networks in the study areas of Sivas, Karabük and Bartın (Turkey). Environ Earth Sci. 2014;73(9):5333-47. https://doi.org/10.1007/s12665-014-3784-6.

  • 23.

    Hossain MM, Piantanakulchai M. Groundwater arsenic contamination risk prediction using GIS and classification tree method. Eng Geol. 2013;156:37-45. https://doi.org/10.1016/j.enggeo.2013.01.007.

  • 24.

    Alizamir M, Sobhanardakani S. Predicting arsenic and heavy metals contamination in groundwater resources of Ghahavand plain based on an artificial neural network optimized by imperialist competitive algorithm. Environ Health Eng Manage. 2017;4(4):225-31. https://doi.org/10.15171/ehem.2017.31.

  • 25.

    Alizamir M, Sobhanardakani S. An artificial neural network - particle swarm optimization (ANN- PSO) approach to predict heavy metals contamination in groundwater resources. Jundishapur J Health Sci. 2018;10(2). https://doi.org/10.5812/jjhs.67544.

  • 26.

    Cybenko G. Approximation by superpositions of a sigmoidal function. Math Control Signals Sys. 1989;2(4):303-14. https://doi.org/10.1007/bf02551274.

  • 27.

    Hagan MT, Menhaj MB. Training feedforward networks with the Marquardt algorithm. IEEE Trans Neural Netw. 1994;5(6):989-93. [PubMed ID: 18267874]. https://doi.org/10.1109/72.329697.

  • 28.

    Friedman JH. Multivariate adaptive regression splines. Ann Stat. 1991;19(1):1-67.

  • 29.

    Nalcaci G, Özmen A, Weber GW. Long-term load forecasting: Models based on MARS, ANN and LR methods. Cent Eur J Operat Res. 2018;27(4):1033-49. https://doi.org/10.1007/s10100-018-0531-1.

  • 30.

    Arabameri A, Pradhan B, Pourghasemi HR, Rezaei K, Kerle N. Spatial modelling of gully erosion using GIS and R programing: A comparison among three data mining algorithms. Appl Sci. 2018;8(8):1369. https://doi.org/10.3390/app8081369.

  • 31.

    Yadav B, Ch S, Mathur S, Adamowski J. Discharge forecasting using an online sequential extreme learning machine (OS-ELM) model: A case study in Neckar River, Germany. Measurement. 2016;92:433-45. https://doi.org/10.1016/j.measurement.2016.06.042.

  • 32.

    Heddam S, Kisi O. Extreme learning machines: A new approach for modeling dissolved oxygen (DO) concentration with and without water quality variables as predictors. Environ Sci Pollut Res Int. 2017;24(20):16702-24. [PubMed ID: 28560629]. https://doi.org/10.1007/s11356-017-9283-z.

  • 33.

    Alizamir M, Kisi O, Zounemat-Kermani M. Modelling long-term groundwater fluctuations by extreme learning machine using hydro-climatic data. Hydrol Sci J. 2017;63(1):63-73. https://doi.org/10.1080/02626667.2017.1410891.

  • 34.

    Kisi O, Alizamir M. Modelling reference evapotranspiration using a new wavelet conjunction heuristic method: Wavelet extreme learning machine vs wavelet neural networks. Agric Forest Meteorol. 2018;263:41-8. https://doi.org/10.1016/j.agrformet.2018.08.007.