Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Global Warming: Predicting OPEC Carbon Dioxide Emissions from Petroleum Consumption Using Neural Network and Hybrid Cuckoo Search Algorithm

  • Haruna Chiroma ,

    hchiroma@acm.org

    Affiliations Faculty of Computer Science and IT, University of Malaya, Kuala Lumpur, Malaysia, School of Science, Department of Computer Science, Federal College of Education (Technical), Gombe, Nigeria

  • Sameem Abdul-kareem,

    Affiliation Faculty of Computer Science and IT, University of Malaya, Kuala Lumpur, Malaysia

  • Abdullah Khan,

    Affiliation Software and multimedia center faculty of science and computer technology, University Tun Hussein Onn, Johor Bahru, Malaysia

  • Nazri Mohd. Nawi,

    Affiliation Software and multimedia center faculty of science and computer technology, University Tun Hussein Onn, Johor Bahru, Malaysia

  • Abdulsalam Ya’u Gital,

    Affiliation Faculty of Computing, University Technology Malaysia, Johor Bahru, Malaysia

  • Liyana Shuib,

    Affiliation Faculty of Computer Science and IT, University of Malaya, Kuala Lumpur, Malaysia

  • Adamu I. Abubakar,

    Affiliation Faculty of Information and Communication Technology, International Islamic University Malaysia, Kuala Lumpur, Malaysia

  • Muhammad Zubair Rahman,

    Affiliation Software and multimedia center faculty of science and computer technology, University Tun Hussein Onn, Johor Bahru, Malaysia

  • Tutut Herawan

    Affiliation Faculty of Computer Science and IT, University of Malaya, Kuala Lumpur, Malaysia

Abstract

Background

Global warming is attracting attention from policy makers due to its impacts such as floods, extreme weather, increases in temperature by 0.7°C, heat waves, storms, etc. These disasters result in loss of human life and billions of dollars in property. Global warming is believed to be caused by the emissions of greenhouse gases due to human activities including the emissions of carbon dioxide (CO2) from petroleum consumption. Limitations of the previous methods of predicting CO2 emissions and lack of work on the prediction of the Organization of the Petroleum Exporting Countries (OPEC) CO2 emissions from petroleum consumption have motivated this research.

Methods/Findings

The OPEC CO2 emissions data were collected from the Energy Information Administration. Artificial Neural Network (ANN) adaptability and performance motivated its choice for this study. To improve effectiveness of the ANN, the cuckoo search algorithm was hybridised with accelerated particle swarm optimisation for training the ANN to build a model for the prediction of OPEC CO2 emissions. The proposed model predicts OPEC CO2 emissions for 3, 6, 9, 12 and 16 years with an improved accuracy and speed over the state-of-the-art methods.

Conclusion

An accurate prediction of OPEC CO2 emissions can serve as a reference point for propagating the reorganisation of economic development in OPEC member countries with the view of reducing CO2 emissions to Kyoto benchmarks—hence, reducing global warming. The policy implications are discussed in the paper.

Introduction

Global warming and the effects of greenhouse gases are considered among the important issues in the fields of science and politics [12]. This has triggered increasing concern about the contributions of carbon dioxide (CO2) to global warming [3]. The Intergovernmental Panel on Climate Change pointed out that more than 90% of global warming is probably caused by the emission of greenhouse gases due to human activities. The negative impacts of Global warming across the globe are as follows: The observed increase in temperature to date is about 0.7°C, which has started affecting health in several societies across the world. Extreme weather is increasing, especially heat waves, floods, and storms, which results in an increasing loss of human life and injuries due to natural disasters caused by climate change. The determinants of health, such as quality and quantity of foods, water resources, and ecological disease control vectors, are also affected [4]. In addition, community structures are expected to be influenced by Global warming [5].

Energy consumption is viewed as the major source of greenhouse emissions [6]. Energy consumption from 1970–2010 for the Organization of the Petroleum Exporting Countries (OPEC) has increased by 685%, while the emissions of CO2 increased by 440% as a result of burning fossil fuels within the same period. Therefore, energy consumption and CO2 emissions of the OPEC countries have drastically increased [7]. The burning of fossil fuels, has increased the global temperature caused by CO2 emissions [8]. The OPEC countries contributed 7% of the world CO2 emissions in 2010. This is considered to be significant for the use of energy in the future and for the potential of greenhouse emissions from the OPEC countries. Global warming is one of the critical issues currently facing the world. The trend of oil consumption and CO2 emissions of OPEC countries has grave implications by contributing to global warming [7]. The world is affected by the dangers of global warming, and the major contributor to global warming among the greenhouse gases is CO2 emissions [6]. As a result, the attention of policy makers and governments throughout the world has been focused on creating a framework based on energy efficiency simulation capable of conserving energy, thereby reducing the consumption of energy and the emission of greenhouse gases [7]. Reducing greenhouse gases emitted as a result of energy consumption, reduces the effects of global warming [910].

The emission of CO2 requires an accurate prediction for close monitoring and control [11]. Predicting CO2 is significant for the adaptation of climate change policies as well as for offering a reference point for using alternative energy sources [1214] with the view to reduce CO2 emissions [15].

The creation of preventive measures for reducing CO2 emissions has motivated attempts in the literature to apply computational intelligent algorithms due to their superiority over formal logic, mathematical programming [16], and statistical methods [17] for predicting the emissions of CO2. Despite the limitations of the these traditional methods, Meng et al. [18] used a non-homogeneous exponential equation and a linear equation to build a model for the prediction of energy related CO2 emissions in China. To avoid the limitations of the traditional methods, Chen and Wang [19] applied a hybrid of fuzzy regression and backpropagation neural network (BPNN) (FRBPNN) to forecast the global concentration of CO2. It was found to improve the accuracy of CO2 forecasting. Chen [11] used a collaborative fuzzy neural network to improve the forecast accuracy of the FRBPNN. Results indicated that the collaborative fuzzy neural network outperforms the FRBPNN and statistical methods in the forecasting of global CO2. Bao and Hui [20] applied the Grey model to build a model for the forecasting of CO2 emissions in Shijiazhuang, China. The model was used to project the CO2 emissions of Shijiazhuang from 2010 to 2020. In another study, the CO2 emissions related to energy in developing countries were forecasted using the Grey model [21]. The Grey model is not effective with a large sample of data; it requires small samples of observations to be robust [22], lacks fitting ability and has a deficiency in nonlinear modeling [23]. This motivated Tan and Zhang [23] to use GA to improve fitting ability of the Grey model and combined the genetic algorithm (GA) fitted Grey into BPNN for improving its nonlinear approximation ability. The model was used to predict energy load with improved performance.

However, the BPNN is a gradient based algorithm that has the possibility of being stuck in local minima, slow convergence, highly dependent on parameter settings, and generates complex error surfaces with a multiple local minimum [2425]. Fuzzy systems lack the capability of learning input data; human language is used to represent the input and output of the systems. Thus, incomplete or wrong rules cannot be handled well by fuzzy systems. Tuning of the systems is not a direct task [26]. The GA abolished previous knowledge of the problem if the population changes [27], and requires many parameter settings that undermine its robustness [28].

Studies on the prediction of OPEC CO2 emission from petroleum consumptions are scarce in the literature, despite the increasing consumption of petroleum and emissions of CO2 by the OPEC countries. Limitations of the previous studies and lack of work on the prediction of OPEC CO2 emission from petroleum consumptions motivated the present research.

To circumvent the limitations of the gradient decent algorithms, several biologically inspired global algorithms were proposed such as GA, particle swarm optimisation (PSO), artificial bee colony (ABC), etc., and recently cuckoo search algorithm for training the ANN. However, the cuckoo search algorithm (CS) was found to be more effective than the GA, PSO, and ABC [29]. In this paper, we proposed to hybridise the CS and Accelerated PSO (APSO) for training ANN (HCSNN) to build a model for the prediction of OPEC CO2 emissions. The HCSNN can improve the prediction accuracy and convergence speed of the ANN more than the GA, ABC, CS, and APSO as shown in the preliminary experiments [30].

In our approach, the hybrid CS communication capability of the cuckoo births has been improved by introducing APSO to search for a better location in which the optimal nest can share information with the cuckoo unlike in the previous studies. In the literature, Valian et al. [31] modified the CS by using variable probability of worse nests and step size when generating new solutions instead of the constant probability of worse nests and step size. Abubakar et al. [32] adopted Walton et al. [33] modified CS by adding exchange information between the eggs to the model and the crossover. Also, the distance to the location of a new egg was computed using an inverse golden ratio. Abubakar et al. [32] used the Walton et al. [33] modified CS to train a Functional Link ANN to build a model for the prediction of temperature and relative humidity in Malaysia. Abubakar et al. [34] further applied the model proposed in [32] for the prediction of climate change via temperature and ozone.

The Proposed Methods

Cuckoo Search Algorithm

The Cuckoo search algorithm is a new optimisation algorithm [35] developed by Yang and Deb [36], currently attracting attention from the research community. Attention is expected to continue into the future [28]. The CS is a global search algorithm for searching a global optimum solution. In CS, the fitness can be proportional to the objective function value without difficulties. Getting an optimised solution of a complicated problem using CS does not require a comprehensive search. Cuckoos are fascinating birds due to their aggressive strategies in reproduction. The 3 types of the brood parasitism strategy are as follows: (1) Intraspecific brood parasitism; (2) cooperative breeding; (3) nest takeover. Engaging in conflict directly between the host birds and cuckoos is possible. The host birds either abandon the nest or throw the alien eggs out of the nest to produce new eggs. In lévy flight distribution, animals and birds search for food in random or quasi-random, thus following a random walk, since the subsequent action relies on the present position and transition probability of the next state [37]. This behaviour has been applied in the CS optimisation, which has shown a better performance than other distribution-based random walk in exploring large scale search space. The lévy flight distribution is expressed as shown in Eq (1) based on Fourier transform (I) Yang [38]: (1)

Where α is the scaling parameter and s is the step length. Only special cases of parameters have inverse transform with explicit analytical formulae. Eq (1) can be changed to Eq (2) if the λ = 2.

(2)

The inverse integral of the transform of Eq (2) produces the Gaussian distribution and the inverse integral is expressed in Eq (3): (3)

Where M is the cost function and μ is the location parameter, when s → ∞ Eq (3) becomes: (4) (5)

Where the gamma function is represented by Γ(y) and y = n, we have Γ(n) = (n−1)!. The 3 major ideas of the CS proposed by Yang and Deb [36] for rules as an optimisation algorithm for the CS are: (1) Each of the cuckoo lays one egg at a time and puts it in a randomly chosen nest; (2) the nests with the optimum quality eggs will move to the next generation; (3) the available nest host is fixed and the egg laid by a cuckoo is discovered by the host bird with the probability of worse nests to be abandoned (Pa) pa ∈ [0,1]. The fitness function is selected as the objective function itself for maximum or minimum problems. In the generation of a new solution, for cuckoo i, a levy flight is performed as expressed in Eq (6): (6)

Where α1 is the lévy flight step size multiplication processes with an entry wise multiplication process. However, levy flight provides a random walk, whereas their random step lengths are drawn from the levy flight distribution for large steps. The CS initialised the population (n) for the nest, and randomly selected the best nest via levy flight. Thus, the cuckoo birds are always looking for a better place in order to reduce the chance of their eggs being discarded. The CS requires the setting of parameters for execution such as n, etc. However, the most critical parameters required to obtain the optimal solution from CS are Pa and α1 [39]. The pseudo-code for the CS is shown in Fig 1.

Accelerated Particle Swarm Optimisation

Particle Swarm Optimisation.

The choreography behaviour of birds and insects motivated Kenneth and Eberhart [40] to propose PSO. A number of individuals in PSO refined their knowledge of the given search space. Each and every individual in a PSO has a particle that refers to position and velocity. In PSO two pieces of information are responsible for adjusting the particle trajectory: The best location stays at the present point and global best location is reached by the entire swarm. The PSO uses evaluation function to assign a fitness value like other optimisation techniques.

Global best is the highest fitness value reached by a swarm, while local best is the highest fitness value that an individual particle has attained. Global and local best are remembered by each particle. PSO randomly initialised population of solutions, searching for the optimum solution by evolving generations. The basic steps involved in PSO operation from the initial stage to the optimum solution are depicted in Fig 2.

Accelerated Particle Swarm Optimisation.

The APSO is a modified version of the standard PSO proposed by Yang et al. [41]; in APSO, convergence is accelerated by using only global best, unlike the standard PSO that uses both global best and individual best. The individual best is used for increasing diversity to obtain a quality solution, which can also be achieved using other randomness. Thus, it is not compulsory to use the individual best except in solving highly nonlinear and multimodal problems. It was found that the APSO advances the performance of the standard PSO. Compared to other variants of PSO, APSO has only two parameters: The α and β representing the learning parameters or acceleration constants (αβ).

Neural Network

The ANN is comprised of nodes in the input, hidden, and output layers. Nodes in the input layer feed inputs to nodes in the hidden layers, and continue in a forward direction up to the nodes in the output layer. The nodes in the input layer are configured based on the independent variables in the dataset, and the dependent variable determined the output nodes [4243]. There can be more than one hidden layer; however, theoretical works, such as [44], argued that one hidden layer is sufficient to approximate any complex non-linear function. The number of nodes in the hidden layer is commonly realised through trial and error [45]. A typical structure of the ANN is shown in Fig 3. The ANN is an algorithm for processing information in parallel and can model complex and nonlinear associations using input–output training from datasets collected from the application domain. The intrinsic capabilities of the NN enable the algorithm to provide a nonlinear mapping of input and output vectors [43].

thumbnail
Fig 3. A typical structure of an ANN with input, hidden and output neurons distributed across the input, hidden and output layers respectively, where β is the bias.

https://doi.org/10.1371/journal.pone.0136140.g003

The NN can modify itself to perform the task if the optimal weights and bias of the NN are established [46]. There are several gradient-descent training algorithms for the optimisation of the NN weights and bias such as the Levenberg-Marquardt, backpropagation, resilient back propagation, scaled conjugate gradient, conjugate gradient with Powell-Beale restarts, Polak-Ribiere conjugate gradient, Fletcher-Reeves conjugate gradient, BFGS quasi-Newton and one-step secant algorithms. The most commonly used NN training algorithm is the backpropagation algorithm [47]. The backpropagation algorithm is a gradient method for minimising the error cost function. However, these gradient descent algorithms, are susceptible to limitations such as over-training of the NN, which could cause the training data to be overfitted and degrade the prediction accuracy. They have the possibility of being stuck in local minima, depending on the error surface shape, saturation, rate of convergence and so on [48]. Thus, the training of the NN using a HCS is ideal because the limitations of the gradient descent algorithms can be eliminated.

The Organization of the Petroleum Exporting Countries’ CO2 Emissions Dataset

The dataset for the OPEC CO2 emissions from the consumption of petroleum in million metric tons (mmt) from 1980 to 2011 was collected from [49], a credible source of energy data [50]. The data are collected yearly, in view of the fact that the data are available on a yearly basis. Data availability determined the collection period and frequency [51]. The data is comprised of the 12 OPEC countries’ CO2 emissions and the total OPEC CO2 emissions. The columns and rows of the dataset are 13 and 32 respectively. The basic statistics of the dataset are presented in Table 1 showing the maximum, minimum, mean and standard deviation (SD) for each OPEC country CO2 emissions dataset including the OPEC for the data collection period.

thumbnail
Table 1. Basic descriptive statistics of the OPEC countries CO2 emissions dataset.

https://doi.org/10.1371/journal.pone.0136140.t001

The OPEC CO2 emission is the dependent variable, whereas the CO2 emissions from the 12 member countries of the OPEC, as shown in Fig 4, are the independent variables representing the inputs. Therefore, the CO2 emissions of the 12 OPEC countries are used as the inputs to predict the OPEC CO2 emissions from petroleum consumption.

thumbnail
Fig 4. The pattern of CO2 emissions from petroleum consumption in OPEC countries (1980–2011).

https://doi.org/10.1371/journal.pone.0136140.g004

The dataset was normalised to a range of [–1,1] using Eq (7) to improve prediction accuracy and convergence speed [52].

(7)

Where no = normalise dataset, ki = raw dataset, xmin = minimum value of the dataset and pmax = maximum value of the dataset. The OPEC CO2 emissions dataset was analysed using correlation to investigate the relationship between dependent variables and between dependent and independent variables. Successful prediction requires that the variables involved in the task be positively related [53]. Table 2 is the correlation matrix of the variables involved in the prediction. It was found that the relationships among the variables are positively related. This makes the variables suitable for the prediction.

thumbnail
Table 2. An inter correlation matrix showing relationships among the 12 member countries CO2 emissions from petroleum consumption as well as the relationship between OPEC CO2 emissions and each member country

https://doi.org/10.1371/journal.pone.0136140.t002

The Design of the Proposed Hybrid Cuckoo Search Neural Network (HCSNN)

The major components of the proposed method are presented in a flowchart in Fig 5. The major stages comprised of the dataset, modeling, and evaluation. In the proposed approach, CS is hybridised with APSO to build the HCS. In the proposed HCS, communication capability of the cuckoo births have been improved by introducing APSO to search for a better location in which the optimal nest can share information with the cuckoo. Thus, the HCS chooses the optimal nest among all the nests via lévy flight, unlike in the standard CS (refer to section 2.1). The HCS performs the search using Eq (8) [4041]. The standard Equation of the CS is given in Eq (6). Eq (9) is the proposed equation in which the velocity vector vit+1 is taken from Eq (9) which is the standard Eq of the APSO [41]. The proposed Eq (9) is derived from Eq (6) and Eq (8).

(8)(9)

Where vit+1 is the velocity vector, vit and xit are positions vector for the particle, and εn represents the random vector typically drawn from [0,1]. The current global best is represented by g*. The mean square error (MSE) is chosen as the objective function because the HCSNN performance is to be compared with other meta-heuristic algorithms for evaluation purposes. The MSE is better than other performance indicators such as normalised mean square error, sum of square error, etc. in comparing performance of different algorithms on the same dataset [43].

To really assess the performance of the proposed method, the HCSNN was experimented across several training and test datasets with varying data partition ratios (training–testing); given that training data has an effect on the performance of the prediction [54], a similar practice was used in [55]. Therefore, five different data partition ratios were used in this study and each was run 10 times because meta-heuristic algorithms are required to be run more than once to compute the mean, best and the worst results as meta-heuristic algorithms are not deterministic. The best solution is typically realised from multiple execution of the algorithm [56]. The input neurons of the ANN are set to 12 in view of the fact that the independent variables in the dataset are 12, and the output neuron is set to 1 because only one dependent variable is used (refer to section 3). The hidden neurons were fixed to 5 as suggested by experimental trials. There are many activation functions but tanh is preferred in the hidden layer of ANN for solving prediction problems [57], and linear in the output layer as recommended by Beale et al. [58]. The objective of the HCS is to train the ANN to optimise its weights and bias.

Running HCS requires initialisation to start running. The HCS, like other meter-heuristic algorithms, requires the setting of parameter values. There is no systematic, universally agreed method of getting the best settings of meta-heuristic algorithms [28]. In this study, we adopted the parameters Pa = 0.25, α1 = 1, n = 25 [36], α = 0.7 [41]. The proposed HCSNN was run for a maximum of 1000 generations to build a HCSNN-with-bias for the prediction of OPEC CO2 emissions. The pseudo-code of the HCSNN proposed in the research is presented in Fig 6. For the purpose of evaluating the effectiveness of our method, we used standard CS, GA, PSO, ABC to optimise the weights and bias of the ANN to build CSNN, GANN, PSONN, ABCNN for the prediction of OPEC CO2 emissions. The results of the proposed and comparative methods are compared.

Results and Discussion

The numerical results of the experiments conducted using the OPEC CO2 emissions datasets are shown and discussed in this section. Experimental simulation analysis shows that it is possible to predict OPEC CO2 emissions in 3, 6, 9, 12, and 16 years using the proposed HCSNN.

Sensitivity of the ANN and CS configuration parameters

The results of the experimental trials to investigate several configurations of the ANN with regard to the variety of CS parameter settings are presented in Table 3. The experiments are repeated for different number of hidden layer neurons starting from 2 with an increment of 1 up to 7. The experiment was stopped at 7 hidden layer neurons in all the trials because it was observed that the MSE started reducing from 6 hidden neurons. A similar phenomenon was observed by Uzer et al. [59] in their experiments. All the experiment trials conducted has proven that 5 hidden neurons were the best for the ANN. The sensitivity of the CS parameters as shown in Table 3 has influence on the ANN performance. This is not surprising because meta-heuristic algorithms are sensitive to parameter settings, though CS require the setting of only Pa and α parameters [60]. Among the CS parameters used in the experiment trials, the values suggested by Yang and Deb [36] were found to be the best settings for the CS. Many literature [6163] adopted the CS settings proposed by Yang and Deb [36] for the execution of CS because of their performance.

thumbnail
Table 3. Experiments with several ANN configurations and CS parameters.

https://doi.org/10.1371/journal.pone.0136140.t003

Comparing HCSNN with the Standard CSNN and APSONN

The experiments were implemented using MATLAB R2012b on a machine (Intel Core 2 Quad CPU 2.33GHz, RAM 2GB, 32-bit operating system). The source code can directly be requested from abdullahdirvi@gmail.com. The comparison between the proposed HCSNN and the basic CSNN and APSONN were first performed. Subsequently, the proposed HCSNN is compared with other established algorithms (GANN and ABCNN). In Chiroma et al. [64], their proposed meta-heuristic algorithm method of modelling oil consumption was compared with other meta-heuristic algorithms. Tables 47 summarised the simulation results; the first column is the data partition ratio, whereas the second, third, and fourth columns are the mean, best, and worst results, respectively. The results were obtained for each of the algorithms after the experiments on both training and test OPEC CO2 emissions datasets.

thumbnail
Table 4. Comparing HCSNN, CSNN, and APSONN training time (seconds) on the OPEC CO2 emissions training dataset.

https://doi.org/10.1371/journal.pone.0136140.t004

thumbnail
Table 5. Comparing HCSNN, CSNN, and APSONN accuracy (MSE) on the OPEC CO2 emissions training dataset.

https://doi.org/10.1371/journal.pone.0136140.t005

thumbnail
Table 6. Comparing HCSNN, CSNN, and APSONN test time (seconds) on OPEC CO2 emissions test datset.

https://doi.org/10.1371/journal.pone.0136140.t006

thumbnail
Table 7. Comparing HCSNN, CSNN, and APSONN accuracy (MSE) on OPEC CO2 emissions test dataset.

https://doi.org/10.1371/journal.pone.0136140.t007

Tables 47 reported the performance of the proposed HCSNN, CSNN, and APSONN on the training and test OPEC CO2 emissions datasets. The HCSNN was found to converge to the optimal solution faster than the CSNN, and APSONN on both training and test datasets. Therefore, the proposed HCSNN can be considered as the best algorithm because the best algorithm converges to the best solution within a short period of time [28, 65]. The proposed HCSNN has improved the performance of the CSNN and APSONN prediction methods. This signifies that the proposed HCSNN has the capability of providing a better solution in a short period of time. The performance advances made by the proposed HCSNN over the standard CSNN and APSONN could probably be achieved because of the hybridisation of the standard CS and APSO, which improves the communication capability of the cuckoos to search for a better location where the optimal nest can share information with the cuckoo; hence, it improves the performance of the CS and the APSO to converge to the optimal solution very fast.

Comparing Performance of HCSNN, GANN, and ABCNN

Comparing a proposed method based on meta-heuristic algorithm to other meta-heuristic algorithms [66] is required. The proposed HCSNN performance was compared with established meta-heuristic algorithms, that is, GA, and ABC [29]. Thus, GANN and ABCNN were applied for the prediction of OPEC CO2 emissions from petroleum consumption. The experimental results of the study are summarised in Tables 811.

thumbnail
Table 8. GANN and ABCNN training time (seconds) on OPEC CO2 emissions training dataset.

https://doi.org/10.1371/journal.pone.0136140.t008

thumbnail
Table 9. GANN and ABCNN accuracy (MSE) on OPEC CO2 emmissions training dataset.

https://doi.org/10.1371/journal.pone.0136140.t009

thumbnail
Table 10. GANN and ABCNN test time (seconds) on OPEC CO2 emmissions test dataset.

https://doi.org/10.1371/journal.pone.0136140.t010

thumbnail
Table 11. GANN and ABCNN accuracy (MSE) on OPEC CO2 emmsisions test dataset.

https://doi.org/10.1371/journal.pone.0136140.t011

The performance of the GANN and ABCNN on training and testing OPEC CO2 emissions datasets are reported in Tables 811. A comparison of the performance of the proposed HCSNN (see Tables 47, bold) with that of GANN and ABCNN (Tables 811) on training and test dataset showed that the proposed HCSNN can provide better accuracy and convergence speed than the GANN and ABCNN on both training and test dataset. Those results have further validated the effectiveness and robustness of the HCSNN in the prediction of OPEC CO2 emissions. The performance of the HCSNN can probably be attributed to the CS in twofold: (1) The CS striking balance between local and global search; (2) the CS requires few parameters to run successfully unlike GA and ABC that require more parameters settings than the CS.

Predicted vs. Actual OPEC CO2 Emissions from Petroleum Consumption

The pattern of the actual OPEC CO2 emissions and the predicted ones by the algorithms (HCSNN, GANN, ABCNN, and APSONN) are depicted in Figs 711. The prediction is based on the OPEC CO2 emission test dataset reserved for evaluation purpose. The prediction is for 3, 6, 9, 12, and 16 years, respectively. The performance indicators are in Tables 47 and Tables 811.

thumbnail
Fig 7. Predicted vs. actual OPEC CO2 emissions (90–10).

https://doi.org/10.1371/journal.pone.0136140.g007

thumbnail
Fig 8. Predicted vs. actual OPEC CO2 emissions (80–20).

https://doi.org/10.1371/journal.pone.0136140.g008

thumbnail
Fig 9. Predicted vs. actual OPEC CO2 emissions (70–30).

https://doi.org/10.1371/journal.pone.0136140.g009

thumbnail
Fig 10. Predicted vs. actual OPEC CO2 emissions (60–40).

https://doi.org/10.1371/journal.pone.0136140.g010

thumbnail
Fig 11. Predicted vs. actual OPEC CO2 emissions (50–50).

https://doi.org/10.1371/journal.pone.0136140.g011

It can be observed in Figs 711, that the OPEC CO2 emissions predicted by the proposed HCSNN is more fit to the actual OPEC CO2 emissions than the other comparison algorithms. In 3, 6, 9, and 12 year predictions (Figs 710) the other compared algorithms also fitted close to the actual OPEC CO2 emissions except for GANN. The abolition of previous knowledge by GA could possibly be responsible for the low performance of the GANN. In 16 year predictions, ABCNN and CSNN move further away from the actual OPEC CO2 emissions. This has clearly shown that the algorithms are not robust as the number of the predicted years increases. Thus, ABCNN, GANN, and CSNN are not consistent in their performance. The APSONN performance is consistent. However, the proposed HCSNN is consistent and more accurate than the APSONN in the prediction of OPEC CO2 emissions, as the HCSNN has maintained similar performance throughout the prediction periods. Therefore, the HCSNN is robust, accurate and fast in the prediction of OPEC CO2 emissions. The optimum solution for application in solving real world problem is required to be robust in addition to accuracy and convergence speed as argued by Yang and Deb [28].

Policy Implications

In view of the fact that protection against global warming requires a holistic approach, accurate prediction of OPEC CO2 emissions from petroleum consumption can give member countries a better estimate of CO2 emissions expected in the future, thus allowing OPEC to create a robust CO2 emissions policy involving the 12 member countries. OPEC members are skeptical, however, about the reduction of CO2. This is because it may increase the price of oil to consumers, thus decreasing demand from developed countries, which accounts for 60% of total oil consumption in the world [67]. This can obstruct development and decline in revenue generation in OPEC countries, given that the main source of government revenue in OPEC countries is the sale of petroleum.

Reducing oil consumption means reducing CO2 emissions. If some OPEC countries are reducing CO2 emissions while others are not, surely it can affect other members’ CO2 emissions (see Table 2). Thus, a holistic approach is required by all the member countries to put measures in place that will drastically reduce CO2 emissions in all the countries if meaningful results are to be achieved. However, reducing oil consumption must be done with a caution given that oil consumption is significantly positively related to economic development as described in [3].

Since OPEC members are developing countries, the reduction of CO2 must be done with precautions in order not to slow down economic development and generation of revenue. An accurate prediction of OPEC CO2 emissions can serve as a reference point for an OPEC secretariat to propagate the reorganisation of economic development in member countries with the view of managing CO2 emissions. Evidence of CO2 emission dangers can easily be used to convince member countries to embark on economic development that can result to minimal petroleum consumption and reduced CO2 emissions. In view of the economic implications of reducing CO2 emissions, reduction of the CO2 emissions in OPEC countries must be enforced with caution. Considering the contributions of OPEC countries to global warming, it is significant for OPEC to adapt its policies on climate change that can enforce stringent measures for the members to adopt an energy-efficient economy.

Meng et al. [18] argued that the CO2 emissions emanating from countries that are developing has attracted unprecedented attention to economic development and the increasing consumption of fossil energy consumption. The Efforts been taken by the developing countries in monitoring and controlling the emissions of CO2 have become a premise to further maintain the Kyoto benchmark on climate change alleviation.

The future prediction of CO2 emission is one of the major factors for the management, control and modification of a state of the art policies related to CO2 emissions [18, 21]. The management and control of the emissions of CO2 drastically reduce the negative effects of global warming [1011].

The limitations of our study: The prediction was performed based on historical data. As such, future predicted CO2 emissions can be affected by a prolonged wars or famines that can bring down the economic growth. As a result, the emission of CO2 emissions can be decreased in the future. Also, the data were collected on yearly frequency. Therefore, the prediction horizon is limited to yearly basis.

Conclusions

This paper proposed a method for the prediction of OPEC CO2 emissions based on CS, ANN, and APSO to improve accuracy and convergence speed. The dataset required for the modelling was collected from the Energy Information Administration. We built a HCSNN model to predict OPEC CO2 emissions. Intensive experiments were conducted with HCSNN and other meta-heuristic algorithms such as CSNN, PSONN, GANN, and ABCNN to predict OPEC CO2 emissions in 3, 6, 9, 12, and 16 years. Comparative results indicated that the proposed HCSNN advanced the prediction accuracy and convergence speed of the comparison meta-heuristic algorithms in all the years. Accurate and timely prediction of OPEC CO2 emissions can allow OPEC member countries to accurately adapt OPEC policies related to climate change. This is because the more the prediction accuracy of CO2 emissions, the more the accuracy of the decision to be taken on climate change policies, hence, reducing the contributions of the OPEC countries to global warming. In the future, the method presented in this study will be modified to investigate the effectiveness of the method in the estimate of CO2 loss from the streams [68]. The method presented in this research could easily be implemented into software to develop a decision system capable of advising OPEC policy makers with predicted values of CO2 emissions.

Acknowledgments

This work is supported by University of Malaya High Impact Research Grant No vote UM.C/625/HIR/MOHE/SC/13/2 from Ministry of Higher Education Malaysia.

Author Contributions

Conceived and designed the experiments: HC SA. Performed the experiments: AK NMN MZR. Analyzed the data: HC SA AYG. Contributed reagents/materials/analysis tools: HC SA AYG. Wrote the paper: HC SA TH AYG. The critical review of the manuscript which significantly contributed to the improvement of the scientific content: TH AYG. Critically addressed the reviewers comments and properly guided in the implementation of the comments as well as approved the manuscript: LMS AIA.

References

  1. 1. Kyselý J, Picek J, Beranová R (2010) Estimating extremes in climate change simulations using the peaks-over-threshold method with a non-stationary threshold. Global Planet Change 72(1–2) 55–68 p.
  2. 2. Lindstad H, Asbjørnslett BE, Strømman AH (2011) Reductions in greenhouse gas emissions and cost by shipping at lower speeds. Energy Policy 39(6) 3456–64 p.
  3. 3. Wang SS, Zhou DQ, Zhou P, Wang QW (2011) CO< sub> 2 emissions, energy consumption and economic growth in China: A panel data analysis. Energy Policy 39(9) 4870–4875 p.
  4. 4. Richardson K, Steffen W, Schellnhuber HJ, Alcamo J, Barker T, Daniel M et al. (2009) Synthesis report from climate change global risk, challenges & decisions. Copenhagen 2009, 10–12 March pp. 8–12 p.
  5. 5. Nguyen KDT, Morley SA, Lai CH, Clark MS, Tan KS, Bates AE et al. (2011) Upper Temperature Limits of Tropical Marine Ectotherms: Global Warming Implications. PLoS ONE 6(12) e29340. pmid:22242115
  6. 6. Sari R, Soytas U (2009) Are global warming and economic growth compatible? Evidence from five OPEC countries?. Applied Energy, 86(10) 1887–1893 p.
  7. 7. Adetutu MO (2014) Energy efficiency and capital-energy substitutability: Evidence from four OPEC countries. Applied Energy 119 363–370 p.
  8. 8. Mondor E, Tremblay M (2010) Global Atmospheric Change and Animal Populations. Nature Education Knowledge, 3 23–36 p.
  9. 9. Memon J, Uddin M, Rozan MZA(2013) Green postal service framework to reduce CO2 emissions in postal service industry. International Journal of Global Warming 5(3) 255–269 p.
  10. 10. Uddin M, Rahman AA (2011) Techniques to implement in green data centres to achieve energy efficiency and reduce global warming effects. International Journal of Global Warming 3(4) 372–389 p.
  11. 11. Chen T (2012) A collaborative fuzzy-neural system for global CO2 concentration forecasting. International Journal of Innovative Computing, Information and Control 8(11) 7679–7696 p.
  12. 12. Kusiak A, Zhang Z, Xu G (2013) Minimization of Wind Farm Operational Cost Based on Data-Driven Models. IEEE Transactions on Sustainable Energy 4(3) 756–764 p.
  13. 13. Smith J, Clark C (2013) A Fresh Look At Wind: Reflections on Where We Are Going [Guest Editorial]. Power and Energy Magazine, IEEE, 11(6) 16–19 p.
  14. 14. Khosravi A, Nahavandi S, Creighton D (2013) Prediction intervals for short-term wind farm power generation forecasts. IEEE Transactions on sustainable energy 4(3) 602–610 p.
  15. 15. Lina C, Lioub F, Huangc C (2011) Grey forecasting model for CO2 emissions: A Taiwan study. Applied Energy 88 3816–3820 p.
  16. 16. Sahab MG, Toropov VV, Gandomi AH (2013) Traditional and modern structural optimization techniques—theory and application. In: Gandomi AH,Yang XY, Talatahari S, Alavi AH, (Eds.). Metaheuristic applications instructures and infrastructures. Waltham, MA: Elsevier, (Chapter 2).
  17. 17. Yu L, Wang S, Lai KK (2008) A generalized intelligent–agent–based fuzzy group forecasting model for oil price prediction. In: Proceedings of IEEE International Conference on Systems, man and cybernetics, Singapore, pp. 489–493
  18. 18. Meng M, Niu D, Shang W (2014) A small-sample hybrid model for forecasting energy-related CO2 Emissions. Energy 64 673–677 p.
  19. 19. Chen T, Wang YC (2011) A fuzzy-neural approach for global CO2 concentration forecasting. Intelligent Data Analysis, 15(5) 763–777 p.
  20. 20. Bao GL, Hui HQ, (2012) Grey Forecasting Model for CO2 Emissions. Advanced Materials Research 518 1664–1668 p.
  21. 21. Chen T (2013) A small-sample hybrid model for forecasting energy-related CO2 emissions. Computers & Industrial Engineering 66 834–848 p.
  22. 22. Zhang QM, Chen N, Wang F (2009) Combined Forecast Model of Gas Load Based on Grey Theory. In: Cao B., Li T.-F., Zhang C.-Y. (Eds.) Fuzzy Information and Engineering 2 1275–1281 p. Springer Berlin Heidelberg.
  23. 23. Tang N, Zhang DJ (2011) Application of a load forecasting model based on improved grey neural network in the smart grid. Energy Procedia, 12 180–184 p.
  24. 24. Zweiri YH, Whidborne JF, Sceviratne LD (2003) A three-term backpropagation algorithm. Neurocomputing 50 305–318 p.
  25. 25. Hagan MT, Demuth HB, Beale MH (2002) Neural network design. PWS Publishing, Boston.
  26. 26. Bunke H, Kandel A (2000) Neuro-Fuzzy Pattern Recognition. World Scientific Publishing CO: Singapore.
  27. 27. Dehuri S, Cho SB(2010) A comprehensive survey on functional link neural networks and an adaptive PSO–BP learning for CFLNN. Neural Computing and Applications 19(2)187–205 p.
  28. 28. Yang XS, Deb S(2014) Cuckoo search: recent advances and applications. Neural Computing and Applications 24(1) 169–174 p.
  29. 29. Civicioglu P, Besdok E (2013) A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms. Artificial Intelligence Review 39(4) 315–346 p.
  30. 30. Nawi NM, Khan A, Rehman MZ, Herawan T, Abawajy JH (2014) Neural network training by hybrid accelerated cuckoo particle swarm optimization algorithm. The 21st International Conference on Neural Information Processing (ICONIP 2014), Springer International Publishing 8835, 237–244 p.
  31. 31. Valian E, Mohanna S, Tavakoli S (2011) Improved Cuckoo Search Algorithm for Feed Forward Neural Network Training. International Journal of Artificial Intelligence & Applications 2(3) 36–43 p.
  32. 32. Abubakar SZ, Ghazali RB, Ismail LHB (2014) Implementation of Modified Cuckoo Search Algorithm on Functional Link Neural Network for Temperature and Relative Humidity Prediction. In: Proceedings of the First International Conference on advanced Data and Information Engineering (DaEng-2013), 151–158 p.
  33. 33. Walton S, Hassan O, Morgan K, Brown MR (2011) Modified cuckoo search: A new gradient free optimisation algorithm. Chaos, Solitons & Fractals 44(9) 710–718 p.
  34. 34. AbuBakar SZ, Ghazali R, Ismail L H, Herawan T, Lasisi A (2014). Implementation of Modified Cuckoo Search Algorithm on Functional Link Neural Network for Climate Change Prediction via Temperature and Ozone Data. In Recent Advances on Soft Computing and Data Mining (pp. 239–247). Springer International Publishing.
  35. 35. Bhandari AK, Singh VK, Kumar A, Singh GK (2014) Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using Kapur’s entropy. Expert Systems with Applications, 41(7) 3538–3560 p.
  36. 36. Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: Nature & Biologically Inspired Computing, World Congress on pp. 210–214 p.
  37. 37. Payne RB, Sorenson MD, Klitz K (2005) The Cuckoos, Oxford University Press.
  38. 38. Yang XS (2010) Nature-inspired metaheuristic algorithms. Luniver Press.
  39. 39. Marichelvam MK, Prabaharan T, Yang XS (2014) Improved cuckoo search algorithm for hybrid flow shop scheduling problems to minimize make span. Applied Soft Computing 19 93–101 p.
  40. 40. Kenneth J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks Piscataway, NJ, 1942–1948 p.
  41. 41. Yang XS, Deb S, Fong S (2011) Accelerated particle swarm optimization and support vector machine for business optimization and applications. In: Networked digital technologies (pp. 53–66). Springer Berlin Heidelberg.
  42. 42. Haykin S (2005) Neural network: A comprehensive foundation. Pearson Education, New Delhi.
  43. 43. Peter GZ, Patuwo BE, Hu MY(2001) A simulation study of artificial neural networks for nonlinear time-series forecasting. Computers & Operation Research 28 381–396 p.
  44. 44. Hornick K, Stinchcombe M, White H (1989) Multilayer feed forward networks are universal approximators. Neural Networks 2 359–366 p.
  45. 45. Pan TY, Wang RY (2004) State space neural networks for short term rainfall-runoff forecasting. Journal of Hydrology 297 (1) 34–50 p.
  46. 46. Kumar S, Singh MP (2010) Pattern recall analysis of the Hopfield neural network with a genetic algorithm. Computers & Mathematics with Applications 60(4) 1049–1057 p.
  47. 47. Wong BK, Bodnovich TAE, Selvi Y (1995) A bibliography of neural network applications research: 1988–1994. Expert Systems with Applications 12 253–261 p.
  48. 48. Karaboga D, Akay B, Ozturk C (2007) Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks. In: Torra V, Narukawa Y, Yoshida Y(Eds.): Modeling Decisions for Artificial Intelligence, Kitakyushu, Japan, 16–18 August, Vol. 4617, pp.318–329, Springer, Berlin, Heidelberg.
  49. 49. Energy Information Administration of the US Department of Energy. Available: http://www.eia.gov/cfapps/ipdbproject/iedindex3.cfm?tid=5&pid=5&aid=8&cid=CG9,&syid=1980&eyid=2011&unit=MMTCD. Accessed 27 May 2014.
  50. 50. Chiroma H, Abdulkareem S, Abubakar A, Usman MJ (2013) Computational Intelligence Techniques with Application to Crude Oil Price Projection: A Literature Survey from 2001–2012. Neural Network World 23 (6) 523–551 p.
  51. 51. Ekonomou L (2010) Greek long-term energy consumption prediction using artificial neural networks. Energy 35(2) 512–517 p.
  52. 52. Kaynar O, Yilmaz I, Demirkoparan F (2011) Forecasting of natural gas consumption with neural networks and neuro fuzzy system. Energy Education, Science and Technology, 26(2) 221–238 p.
  53. 53. Hair FJ, Black WC, Babin JB, Anderson RE (2010) Multivariate data analysis. Pearson Prentice Hall, New Jersey.
  54. 54. Witten IH, Frank E (2005) Data Mining: Practical Machine Learning Tools and Techniques (Data Management Systems). Morgan Kaufmann, San Mateo.
  55. 55. Xu Y, Zhu Q, Wang J (2012) Breast cancer diagnosis based on a kernel orthogonal transform. Neural Computing and Applications, 21(8) 1865–1870 p.
  56. 56. Subotic M, Tuba M, Bacanin N, Simian D (2012) Parallelized cuckoo search algorithm for unconstrained optimization. In: Proceedings of the 5th WSEAS congress on Applied Computing conference, and Proceedings of the 1st international conference on Biologically Inspired Computation, World Scientific and Engineering Academy and Society 151–156 p.
  57. 57. Zhang G, Patuwo EB, Hu MY(1998) Forecasting with artificial neural networks:: The state of the art. International Journal of forecasting, 14(1) 35–62 p.
  58. 58. Beale MH, Hagan MT, Demuth HB(2013) Neural network toolbox user’s guide. The MathWorks, Inc., Natick.
  59. 59. Uzer MS, Inan O, Yılmaz N (2013) A hybrid breast cancer detection system via neural network and feature selection based on SBS, SFS and PCA. Neural Computing and Applications 23 (3–4) 719–728 p.
  60. 60. Marichelvam MK, Prabaharan T, Yang XS (2014) Improved cuckoo search algorithm for hybrid flow shop scheduling problems to minimize make span. Applied Soft Computing 19 93–101 p.
  61. 61. Zheng H, Zhou Y (2012) A novel cuckoo search optimization algorithm based on Gauss distribution. Journal of Computational Information Systems 8(10) 4193–4200 p.
  62. 62. Yang XS, DebS (2013) Multiobjective cuckoo search for designoptimization. Computers & Operations Research 40(6) 1616–1624 p.
  63. 63. Salimi H, Giveki D, Soltanshahi MA, Hatami J (2012) Extended Mixture of MLP Experts by Hybrid of Conjugate Gradient Method and Modified Cuckoo Search. International Journal of Artificial Intelligence & Applications 3(1)
  64. 64. Chiroma H, Abdulkareem S, Sari EN, Abdullah Z, Muaz SA, Kaynar O, et al. (2014) Soft Computing Approach in Modeling Energy Consumption. In: Computational Science and Its Applications–ICCSA 2014, 770–782 p. Springer International Publishing.
  65. 65. Bishop MC (1995) Neural network for pattern recognition. Oxford University Press, Oxford.
  66. 66. Ouaarab A, Ahiod B, Yang XS (2014) Discrete cuckoo search algorithm for the travelling salesman problem. Neural Computing and Applications, 24(7–8) 1659–1669 p.
  67. 67. Barnett J, Dessai S, Webber M (2004) Will OPEC lose from the Kyoto Protocol?. Energy Policy, 32(18) 2077–2088 p.
  68. 68. Venkiteswaran JJ, Schiff SL, Wallin MB (2014) Large Carbon Dioxide Fluxes from Headwater Boreal and Sub-Boreal Streams. PloS one 9(7) e101756. pmid:25058488