301
Views
1
CrossRef citations to date
0
Altmetric
Original Articles

Multiple Decision Expert Systems for Performance Analysis of a Boiler System

, , &

Abstract

Artificial neural networks (ANN)-based multiple decision expert systems (MDES) were developed for assessing the performance of a boiler system. Different configurations of ANN were used with different decision combination methods, including a neural combiner, to propose the model. The model was developed using the plant data collected over a period of five months to predict steam temperature, pressure, and mass flow rate, using feed water pressure, feed water temperature, conveyor speed, and incinerator exit temperature as the input parameters. The predictive capability of the model is evaluated in terms of both correlation coefficient (R) and mean absolute percentage error (MAPE). The results observed from this work demonstrate that neural combiner and ANN-based MDES can efficiently predict the data on steam properties consistently, and that the model can serve as an efficient tool for monitoring boiler behavior under real-time conditions. Superiority of the proposed model over others under various scenarios is also demonstrated.

INTRODUCTION

Precarious energy crises around the world warrant the exploration of new and renewable energy sources. As the world’s tenth largest energy consumer, The Republic of Korea imports 97% of its total required energy (MOE 2013). Therefore, waste-to-energy (WTE) conversion is drawing significant attention in the recent times. Among the options for WTE, steam, generated via heat energy recovery from waste incinerators, can be utilized by many process and allied industries, wherein boilers play a significant role. The performance of a boiler with respect to steam production, both in terms of quality and quantity, is important especially when some process industries are highly dependent on a particular plant to meet their steam requirement for different processes. However, it is often cumbersome to predict the performance of industrial boilers during prolonged period of operation owing to the continuous change in the boiler and fuel characteristics (Behera et al. Citation2014). Nevertheless, physical modeling and simulation of a boiler is a complicated phenomenon (Adam and Marchetti Citation1999; Bhambre, Mitra, and Gaitunde Citation2007; Kwan and Anderson Citation1970; Lu Citation1999; Wu et al. Citation2011). For real-time simulation, monitoring, and prediction of boiler behavior, artificial neural network (ANN)-based models have emerged to be very useful, especially for the prediction of fresh steam properties from a newly installed boiler, for which no physical model exists (Kljajić, Gvozdenac, and Vukmirović Citation2012; Smrekar et al. Citation2009; Wu et al. Citation2011). The most widely used neural network for forecasting/prediction purposes is the multilayer perceptron (MLP) (Maier and Dandy Citation2001) using the backpropagation (BP) algorithm (Rummelhart, Hinton, and Williams Citation1986). In MLPs, the neurons (processing units) are connected to each other in a layered configuration, containing an input layer (receives information from external sources), a hidden layer (receives information from the input layer and processes them), and an output layer (receives processed information and signals the desired output; ).

FIGURE 1 Generic architecture of multiple decision system.

FIGURE 1 Generic architecture of multiple decision system.

The capability of soft computing methods such as ANNs, fuzzy logic, and expert systems to solve engineering problems including energy systems is well documented (Afgan et al. Citation1996; Khoshjavan, Rezai, and Heidary Citation2011; Lalot and Lecoeuche Citation2003; Monedero et al. Citation2012; Qin et al. Citation2012; Syn et al. Citation2011). It is, however, experimentally verified across various application domains that different decision makers trained under the same environment might provide contradictory decisions for different inputs. This motivated us to design a decision system by combining multiple decision expert systems (MDES) (Du et al. Citation2012; Kittler Citation1998; Kuncheva Citation2004; Kusiak, Li, and Zhang Citation2010; Polikar Citation2006; Tang et al. Citation2012). The basic idea is not to rely on a single decision system, rather on a consensus decision obtained by combining the individual performances with an anticipation of improved result. The objective of MDES is to exploit the complementary discriminatory ability of different expert systems for achieving improved learning and better generalization. In general, MDES has two major goals: (1) increasing the decision accuracy, and (2) increasing the robustness of the system in terms of generalization ability on unknown inputs. Combination of multiple decisions has been treated as one of the most exciting advancements in pattern recognition over the last decade. Improvement in performance due to combining decision systems is reviewed and presented by several researchers in various applications (Kittler Citation1998; Kuncheva Citation2004; Polikar Citation2006). Several methods for combining multiple models with applications to different domains have been described in the literature (Kuncheva Citation2004; Polikar Citation2006; Kusiak, Li, and Zhang Citation2010; Tang et al. Citation2012). For example, a neural network ensemble with five MLPs have been described to develop a predictive model for energy management applications, and Monte Carlo simulation was used to investigate uncertainty propagation of the model built by using weather forecast data (Kusiak, Li, and Zhang Citation2010). Based on the formulated model and weather forecasting data, future steam consumption was estimated. A hybrid ensemble learning paradigm integrating empirical mode decomposition and least squares support vector regression was proposed for nuclear energy consumption forecasting (Tang et al. Citation2012). This model was formulated specifically to address difficulties in modeling nuclear energy consumption, which inherently has high volatility, complexity, and irregularity. Recent literature survey describes the design, implementation, and application of many of the existing ensemble based systems in decision-making processes (Du et al. Citation2012; El-Melegy and Ahmed Citation2007; Ghosh et al. Citation2010; Kusiak, Li, and Zhang Citation2010; Polikar Citation2006; Tang et al. Citation2012).

Although many efforts aimed at MDES have become popular, the performance of the MDES is highly dependent on the individual decision-making system and the combination technique (Kuncheva Citation2004). The use of multiple decisions led to increase in computational complexity with significant increase in the performance. To overcome these constraints, a trade-off between the decision accuracy and the cost of computation needs to be carefully considered in real-world applications. Normally, a set of classifiers is used in the design of MDES for combining the output through some linear or nonlinear method. The process of combination can be anything, starting from simple voting or linear combination to adaptive learning. Recently, two different MDES models were developed for energy management applications (Kusiak, Li, and Zhang Citation2010; Tang et al. Citation2012). However, these models do not provide consistently better results in different environments. This means that, for various individual decision systems, based on the datasets collected from diverse applications, and use of different combination strategies, the corresponding MDES model provides dissimilar outputs.

Our aim in the present study is to use the whole feature space as input to MDES, combine all the outputs with different combination methods, including the adaptive combination method called neural combiner, to justify the potentiality of the use of MDES for parameter estimation of a boiler. Irrespective of the different datasets, the motivation to use an adaptive neural combiner to get a consistently better result has been drawn from various applications. We have considered MDES consisting of four ANNs (e.g., see Kusiak, Li, and Zhang Citation2010), all of which receive the same input data. The network structures of all ANNs are the same but are trained with four different learning algorithms, such as Levenberg–Marquardt optimization BP (Wilamowski and Yu Citation2010), resilient BP algorithm (Riedmiller and Braun Citation1993), extended Kalman filter (EKF)(Singhal and Wu Citation1989), and extreme learning machine (ELM)(Huang, Zhu, and Siew Citation2006). The decisions provided by the individual systems are combined with ten different combination techniques (Kuncheva Citation2004), such as voting, aggregation reasoning rules such as maximum, minimum, product, sum, and mean, probabilistic product, decision template, Dempster-Shafer, and neural network.

The inspiration drawn from the aforementioned literatures, and the scope of using real plant data from a newly installed refuse plastic fuel (RPF)-fired boiler helped us to formulate the research objective of this work, given as follows; (1) to create MDES by using different learning algorithm-based ANNs and a neural combiner that would predict the pressure, temperature, and mass flow rate of steam generated from the boiler, (2) to test the developed model with real plant data that was not presented to the trained decision system, and (3) to emphasize the application of MDES for real-time control of boiler parameters and (4) to address the potential advantages of MDES for predicting the boiler performance compared to the individual learning-method-based ANN. Finally, the article demonstrates the advantages of MDES with neural network-based individual decision-making systems and the decision combination that consistently provided the best output for the boiler performance analysis.

MATERIALS AND METHODS

Boiler Operation

The boiler under discussion is a water-tube type established in an incineration plant fired with RPF located within the Ulsan National Industrial Complexes, South Korea. It produces fresh steam with temperature and pressure in the range of 180 °C–190 °C and 12 kgf/cm2, respectively. A part of the steam is supplied to a nearby paper mill, and the remaining is used to meet its own energy requirement.

Data Acquisition and Preprocessing

Time-series data at 1 min intervals was provided by the plant manager for a period of five months. The data set consisted of the following parameters: steam temperature, steam pressure, mass flow rate, feed water pressure, feed water temperature, conveyor speed. and incinerator exit temperature. The data was filtered according to the procedure described elsewhere (De et al. Citation2007; Romeo and Gareta Citation2006; Rummelhart, Hinton, and Williams Citation1986). After the data filtering, the plant data was averaged at every 12 h and mixed together, which resulted in 215 data points for all the parameters used in this study. This amount of data was easier to handle, because the training process did not require longer time, which consequently resulted in developing a reliable and more representative MDEC model. The data was normalized and scaled to the range of 0 to 1 using Equation 1, in order to suit the transfer function in the hidden (sigmoid) and output (linear) layers of the ANN used in MDES.

(1)
where is the normalized value, and Xmin and Xmax are the minimum and maximum values of X, respectively.

Neural Combiner-Based MDES Development

As described earlier, the basic motivation in the design of MDES is to overcome some (known or unknown) limitations of individual approaches, which are often difficult to find for a given task at hand, while different decision makers are designed for the same task. For example, the use of the same base decision-maker trained on different training sets, or on different feature, can show evidence of complementary strengths and weaknesses. Moreover, the problem of decision making becomes a little complex process at the cost of improved performance, particularly when the expert system is designed in a multistage process.

Two major steps exist in the design of MDES, such as construction of the individual decision makers and the design of the combination rule (). The basic aim of the combination rule is to exploit the complementary decisions made by the individual systems. In general, most of the MDESs follow a parallel design structure, wherein the systems are trained independently so that all of them can make a decision on the input samples simultaneously. The outputs of these systems are finally combined for a consensus decision using some rules. Researchers have adopted different strategies to obtain complementary decisions from the systems. This strategy is broadly categorized into three levels (): decision system level, feature level, and data level (Kuncheva Citation2004).

FIGURE 2 Designing MDES in different levels of operations.

FIGURE 2 Designing MDES in different levels of operations.

Operation on training data (i.e., in the data level), is performed by training the individual system (or maybe the same base system) with different training sets. This method is usually preferred for unstable systems such as decision trees and neural networks. With the manipulation of input features (i.e., at the feature level), different feature sets for the same or different individual decision-making systems are used. At the decision system level, various contemporary and efficient decision-making systems are considered for the MDES design.

MDES with ANN

Among the different approaches for designing MDES, we have considered a simple and efficient approach in which the input sample data, with its original number of features/parameters are used for the next step of processing (). The proposed MDES is modeled using four ANNs with different learning algorithms, and the decisions obtained from these networks are finally combined using a conventional BP neural network.

The input and output parameters in the modeling of an individual ANN are usually selected on the basis of the objective of the modeling and the availability of reliable data (Rummelhart, Hinton, and Williams Citation1986). In order to develop the ANN model for the RPF-fired boiler, the output parameters viz., steam flow rate, (s), steam temperature (ts), and steam pressure (ps) were decided on the basis of real-life requirements. The selection of input parameters (belt conveyor speed (sc), incinerator exit temperature (tie), feed water pressure (pfw), and feed water temperature (tfw)) was made () on the basis of prior experience and system knowledge. The mass flow rate of fuel, feed water pressure, and feed water temperature have been selected previously as the input parameters for prediction of steam properties (De et al. Citation2007). However, considering the practical utility of the ANN model, a more directly controllable parameter, viz. belt conveyor speed, was included as a surrogate input parameter against RPF mass flow rate. Besides, the data received from the plant on the RPF mass flow rate were averaged calculated values. The basic statistics of the variables for the training and test matrix are shown in . These parameters are then fed in parallel to four ANN-based decision-making systems. The ANN is trained with four different learning methods: Levenberg-Marquardt optimization BP, resilient BP algorithm, EKF, and ELM. A brief introduction and operation of a conventional ANN is given in the following.

TABLE 1 Basic Statistics of the Data Used for ANN Model Development (a) Training and (b) Test Data

FIGURE 3 Schematic of a multilayer perceptron (4-15-3) neural network used for predicting the boiler behavior.

FIGURE 3 Schematic of a multilayer perceptron (4-15-3) neural network used for predicting the boiler behavior.

The basic motivation in the design of an ANN is to mimic the behavior and reasoning processes of the biological nervous system. Intuitively, the model gives a hope of accomplishing humanlike performance artificially by capturing the key ingredients responsible for the remarkable capabilities of the human nervous system. Making a collective decision is the inherent aspect of an ANN because of its interrelated connections among the processing units called neurons. In addition, the key characteristics of ANNs is that they are data driven, adaptive, fault tolerant, robust, and play important roles in a decision-making process. Furthermore, to discover the essential regularities in the problem space, the ANN fits very well to model complex nonlinear boundaries. In a conventional neural decision model, the number of nodes in the input-layer is equal to the number of parameters (features) present in the input data pattern and the number of output-layer nodes is equal to the number of output parameters (). Thus, the key information of different input parameters will automatically be encoded in the connecting links during training, and the nonlinear decision boundaries are generated to estimate the output parameters by making collective decisions with regard to the processing units’ functionalities.

Several attempts have been made to use ANNs for parameter estimation of different boilers (De et al. Citation2007; Kljajić, Gvozdenac, and Vukmirović Citation2012; Rummelhart, Hinton, and Williams Citation1986). In the present work, we have tried to explore the advantages of ANNs with different learning methods and finally use them to design an efficient MDES, which finally provides the best result compared to the individual ANN in estimating the performance of the RPF-fired boiler for a better analysis and diagnosis. The values of estimated parameters are obtained from these four ANNs and fed to the second step of processing, where the values are combined with a metalearner or combiner using a conventional BP-based neural network (). A brief description of the neural network-based decision fusion system is made in the following section.

Neural Network-Based Decision Fusion

Just as no system exists for providing optimum decision in general, there exists no “best” combiner for all problems. This motivates designing a decision combiner that performs consistently well for most of the problems and is not dependent on the dataset and the selection of individual decision-making systems. Among the different combining methods, “majority voting” is the most popular one, which interprets the decision as a vote for one of the decisions provided. However, for any specific task, each of these combiners could attain a different degree of success, but none of them is perfect and consistently performs well. Fusion decision varies with input data, type of individual decision-maker, and combination methods (Kuncheva Citation2004; Polikar Citation2006).

Broadly, the methods of combining decisions can be categorized as fixed and adaptive. The maximum, majority and average rules (Kuncheva Citation2004) are among the approaches that can be categorized as fixed combining methods. These combining methods do not acquire any information from the input data. On the other hand, the adaptive combining method uses the approach to possess parameters acquired via training. Such approaches are Demspter–Shafer, weighed average, behavioral knowledge space, and fuzzy integral approaches, fuzzy templates. Another way of categorizing these different classifier-combining techniques is based on the method of mapping between the input and output of the fusion module. This mapping may be linear or nonlinear. The feature-based approach, stacked generalization, or rank-based methods, which involve a more complex mapping of the input, also use a nonlinear mapping in the combining method. Decision fusion using a neural network is a trained, nonlinear scheme. The present study uses a neural network-based combination method that provides the final decision adaptively and is independent of input data and individual decision systems.

The neural network-based decision combining method proposed in this study falls under the adaptive combination category. The elements of the individual network’s output becomes the input to a feed forward MLP (), which acts as the combiner. The number of input nodes of the neural network is equal to the product of the number of individual decision expert systems used in the MDES and the number of output parameters to be estimated in the dataset. The number of output nodes of the neural network is equal to the number of output parameters present in the dataset. As a rule of thumb, the number of hidden nodes in the neural network is the square root of the product of the number of input nodes and the number of output nodes.

Working Principles of the ANN Models

Selection of Training Data

ANN detects the statistical interrelationship between a set of input and a set of output parameters. It can learn by training and cannot be more accurate than the initial training data. Thus, the proper selection of training data, from the available raw plant data is very important for the accurate prediction of the developed ANN-based MDES model. For the individual systems, four three-layered ANN models were developed to predict steam temperature, steam pressure, and mass flow rate, using feed water pressure, feed water temperature, conveyor speed, and incinerator exit temperature as the input parameters. The outputs of these systems are then used for the input to the ANN-based combiner to get the final decision output. The 215 data points were divided into different sets of training and testing sets, e.g., 80% (NTr: 170) of the data points were used for training the network, whereas the remaining 20% (NTe: 45) were used for testing the developed models. The sets of training and testing data were picked up randomly and tested for the performance of the model. The testing dataset of the boiler was kept aside during the training process and was used only for validation purposes.

Network Training, Testing, and Error Evaluation

Four ANNs have been used in this study for the MDESs that are trained with different learning algorithms, such as Levenberg–Marquardt optimization BP, resilient BP algorithm, EKF, and ELM, each of which has its own advantages and disadvantages. However, these algorithms have been selected because of their superiority over other existing algorithms. Anew, they have also been observed to perform fairly well when used individually. The basis of operations for all these four networks is the same although the learning methodologies are different; i.e., the input data are processed through the network, layer by layer, and finally the parameters are updated. This is an iterative process, which continues until an acceptable level of errors (difference between desired and estimated) is obtained. Each time the network processes, the whole set of data is called an epoch. After training, the ANN can accept new “unknown” data as input and predict the corresponding output based on its training. The performance of the training and test dataset was evaluated in terms of the correlation coefficient (R), and the mean absolute percentage error (MAPE) was used as an error-estimating index to evaluate the accuracy/predictive capability of the model (Kljajić, Gvozdenac, and Vukmirović Citation2012). It can be noted that higher R and lower MAPE values are desirable.

(2)
(3)
where xi is the target value, yi is the predicted value at time i, and n is the number of test or training samples. For the modeling work, Neural Network Tool box, Version 7.0 of MATLAB was used.

RESULTS AND DISCUSSION

Selection of Parameters for the Best Network Topology

In the training stage of three individual ANN decision systems and one ANN-based combiner, successive iterations consisting of sequences of learning and verification processes were repeated until the accuracy of the networks reached the assumed model of the MDES. For the individual systems, four ANNs with different training algorithms; such as Levenberg–Marquardt (LM) optimization BP, resilient BP, EKF and ELM have been used. In the decision combination process, ELM-based ANN is used because of its superiority over the other three () to obtain the final output. The training process was repeated for different sets of internal network parameters: training count (Tc) or epoch, number of neurons in the hidden layer (Nh), learning rate (η), and momentum term (α) of a BP neural network. A detailed study on the effect of internal parameters on the performance and procedures involved in selecting the best network topology of different training algorithms-based ANNs has been described elsewhere (Hornik, Stinchcombe, and White Citation1989). For the model development, the dataset was divided into two parts: (1) the first part was taken for the estimation of model parameters (training data), and the second part was taken for testing the performance (test data). Three different sizes of data were taken for training, viz., 60%, 70%, and 80% and 40%, 30%, and 20%, respectively, were considered as test data. Selection of the training data is random in nature and an equal percent of data is collected from each class.

TABLE 2 Performance Comparison of Individual Decision Expert Systems

The best network architectures were based on the R value (Elias et al. Citation2006) and were achieved by a vigorous trial-and-error approach (Silva et al. Citation2008), keeping some training parameters constant and slowly moving the other parameters over a wide range of values. For example, as a first step of the modeling procedure for the BP network, studies were initiated to identify the influence of both Tc and Nh for obtaining the suitable network topology. During model development for the boiler, Tc was varied from 500 to 1000 by keeping other network parameters such as η and α at some constant value (0.75). The best values of η and α for the developed model were thus determined by keeping some training parameters constant and by slowly moving these parameters from 0.1 to 0.9. It was observed that (1) increasing the number of neurons (Nh) from 6 to 18 increased the R values, (2) increasing the training count (Tc) increased the R values, (3) increasing the learning rate (η) from 0.01 to 0.9 decreased the R value significantly, and (4) increasing the momentum term (α) from 0.1 to 0.9 did not significantly increase the R value. The simulation results showed that the network architecture 4–15–3 (i.e., four input parameters, 15 neurons in one hidden layer and three output parameters) resulted in high R value during training, and this MLP had the following best values of network parameters: Nh = 18; Tc = 1000; η = 0.01, and α = 0.1.

Performance Analysis

The ANN-based MDES model for the boiler was specifically formulated to predict the values of output parameters more accurately using the values of the selected input parameters collected from the plant, during real-time operation. Successively, to verify this, the trained model was provided with a separate set of test data containing real measured values of input parameters, which was not used earlier during training. By comparing the prediction of the model with the actual/target measured values of output parameters, the expected performance of this trained model was assessed for its practical application. The results were evaluated in terms of the most commonly employed error measurement indexes: R and MAPE.

The comparative performances of the predictions of individual ANN models with different training algorithms are depicted in . The results in were evaluated on the test data for three sets of training and test percentages. It was observed from that, individually, the ELM-based ANN performed better compared to the rest with high R and low MAPE values for all three percentages of training and test sets. For example, with 80% training and 20% test set, the ELM-based model provided R and MAPE values of 0.9498 and 6.5304, respectively, compared to 0.8984 and 9.5936 with LM BP, 0.9112 and 6.9853 with resilient BP, and 0.9213 and 6.7914 with EKF-based models.

TABLE 3 Performance Comparison of MDES in Terms of MAPE with Different Combiners

In a comparative analysis with different decision-combiners-based MDES, results are shown in for the MAPE values with three different sets of training and test samples, such as 60% and 40%, 70% and 30%, and 80% and 20%, respectively. A similar trend of observation was also observed with respect to R values, and thus, we have not included these values in . Note that the MAPE values in the table are based on the test samples. The performance comparison between and revealed that any of the MDES models performed better than different individual models. Interestingly, among the MDES with six decision combiners (except the proposed neural combiner), the observation varies for different combiners and none of the MDES () provided consistently better results for all three training and test samples. For example, with 60% training set, the Dempster–Shafer-based model performed better, whereas with 70% and 80% training sets, decision template and mean combiners, respectively, performed better. Moreover, the improvement of MDES is dependent on different randomly selected training and test samples. Hence, it is difficult to choose a combiner for a particular dataset with a particular training set. However, with the proposed neural network combiner-based MDES, the accuracies were improved and found to be consistently superior for all three training sets compared to the results obtained with any of the six discussed combiners-based MDES.

The prediction capability of the proposed MDES was also verified by comparing the actual and predicted values of three output parameters of the boiler using four different models for 30% testing samples (, and ). The models that were considered for comparison are (1) MDES with neural-combiner, (2) MDES with Dempster–-Shafer combiner and 3) MDES with mean combiner. It was observed that the predicted values from the neural combiner-based MDES were more aligned with the targeted values compared to the other two models.

FIGURE 4 Targeted and predicted values of MDES models for steam pressure.

FIGURE 4 Targeted and predicted values of MDES models for steam pressure.

FIGURE 5 Targeted and predicted values of MDES models for steam temperature.

FIGURE 5 Targeted and predicted values of MDES models for steam temperature.

FIGURE 6 Targeted and predicted values of MDES models for steam flow rate.

FIGURE 6 Targeted and predicted values of MDES models for steam flow rate.

It can be seen from , and that the variations in the actual and predicted profiles of steam flow rate is comparatively large when compared to the steam pressure and temperature. This variation can be attributed to the large variation of feed water pressure (5.95 kgf/cm2 and 16.61 kgf/cm2; ). The fluctuation in the steam flow rate during the period of data collection could be attributed to the less homogeneous nature of RPF injected to the incinerator, which could have resulted in varying heat generation. Thus, the fluctuation in the input and output parameters would have caused an impact in the learning/generalization pattern of the neural networks during the performance prediction. The sudden drop in the measured steam temperature, pressure, and flow rates on data point 36 is due to a transient condition during the boiler operation. Despite this unavoidable transient-state condition, the results of the ANN-based MDES were excellent for predicting the steam temperature and pressure, with a slight variation in the steam flow rate prediction. Furthermore, the errors in prediction were due to the sudden fluctuation of the measured data presented to the MDES during training and testing. Nevertheless, the parts with higher fluctuation were predicted with quite good accuracy. It is, in general, observed that operation of a boiler is more or less stable at a nominal load, and the errors during ANN prediction can be the lowest (Smrekar et al. Citation2009). However, the prediction error increases with the load on the boiler, and under such circumstances ANN-based prediction does not provide satisfactory results. At the same time, deviations during prediction can also be expected from real boiler behavior operation due to the lack of a representative dataset (Romeo and Gareta Citation2006). This problem has been sorted out to a certain extent using MDES-based prediction, which is clearly observed from the results presented in this study. This implies that the degree of complexity of the data for the MDES-based network was not high and that, it can sufficiently map the relation between the given set of inputs and outputs.

Performance Analysis in Terms of Computational Time for Both Individual and MDES with Different Combiners

In this section, we have made a comparative performance analysis with computational time (C_time; the sum of training and testing times), as required by different individual and MDES with seven combiner-based models. The results for 70% training and 30% testing sets are depicted in . All the simulations were done in a MATLAB environment. It was observed from that the ANN model with EKF- and RP-learning-based models took high and low time, respectively, compared to the rest. Interestingly, the ELM-learning-based model took little more time than the RP-learning-based model, and at the same time performed the best among the four (). In a comparison analysis of MDES with different combiner-based models, as expected the proposed NN-combiner-based MDES took more time compared to others. However, at the cost of these times, it yielded the best and most consistent prediction results toward the performance analysis of the boiler system irrespective of different training and testing sets, whereas other combiner-based MDES provided varying results with less C_time.

FIGURE 7 Computational time taken by (a) individual and (a) different (a) combiner-based models for 70% training and 30% testing set.

FIGURE 7 Computational time taken by (a) individual and (a) different (a) combiner-based models for 70% training and 30% testing set.

Application of ANN-Based MDES for Real Time Performance Analysis of Boiler System

The developed ANN-based MDES for the boiler was trained by a very short computation time (0.018 s–0.025 s for one run), which resulted in predictions of high accuracy. Although the operational time for the individual learning network is insignificantly lower than the MDES, the prediction capability of any of the MDES is 8% to 9% better, and the proposed MDES is nearly 16% to 17% more accurate than the best individual model ( and ). This justifies the significance of MDES as a decision-making tool for evaluating the performance of the boiler. The proposed ANN-based MDES integrated in a simple user interface can enable the estimation of the quality of fresh steam properties on change of input parameters. Thus, the model can be used for online prediction of fresh steam properties and can also alert an operator about possible error in the system. The model developed might yield more promising results when the online control system is integrated with adequate application-specific optimization programs. Nevertheless, ANN-based MDES, when combined with more prominent applications such as genetic algorithms, fuzzy logic based-control systems, and fuzzy neural optimization software would allow better prediction and control of the boiler performance. This work might enable researchers to extend and intensify research in applying neural networks for optimizing state variables in a boiler for enhanced steam production.

Research Contribution

It has been proved that during the inception period of the MLP NN, MLP can approximate any function with a certain level of precision using two hidden layers of threshold nodes (Haykin Citation2009). Subsequently, however, it has been shown that an MLP with a single hidden layer and threshold nodes can also approximate any function with a specified precision (Haykin Citation2009). Interestingly, none of the findings provided any likely method of building and training MLP, and thus, the significance was observed only theoretically. In spite of this, MLP has been applied in various domains for solving highly complex problems (e.g., nonlinear function mapping), and it successfully gained attention for its human-like intelligence and discriminative power. The NN provides an alternative information processing approach to biological neural networks. Its major characteristics are adaptivity (adjusts to a change in environment/new data/information), speed (via massive parallelism), fault tolerance (to missing, confusing, and/or noisy data), ruggedness (to failure of nodes/links), and optimality (with regard to error rates in classification).

This motivated us to use the merits of NN in such a way that their shortcomings can be diminished in the resultant network using the concept of MDES. As described in the previous section, MDES has its own drawback in the selection of individual decision-making systems and the decision combination rules. Our proposed MDES has aimed to address these issues and used four individual NNs trained with different learning algorithms and an adaptive/trainable combination strategy, wherein the task of determining the data-dependent/decision, system-dependent-based combination rules can be avoided. Here, a NN was used as a combiner that takes the decisions of the individual systems as input to the network and provides respective outputs with consistent improvement in the performance, irrespective of data and decision-making systems. The efficacy of the proposed model for analyzing the behavior of RPF-fired boiler have been justified.

CONCLUSION

In the present study, we have proposed a decision-making model MDES based on a neural network combiner in which the outputs of a set of neural networks are fused adaptively. The usefulness of the model is demonstrated by showing its consistency in performance over other existing combiners and individual decision systems for various training and test sets. A set of four base neural systems with different training algorithms were considered, and the outputs of these systems were combined in a multiple classifier paradigm with different combiners (existing and proposed neural combiner), following which the performance analysis was evaluated. The proposed model was observed to work well and the improvement was consistent. However, the results were different for different existing combiners, depend highly on the input dataset.

The developed neural combiner-based MDES for the boiler was found to have very good prediction accuracy. As it can predict the steam properties (temperature, pressure, and mass flow rate) with good accuracy, the model can be used for evaluating the performance of the boiler through an online monitoring system. With the developed model, it will be easier to control, monitor, and predict the three output variables. As further research, it might be interesting to compare the performance of the proposed MDES model with other learnable combiners such as support vector machine and Fisher discriminant analysis (the two successful classifiers).

Notes

Color versions of one or more figures in the article can be found online at www.tandfonline.com/uaai

REFERENCES

  • Adam, E. J., and J. L. Marchetti. 1999. Dynamic simulation of large boilers with natural recirculation. Computers & Chemical Engineering 23:1031–40. doi:10.1016/S0098-1354(99)00269-0.
  • Afgan, N., M. G. Carvalho, and P. Coelho. 1996. Concept of expert system for boiler fouling assessment. Applied Thermal Engineering 16:835–44. doi:10.1016/1359-4311(95)00082-8.
  • Behera, S. K., E. R. Rene, M. C. Kim, and H. S. Park. 2014. Performance prediction of a RPF-fired boiler using artificial neural networks. International Journal of Energy Research 38(8): 995–1007. doi:10.1002/er.3108.
  • Bhambre, K., S. K. Mitra, and U. N. Gaitunde. 2007. Modeling of a coal-fired natural circulation boiler. Journal of Energy Resources — ASME 129:159–67. doi:10.1115/1.2719209.
  • De, S., M. Kaiadi, M. Fast, and M. Assadi. 2007. Development of an artificial neural network model for the steam process of a coal biomass co-fired combined heat and power (CHP) plant in Sweden. Energy 32:2099–109. doi:10.1016/j.energy.2007.04.008.
  • Du, P., J. Xia, W. Zhang, K. Tan, Y. Liu, and S. Liu. 2012. Multiple classifier system for remote sensing image classification: A review. Sensors 12:4764–92. doi:10.3390/s120404764.
  • Elias, A., G. Ibarra–Berastegi, R. Arias, and A. Barona. 2006. Neural networks as a tool for control and management of a biological reactor for treating hydrogen sulphide. Bioprocess and Biosystems Engineering 29:129–36. doi:10.1007/s00449-006-0062-3.
  • El-Melegy, M. T., and S. M. Ahmed. 2007. Neural networks in multiple classifier systems for remote-sensing image classification. In Soft computing in image processing: Studies in fuzziness and soft computing, ed. M. Nachtegael, D. Vin der Weken, E. E. Kerre, and W. Philips, Vol. 210, 65–96. Berlin, Heidelberg: Springer-Verlag.
  • Ghosh, A., B. Uma Shankar, L. Bruzzone, and S. K. Meher. 2010. Neuro-fuzzy-combiner: An effective multiple classifier system. International Journal of Knowledge Engineering and Soft Data Paradigms 2:107–29. doi:10.1504/IJKESDP.2010.034678.
  • Haykin, S. 2009. Neural networks and learning machines (3rd ed.). Upper Saddle River, NJ: Pearson Education, Inc.
  • Hornik, K., M. Stinchcombe, and H. White. 1989. Multilayer feedforward networks are universal approximators. Neural Networks 2:359–66. doi:10.1016/0893-6080(89)90020-8.
  • Huang, G. B., Q. Y. Zhu, and C. K. Siew. 2006. Extreme learning machine: Theory and applications. Neurocomputing 70:489–501. doi:10.1016/j.neucom.2005.12.126.
  • Khoshjavan, S., B. Rezai, and M. Heidary. 2011. Evaluation of effect of coal chemical properties on coal swelling index using artificial neural networks. Expert Systems with Applications 38:12906–12. doi:10.1016/j.eswa.2011.04.084.
  • Kittler, J. 1998. Combining classifiers: A theoretical framework. Pattern Analysis and Applications 1:18–27. doi:10.1007/BF01238023.
  • Kljajić, M., D. Gvozdenac, and S. Vukmirović. 2012. Use of neural networks for modeling and predicting boiler’s operating performance. Energy 45:304–11. doi:10.1016/j.energy.2012.02.067.
  • Kuncheva, L. I. 2004. Combining pattern classifiers: Methods and algorithms. New York, NY: John Wiley & Sons.
  • Kusiak, A., M. Li, and Z. Zhang. 2010. A data-driven approach for steam load prediction in buildings. Applied Energy 87:925–33. doi:10.1016/j.apenergy.2009.09.004.
  • Kwan, H. W., and J. H. Anderson. 1970. A mathematical model of a 200 MW boiler†. International Journal of Control 12:977–98. doi:10.1080/00207177008931911.
  • Lalot, S., and S. Lecoeuche. 2003. Online fouling detection in electrical circulation heaters using neural networks. International Journal of Heat and Mass Transfer 46:2445–57. doi:10.1016/S0017-9310(02)00545-8.
  • Lu, S. 1999. Dynamic modeling and simulation of power plant systems. Proceedings of the Institution of Mechanical Engineers Part A: Journal of Power and Energy 213:7–22.
  • Maier, H. R., and G. C. Dandy. 2001. Neural network based modelling of environmental variables: A systematic approach. Mathematical and Computer Modelling 33:669–82. doi:10.1016/S0895-7177(00)00271-5.
  • MOE (Ministry of Environment). 2013. South Korea. http://eng.me.go.kr/content.do?method=moveContent&menuCode=pol_rec_pol_rec_energy [accessed January 4, 2013].
  • Monedero, I., F. Biscarri, C. León, J. I. Guerrero, R. González, and L. Pérez-Lombard. 2012. Decision system based on neural networks to optimize the energy efficiency of a petrochemical plant. Expert Systems with Applications 39:9860–67. doi:10.1016/j.eswa.2012.02.165.
  • Polikar, R. 2006. Ensemble based systems in decision making. IEEE Transactions on Circuits and Systems 6:21–45.
  • Qin, R., D. Yan, X. Zhou, and Y. Jiang. 2012. Research on a dynamic simulation method of atrium thermal environment based on neural network. Building and Environment 50:214–20. doi:10.1016/j.buildenv.2011.11.001.
  • Riedmiller, M., and H. Braun. 1993. A direct adaptive method for faster back propagation learning: The Rprop algorithm. In Proceedings of the IEEE international conference on neural networks, 586–91. IEEE Press.
  • Romeo, L. M., and R. Gareta. 2006. Neural network for evaluating boiler behaviour. Applied Thermal Engineering 26:1530–36. doi:10.1016/j.applthermaleng.2005.12.006.
  • Rummelhart, D. E., G. E. Hinton, and R. J. Williams. 1986. Learning representations by back-propagation errors. Nature 323:533–36. doi:10.1038/323533a0.
  • Silva, R. G., L. M. Pinotti, A. J. G. Cruz, R. L. C. Giordano, and R. C. Giordano. 2008. Artificial neural networks to infer biomass and product concentration during the production of penicillin G acylase from Bacillus megaterium. . Journal of Chemical Technology and Biotechnology 83:739–49. doi:10.1002/jctb.1864.
  • Singhal, S., and L. Wu. 1989. Training multilayer perceptrons with the extended Kalman filter algorithm. In Advances in neural information processing systems, 133–40. San Mateo, CA: Morgan Kaufmann.
  • Smrekar, J., M. Assadi, M. Fast, I. Kuštrin, and S. De. 2009. Development of artificial neural network model for a coal-fired boiler using real plant data. Energy 34:144–52. doi:10.1016/j.energy.2008.10.010.
  • Syn, C. Z., M. Mokhtar, C. J. Feng, and Y. H. P. Manurung. 2011. Approach to prediction of laser cutting quality by employing fuzzy expert system. Expert Systems and Applications 38:7558–68. doi:10.1016/j.eswa.2010.12.111.
  • Tang, L., L. Yu, S. Wang, J. Li, and S. Wang. 2012. A novel hybrid ensemble learning paradigm for nuclear energy consumption forecasting. Applied Energy 93:432–43. doi:10.1016/j.apenergy.2011.12.030.
  • Wilamowski, B. M., and H. Yu. 2010. Improved computation for Levenberg–Marquardt training. IEEE Transactions on Neural Networks 21:930–37. doi:10.1109/TNN.2010.2045657.
  • Wu, F., H. Zhou, J.-P. Zhao, and K.-F. Cen. 2011. A comparative study of the multi-objective optimization algorithms for coal-fired boilers. Expert Systems with Applications 38:7179–85. doi:10.1016/j.eswa.2010.12.042.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.