A Mechanism to Improve the Interpretability of Linguistic Fuzzy Systems with Adaptive Defuzzification based on the use of a Multi-objective Evolutionary Algorithm

References

• Zadeh , L. A. 1965 . Fuzzy sets . Information and Control , 8 : 338 – 353 .
   Web of Science ®Google Scholar
• L. A Zadeh , The concept of a linguistic variable and its application to approximate reasoning , Part I, Inf. Sci . 8 1975 199 – 249 . Parts II and III, 8, 9, 301–357, 43–80 .
   Web of Science ®Google Scholar
• Mamdani , E. H. 1977 . Application of fuzzy logic to approximate reasoning using linguistic systems . IEEE Trans. on Computers , 26 ( 12 ) : 1182 – 1191 .
   Web of Science ®Google Scholar
• H. Hellendoorn and D. Driankov , Fuzzy Model Identification , Springer-Verlag , London , , UK , 1997 .
   Google Scholar
• Alcalá , R , Alcalá-Fdez , J. , Gacto , M. J. and Herrera , F. 2006 . Hybrid learning methods to get the interpretability– accuracy trade-off in fuzzy modeling . SoftComp , 10 ( 9 ) : 717 – 734 .
   Google Scholar
• J. Casillas , O. Cordón , F. Herrera , L. Magdalena Accuracy improvements in linguistic fuzzy modeling , Studies in Fuziness and Soft Computing , Springer, Heidelberg 2003 , pp. 129 .
   Google Scholar
• J. Casillas , O. Cordón , F. Herrera , L. Magdalena Interpretability issues in fuzzy modeling , Studies in Fuziness and Soft Computing , Springer, Heidelberg 2003 , pp. 128 .
   Google Scholar
• Ishibuchi , H. , Nozaki , K. , Yamamoto , N. and Tanaka , H. 1995 . Selecting fuzzy if-then rules for classification problems using genetic algorithms . IEEE Trans. on Fuzzy Sys. , 3 ( 3 ) : 260 – 270 .
   Web of Science ®Google Scholar
• H. Ishibuchi , T. Murata and I. B. Turksen , Selecting linguistic classification rules by two-objective genetic algorithms , in Proc. of the IEEE Int. Conf. on Sys. Man, Cybern . Vancouver , , Canada , 1995 , pp. 1410 – 1415 .
   Google Scholar
• H. Ishibuchi and T. Murata , Multi-objective genetic local search algorithm , in Proc. Third IEEE Int. Conf. on Evolut. Comput . Japan , 1996 , pp. 119 – 124 .
   Google Scholar
• Ishibuchi , H. , Murata , T. and Turksen , I. B. 1997 . Single-objective and two-objectie genetic algorithms for selecting linguistic rules for pattern classification problems . Fuzzy Sets and Sys , 89 ( 2 ) : 135 – 150 .
   Google Scholar
• Jin , Y. 2000 . Fuzzy modeling of high-dimensional systems: Complexity reduction and interpretability improvement . IEEE Trans. on Fuzzy Sys , 8 ( 2 ) : 212 – 221 .
   Web of Science ®Google Scholar
• H. Ishibuchi and T. Murata , Minimizing the fuzzy rule base and maximizing its performance by a multi-objective genetic algorithms , in Proc. 6th IEEE Int. Conf. Fuzzy Sys . 1997 pp. 259 – 264 .
   Google Scholar
• Alcalá-Fdez , J. , Herrera , F. , Márquez , F. and Peregrín , A. 2007 . Increasing fuzzy rules cooperation based on evolutionary adaptive inference systems . Int. J. Intell. Sys. , 22 ( 9 ) : 1035 – 1064 .
   Google Scholar
• Cordón , O. , Herrera , F. , Márquez , F. A. and Peregrín , A. 2004 . A study on the evolutionary adaptive defuzzification methods in fuzzy modeling . Int. J. of Hybrid Intell. Sys , 1 ( 1 ) : 36 – 48 .
   Google Scholar
• Márquez , F. A. , Peregrín , A. and Herrera , F. 2007 . Cooperative evolutionary learning of linguistic fuzzy rules and parametric aggregation connectors for Mamdani fuzzy systems . IEEE Trans. on Fuzzy Sys. , 15 ( 6 ) : 1168 – 1178 .
   Google Scholar
• Ishibuchi , H. and Murata , T. 1997 . Learning of fuzzy classification rules by a genetic algorithm . Electronics and Communications in Japan (Part III: Fundamental Electronic Science) , 80 ( 3 ) : 37 – 46 .
   Google Scholar
• Nozaki , K. , Ishibuchi , H. and Tanaka , H. 1996 . Adaptive Fuzzy Rule-Based Classification Systems . IEEE Trans. on Fuzzy Sys. , 4 ( 3 ) : 238 – 250 .
   Web of Science ®Google Scholar
• Ishibuchi , H. , Nozaki , K. and Tanaka , H. 1993 . Efficient Fuzzy Partition of Pattern Space for Classification Problems . Fuzzy Sets and Sys , 59 ( 3 ) : 295 – 304 .
   Google Scholar
• Alcalá , R. , Casillas , J. , Cordón , O. and Herrera , F. 2003 . Linguistic Modeling with Weighted Double-Consequent Fuzzy Rules Based on Cooperative Coevolutionary Learning . Integrated Computer Aided Engineering , 10 ( 4 ) : 343 – 355 .
   Google Scholar
• J. Casillas , F. Herrera , R. Pérez , M. J. del Jesus and P. Villar , P, Special issue on genetic fuzzy systems and the interpretability accuracy trade-off , Int. J. of Approximate Reasoning 44 2007 1 – 90 .
   Google Scholar
• González , J. , Rojas , I. , Pomares , H. , Herrera , L. J. , Guillén , A. , Palomares , J. M. and Rojas , F. 2007 . Improving the accuracy while preserving the interpretability of fuzzy function approximators by means of multi-objective evolutionary algorithms . Int. J. of Approximate Reasoning , 44 : 32 – 44 .
   Web of Science ®Google Scholar
• Gacto , M. J. , Alcalá , R. and Herrera , F. 2009 . Adaptation and Application of Multi-Objective Evolutionary Algorithms for Rule Reduction and Parameter Tuning of Fuzzy Rule-Based Systems . Soft Comput. , 13 ( 5 ) : 419 – 436 .
   Web of Science ®Google Scholar
• Ishibuchi , H. and Nojima , Y. 2007 . Analysis of interpretability– accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning . Int. J. of Approximate Reasoning , 44 : 4 – 31 .
   Web of Science ®Google Scholar
• M. Antonelli , D. Pietro , B. Lazzerini and F. Marcelloni , Multi-objective evolutionary learning of granularity, membership function parameters and rules of Mamdani fuzzy systems , Evolutionary Intell ., Special Issue on GFS: New Advances , 2 2009 21 – 37 , doi: 10.1007/s12065-009-0022-3 .
   Google Scholar
• Alcalá , R. , Gacto , M. J. , Herrera , F. and Alcalá-Fdez , J. 2007 . A multi-objective genetic algorithm for tuning and rule selection to obtain accurate and compact linguistic fuzzy rule-based systems, Inter. J. of Uncertainty . Fuzziness and Knowledge-Based Sys. , 15 ( 5 ) : 539 – 557 .
   Web of Science ®Google Scholar
• Botta , A. , Lazzerini , B. , Marcelloni , F. and Stefanescu , D. 2009 . Context adaptation of fuzzy systems through a multiobjective evolutionary approach based on a novel interpretability index . SoftComput. , 13 ( 5 ) : 437 – 449 .
   Google Scholar
• Gacto , M. J. , Alcalá , R. and Herrera , F. 2010 . Integration of an index to preserve the semantic interpretability in the multio-objective evolutionary rule selection and tuning of linguistic fuzy systems . IEEE Trans. on Fuzzy Sys. , 18 ( 3 ) : 515 – 531 .
   Web of Science ®Google Scholar
• Cococcioni , M. , Ducange , P. , Lazzerini , B. and Marcelloni , F. 2007 . A Pareto based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems . Soft Comput. , 11 : 1013 – 1031 .
   Web of Science ®Google Scholar
• Mencar , C. and Fanelli , A. 2008 . Interpretability constraints for fuzzy information granulation . Inf. Sci. , 178 ( 24 ) : 585 – 4618 .
   Google Scholar
• Zhou , M. and Gan , J. Q. 2008 . Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modeling . Fuzzy Sets and Sys. , 159 ( 23 ) : 3091 – 3131 .
   Web of Science ®Google Scholar
• Alonso , J. M. , Magdalena , L. and Gonzalez-Rodríguez , G. 2009 . Looking for a good fuzzy system interpretability index:An experimental approach . Int. J. of Approximate Reasoning , 51 : 115 – 134 .
   Web of Science ®Google Scholar
• M. J. Gacto , R. Alcalá , and F. Herrera , Interpretability of Linguistic Fuzzy Rule-Based Systems: An Overview of Interpretability Measures . Inf. Sci. 2011 doi: 10.1016/j.ins.2011.02.021 .
   Google Scholar
• Nauck , D. 2003 . Measuring interpretability in rule-based classification systems . Proc. of the 12th IEEE Int. Conf. on Fuzzy Sys. , 1 ( 2 ) : 196 – 201 .
   Google Scholar
• Alcalá , R. , Alcalá-Fdez , J. , Herrera , F. and Otero , J. 2007 . Genetic learning of accurate and compact fuzzy rule based systems based on the 2-tuples linguistic representation . Int.. J. of Approximate Reasoning , 44 : 45 – 64 .
   Web of Science ®Google Scholar
• S. Guillaume and B. Charnomordic , A new method for inducing a set of interpretable fuzzy partitions and fuzzy inference systems from data , in J. Casillas , O. Cordón , F. Herrera , L. Magdalena Interpretability issues in fuzzy modeling . Springer-Verlag , 2003 , pp. 148 – 175 .
   Google Scholar
• Guillaume , S. and Charnomordic , B. 2004 . Generationg an interpretable family of fuzzy partitions from data . IEEE Trans. on Fuzzy Sys. , 12 ( 3 ) : 324 – 335 .
   Google Scholar
• C. A. Coello , D. A. Van Veldhuizen and G. B. Lamont , Evolutionary algorithms for solving multi-objective problems Kluwer Academic Publishers , 2002 .
   Google Scholar
• K. Deb . Multi-objective optimization using evolutionary algorithms John Wiley & Sons , NY, USA , 2001 .
   Google Scholar
• Márquez , A. A. , Márquez , F. A. and Peregrín , A. 2009 . Rule base and adaptive fuzzy operators cooperative learning of Mamdani fuzzy systems with multi-objective genetic algorithms . Evolut. Intell. , 2 : 39 – 51 .
   Google Scholar
• Ishibuchi , H. , Nakashima , T. and Murata , T. 2001 . Three-objective genetics based machine learning for linguistic rule extraction . Inf. Sci. , 136 : 109 – 133 .
   Web of Science ®Google Scholar
• Ishibuchi , H. and Yamamoto , T. 2004 . Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining . Fuzzy Sets and Sys. , 141 ( 1 ) : 59 – 88 .
   Web of Science ®Google Scholar
• O. Cordón , M. del Jesus , F. Herrera , L. Magdalena and P. Villar , A multiobjective genetic learning process for joint feature selection and granularity and context learning in fuzzy rule-based classification systems , in: J. Casillas , O. Cordón , F. Herrera , L. Magdalena Interpretability issues in fuzzy modeling . Springer-Verlag , 2003 pp. 79 – 99 .
   Google Scholar
• H. Ishibuchi and T. Yamamoto , Interpretability issues in fuzzy genetics-based machine learning for linguistic modelling , in: J. Jawry , J. G. Shanahan , A. L. Ralescu Modelling with words: Learning, fusion, and reasoning within a formal linguistic representation framework , Vol. 2873 of Lecture Notes in Computer Science , Springer-Verlag , Berlin, Heidelberg , 2003 , pp. 209 – 228 .
   Google Scholar
• Cho , J. S. and Park , D. J. 2000 . Novel fuzzy logic control based on weighting of partially inconsistent rules using neural network . J. of Intell. and Fuzzy Sys. , 8 : 99 – 110 .
   Web of Science ®Google Scholar
• D. Nauck and R. Kruse , How the learning of rule weights affects the interpretability of fuzzy systems , in Proc. Seventh IEEE Int. Conf. Fuzzy Sys . 1998 1235 – 1240 .
   Google Scholar
• Ishibuchi , H. and Yamamoto , T. 2005 . Rule weight specification in fuzzy rule-based classification systems . IEEE Trans. on Fuzzy Sys. , 13 ( 4 ) : 428 – 435 .
   Web of Science ®Google Scholar
• H. Ishibuchi and T. Yamamoto , Trade-off between the number of fuzzy rules and their classification performance , in: J. Casillas , O. Cordón , F. Herrera , L. Magdalena Accuracy improvements in linguistic fuzzy modeling . Springer-Verlag , 2003 , pp. 72 – 99 .
   Google Scholar
• Cheong , F. and Lai , R. 2000 . Constraining the optimization of a fuzzy logic controller using an enhanced genetic algorithm . IEEE Trans. Sys., Man, Cybern. -Part B: Cybernetics , 30 ( 1 ) : 31 – 46 .
   PubMedGoogle Scholar
• Deb , K. , Agrawal , S. , Pratab , A. and Meyarivan , T. 2002 . A fast and elitist multiobjective genetic algorithm: NSGA-II . IEEE Trans. Evolut. Comput. , 6 ( 2 ) : 182 – 197 .
   Web of Science ®Google Scholar
• A.A. Márquez , F.A. Márquez and A. Peregrín , A Multi-objective Evolutionary Algorithm with an Interpretability Improvement Mechanism for Linguistic Fuzzy Systems with Adaptive Defuzzification . 2010 IEEE World Congress on Computational Intelligence (WCCI 2010 - FUZZ-IEEE 2010) . Barcelona , , Spain , 2010 277 – 283 .
   Google Scholar
• Cordón , O. and Herrera , F. 1997 . A three-stage evolutionary process for learning descriptive and approximate fuzzy logic controller knowledge bases from examples . Int. J. of Approximate Reasoning , 17 ( 4 ) : 369 – 407 .
   Google Scholar
• D. Driankov ., H. Haellendoorn and M. Reinfrank , An Introduction to Fuzzy Control Springer_Verlag 1993 .
   Google Scholar
• Lee , C. C. 1990 . Fuzzy logic in control Systems fuzzy logic controller parts I and II, IEEE Trans. Sys., Man . Cybern. , 20 : 404 – 435 .
   Google Scholar
• Alcalá-Fdez , J. , Sánchez , L. , García , S. , del Jesus , M. , Ventura , S. , Garrell , J. , Otero , J. , Romero , C. , Bacardit , J. , Rivas , V. , Fernández , J. and Herrera , F. 2009 . KEEL: A software tool to assess evolutionary algorithms to data mining problems . Soft Comput. , 13 ( 3 ) : 307 – 318 .
   Web of Science ®Google Scholar
• Wang , L. X. and Mendel , J.M. 1992 . Generating fuzzy rules by learning from examples . IEEE Trans. Sys., Man., Cybern. , 22 ( 6 ) : 1414 – 1427 .
   Web of Science ®Google Scholar
• Alcalá , R. , Ducange , P. , Herrera , F. , Lazzerini , B. and Marcelloni , F. 2009 . A Multi-Objective Evolutionary Approach to Concurrently Learn Rule and Data Bases of Linguistic Fuzzy Rule-Based Systems . IEEE Trans. on Fuzzy Sys. , 17 ( 5 ) : 1106 – 1122 .
   Web of Science ®Google Scholar
• Zitzler , E. , Deb , K. and Thiele , L. 2000 . Comparison of Multiobjective Evolutionary Algorithms: Empirical Results . Evolut. Comput. , 8 ( 2 ) : 173 – 195 .
   PubMed Web of Science ®Google Scholar
• Demšar , J. 2006 . Statistical comparisons of classifiers over multiple data sets . J. Mach Learn. Res. , 7 : 1 – 30 .
   Web of Science ®Google Scholar
• García , S. and Herrera , F. 2008 . An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons . J. Mach Learn. Res. , 9 : 2579 – 2596 .
   Google Scholar
• García , S. , Fernández , A. , Luengo , J. and Herrera , F. 2009 . A study of statistical techniques and performance measures for genetics-based machine learning: Accuracy and interpretability . Soft Comput. , 13 ( 10 ) : 959 – 977 .
   Web of Science ®Google Scholar
• S. García , A. Fernández , J. Luengo and F. Herrera , Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental Analysis of Power , Inf. Sci . 180 10 2010 2044 – 2064 . doi: 10.1016/j.ins.2009.12.010 .
   Web of Science ®Google Scholar
• D. J. Sheskin , Handbook of Parametric and Nonparametric Statistical Procedures , CRC Press , Boca Raton , FL , 2003 .
   Google Scholar
• Wilcoxon , F. 1945 . Individual comparisons by ranking methods . Biometrics , 1 : 80 – 83 .
   Web of Science ®Google Scholar
• Friedman , M. 1937 . The use of ranks to avoid the assumption of normality implicit in the analysis of variance . J. of the American Statistical Association , 32 : 674 – 701 .
   Google Scholar
• Finner , H. 1993 . On a monotonicity problem in step-down multiple test procedures . J. of the American Statistical Association , 88 : 920 – 923 .
   Web of Science ®Google Scholar