Data-driven adaptive selection of rule quality measures for improving rule induction and filtration algorithms

References

• Agrawal, R., and R. Srikant. 2004. “Fast Algorithms for Mining Association Rules.” Proceedings of the 20th VLDB Conference, Santiago, Chile.
   Google Scholar
• An , A. and Cercone , N. 2001 . Rule Quality Measures for Rule Induction Systems – Description and Evaluation . Computational Intelligence , 17 : 409 – 424 .
   Web of Science ®Google Scholar
• Bruha , I. 1997 . “ Quality of Decision Rules: Definitions and Classification Schemes for Multiple Rules ” . In Machine Learning and Statistics: The Interface , Edited by: Nakhaeizadeh , G. and Taylor , C. C. 107 – 131 . New York : John Wiley .
   Google Scholar
• Bruha , I. and Tkadlec , J. 2003 . Rule Quality for Multiple-rules Classifier: Empirical Expertise and Theoretical Methodology . Intelligent Data Analysis , 7 : 99 – 124 .
   Google Scholar
• Brzezińska , I. , Słowiński , R. and Greco , S. 2007 . Mining Pareto-optimal Rules with Respect to Support and Confirmation or Support and Anti-support . Engineering Applications of Artificial Intelligence , 20 ( 5 ) : 587 – 600 .
   Web of Science ®Google Scholar
• Chen, S., and B. Liu. 2001. “Generating Classification Rules According to User’s Existing Knowledge.” Proceedings of the SIAM International Conference on Data Mining (SDM-01), April 5-7, Chicago, IL, USA.
   Google Scholar
• Christensen , D. 1999 . Measuring Confirmation . Journal of Philosophy , XCVI : 437 – 461 .
   Web of Science ®Google Scholar
• Cohen, W. W. 1995. “Fast Effective Rule Induction.” In Proceedings of the Twelfth International Conference on Machine Learning, July 9-12, Tahoe City, CA, USA.
   Google Scholar
• Duch , W. , Adamczak , R. and Grabczewski , K. 2000 . A New Methodology of Extraction, Optimization and Application of Crisp and Fuzzy Logical Rules . IEEE Transaction on Neural Networks , 11 ( 2 ) : 1 – 31 .
   Google Scholar
• Dzeroski , S. and Lavrac , N. 1996 . Rule Induction and Instance-based Learning Applied in Medical Diagnosis . Technology and Health Care , 4 ( 2 ) : 203 – 221 .
   PubMedGoogle Scholar
• Eells , E. and Fitelson , B. 2002 . Symmetries and Asymmetries in Evidential Support . Philosophical Studies , 107 ( 2 ) : 129 – 142 .
   Web of Science ®Google Scholar
• Fawcett , T. 2008 . PRIE a System for Generation Rulelist to Maximize ROC Performance . Data Mining and Knowledge Discovery , 17 : 207 – 224 .
   Web of Science ®Google Scholar
• Fürnkranz , J. 1999 . Separate-and-Conquer Rule Learning . Artificial Intelligence Review , 13 : 3 – 54 .
   Web of Science ®Google Scholar
• Fürnkranz , J. and Flach , P. A. 2005 . ROC ‘n’ Rule Learning – Towards a Better Understanding of Covering Algorithms . Machine Learning , 58 : 39 – 77 .
   Web of Science ®Google Scholar
• Gamemberg , D. and Lavrac , N. 2002 . Expert-guided Subgroup Discovery: Methodology and Application . Journal of Artificial Intelligence Research , 17 : 501 – 527 .
   Web of Science ®Google Scholar
• Geng , L. and Hamilton , H. J. 2006 . Interestingness Measures for Data Mining: A Survey . ACM Computing Surveys , 38 ( 3 ) doi:10.1145/1132960.1132963
   Web of Science ®Google Scholar
• Greco , S. , Pawlak , Z. and Słowiński , R. 2004 . Can Bayesian Confirmation Measures be Useful for Rough set Decision Rules? . Engineering Applications of Artificial Intelligence , 17 : 345 – 361 .
   Web of Science ®Google Scholar
• Grzymała-Busse , J. W. and Ziarko , W. 2003 . “ Data Mining Based on Rough Sets ” . In Data Mining Opportunities and Challenges , Edited by: Wang , J. 142 – 173 . Hershey , PA : IGI .
   Google Scholar
• Hilderman , R. J. and Hamilton , H. J. 2001 . Knowledge Discovery and Measures of Interest , Boston , MA : Kluwer Academic .
   Google Scholar
• Janssen , F. and Fürnkranz , J. 2010 . On the Quest for Optimal Rule Learning Heuristics . Machine Learning , 78 : 343 – 379 .
   Web of Science ®Google Scholar
• Joyce , J. 1999 . The Foundations of Causal Decision Theory , Cambridge : Cambridge University Press .
   Google Scholar
• Kamber, M., and R. Shinghal. 1996. “Evaluating the Interestingness of Characteristic Rules.” In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD-96), 263–266. Portland, Oregon.
   Google Scholar
• Kaufman, K. A., and R. S. Michalski. 1999. Learning in Inconsistent World, Rule Selection in STAR/AQ18. Machine Learning and Inference Laboratory, Report P99–2.
   Google Scholar
• Kavsek , B. and Lavrac , N. 2006 . APRIORI-SD: Adapting Association Rule Learning to Subgroup Discovery . Applied Artificial Intelligence , 20 : 543 – 583 .
   Web of Science ®Google Scholar
• Kryszkiewicz , M. 1998 . Representative Association Rules and Minimum Condition Maximum Consequence Association Rules . Lecture Notes in Artificial Intelligence , 1510 : 361 – 369 .
   Google Scholar
• Lakhal , L. and Stumme , G. 2005 . Efficient Mining of Association Rules Based on Formal Concept Analysis . Lecture Notes in Computer Sciences , 3626 : 180 – 195 .
   Google Scholar
• Lavrac, N., P. A. Flach, and B. Zupan. 1999. “Rule Evaluation Measures: A Unifying View.” In Lecture Notes in Artificial Intelligence, 1634, edited by Saso Dzeroski and Peter Flach, 174–185, Heidelberg: Springer-Verlag.
   Google Scholar
• Lavrac , N. , Kavsek , B. and Flach , P. 2004 . Subgroup Discovery with CN2-SD . Journal of Machine Learning Research , 5 : 153 – 188 .
   Web of Science ®Google Scholar
• MacGarry , K. 2005 . A Survey of Interestingness Measures for Knowledge Discovery . The Knowledge Engineering Review , 20 ( 1 ) : 39 – 61 .
   Web of Science ®Google Scholar
• Michalski, R. S. 1973. “Discovering Classification Rules Using variable-valued Logic System VL.” In Proceedings of the Third International Joint Conference on Artificial Intelligence, 162–172. Stanford CA, USA.
   Google Scholar
• Ohsaki , M. , Hidenao , A. , Tsumoto , S. , Hideto , Y. and Yamaguchi , T. 2007 . Evaluation of Rule Interestingness Measures in Medical Knowledge Discovery in Databases . Artificial Intelligence in Medicine , 41 ( 3 ) : 177 – 196 .
   PubMed Web of Science ®Google Scholar
• Pawlak , Z. 1991 . Rough Sets: Theoretical Aspects of Reasoning about Data , Dordrecht : Kluwer .
   Google Scholar
• Piatetsky-Shapiro , G. 1991 . “ Discovery, Analysis, and Presentation of Strong Rules ” . In Knowledge Discovery in Databases , Edited by: Piatetsky-Shapiro , G. and Frawley , W. J. 229 – 248 . Cambridge , MA : MIT Press .
   Google Scholar
• Sahar, S. 2010. “Interestingness Measures – On Determining what is Interesting.” Data Mining and Knowledge Discovery Handbook. 2nd ed, eidted by O. Maimon and L. Rokach, 603–612. New York: Springer.
   Google Scholar
• Sakai , H. , Nakata , M. and Ślęzak , D. 2010 . The Lower and the Upper Systems of Rules in Tables with Missing Values. Database Theory and Application, Bio-Sciences and Bio-Technology . Communications in Computer and Information Sciences , 118 : 132 – 141 .
   Google Scholar
• Sikora, M. 2006. “Rule Quality Measures in Creation and Reduction of Data Rule Models.” In Lecture Notes in Artificial Intelligence, 4259, edited by Salvadore Greco, Yutaka Hata, Shoji Hirano, Masahiro Inuiguchi, Sadaaki Miyamoto, Hung Son Nguyen and Roman Słowiński, 716–725. Heidelberg: Springer-Verlag.
   Google Scholar
• Sikora , M. 2010 . Decision Rules Based Data Models Using TRS and NetTRS – Methods and Algorithms . Transaction on Rough Sets – Lecture Notes in Computer Sciences , 5946 : 130 – 160 .
   Google Scholar
• Sikora , M. 2011 . Induction and Pruning of Classification Rules for Prediction of Microseismic Hazard in Coal Mines . Expert Systems with Applications , 38 ( 6 ) : 6748 – 6758 .
   Web of Science ®Google Scholar
• Sikora , M. and Gruca , A. 2011 . Induction and Selection of the Most Interesting Gene Ontology Based Multiattribute Rules for Descriptions of Gene Groups . Pattern Recognition Letters , 32 : 258 – 269 .
   Web of Science ®Google Scholar
• Sikora , M. and Wróbel , Ł. 2010 . Application of Rule Induction Algorithms for Analysis of Data Collected by Seismic Hazard Monitoring Systems in Coal Mines . Archives of Mining Sciences , 55 ( 1 ) : 91 – 114 .
   Web of Science ®Google Scholar
• Sikora , M. and Wróbel , Ł. 2011 . Data-driven Adaptive Selection of Rules Quality Measures for Improving the Rules Induction Algorithm . Lecture Notes in Artificial Intelligence , 6743 : 279 – 287 .
   Google Scholar
• Ślęzak , D. 2005 . Rough Sets and Bayes Factor. Transaction on Rough Sets III . Lecture Notes in Computer Sciences , 3400 : 202 – 229 .
   Google Scholar
• Ślęzak , D. 2009 . Rough Sets and Functional Dependencies in Data: Foundations of Association Reducts . Lecture Notes in Computer Sciences , 5540 : 182 – 205 .
   Google Scholar
• Ślęzak , D. and Widz , S. 2010 . Is it Important Which Rough-set-based Classifier Extraction and Voting Criteria are Applied Together? . Lecture Notes in Artificial Intelligence , 6086 : 187 – 196 .
   Google Scholar
• Ślęzak , D. and Widz , S. 2011 . Rough-set-inspired Feature Subset Selection, Classifier Construction, and Rule Aggregation . Lecture Notes in Computer Sciences , 6954 : 81 – 88 .
   Google Scholar
• Stefanowski , J. and Vanderpooten , D. 2001 . Induction of Decision Rules in Classification and Discovery-oriented Perspectives . International Journal of Intelligent Systems , 16 : 13 – 27 .
   Web of Science ®Google Scholar
• Szczęch , I. 2009 . “ Multicriteria Attractiveness Evaluation of Decision and Association Rules ” . In Trans-actions on Rough Sets X Lecture Notes in Computer Sciences, 5656 , Edited by: Peters , James F. , Skowron , Andrzej , Wolski , Marcin , Chakraborty , Mihir K. and Wu , Wei-Zhi . 197 – 274 . Heidelberg : Springer .
   Google Scholar
• Tan, P., V. Kumar, and J. Srivastava. 2002. “Selecting the Right Interestingness Measure for Association Patterns.” In Proceedings of the 8th International Conference on Knowledge Discovery and Data Mining (KDD 2002). 32–41. Edmonton, Canada.
   Google Scholar
• Webb , G. I. and Brain , D. 2006 . Generality is Predictive of Prediction Accuracy . Lecture Notes in Computer Sciences , 3755 : 1 – 13 .
   Google Scholar
• Witten , I. H. and Frank , E. 2005 . Data Mining: Practical Machine Learning Tools and Techniques , Morgan Kaufmann .
   Google Scholar
• Wohlrab , L. and Fürnkranz , J. 2011 . A Review and Comparison of Strategies for Handling Missing Values in Separate-and-conquer Rule Learning . Journal of Intelligent Information Systems , 36 ( 1 ) : 73 – 98 .
   Web of Science ®Google Scholar
• Xiong, H., S. Shekhar, P. N. Tan, and V. Kumar. 2004. “Exploiting a Support-based Upper Bound of Pearson’s Correlation Coefficient for Efficiently Identifying Strongly Correlated Pairs.” In Proceedings of the 10th ACM SIGKDD, 334–343. Seattle, USA.
   Google Scholar
• Yao , Y. Y. and Zhong , N. 1999 . An Analysis of Quantitative Measures Associated with Rules . Lecture Notes in Artificial Intelligence , 1574 : 479 – 488 .
   Google Scholar
• Yao, Y., and B. Zhou. 2008. “Micro and Macro Evaluation of Classification Rules.” In Proceedings of the Seventh IEEE International Conference on Cognitive Informatics, ICCI 2008, August 14-16, Stanford University, CA, USA.
   Google Scholar