The Impact of Data Accuracy on System Learning

Abstract:

The purpose of this paper is to study the impact of database accuracy on system learning. The paper assumes a basic model of an information system with a database, a rulebase, and an embedded machine learning approach that is used to add rules to the rulebase. The system learns from its database, changes to that database, and the examination of other databases. The results in this paper can be of use in the analysis of the design and behavior of such learning systems. It is found that the information system accuracy impacts the magnitude of a measure of goodness of individual rules. Thus, if only rules of a certain magnitude are kept, then some rules will be discarded because of database inaccuracy, unless that inaccuracy is accounted for. In addition, by accounting for database inaccuracy, the direction of the impact on measure of goodness can be determined. In some cases, the impact on the direction is monotonic. This finding allows us to understand the impact of database inaccuracy, without explicitly taking account of that inaccuracy. Further, information system accuracy can impact the resulting order of importance of rules, within a set of rules. Since only those higher-ranked rules are kept, database accuracy and measure of goodness can impact what rules are retained in the rulebase of the system. As a result, it is important to account for the information system accuracy in learning information systems.

Key Words and Phrases::

• artificial intelligence
• decision support systems
• expert systems
• machine learning

Additional information

Notes on contributors

Daniel E. O’Leary

Daniel E. O’Leary is an Associate Professor in the School of Business, at the University of Southern California. He received his Ph.D. from Case Western Reserve University, his master’s degree from the University of Michigan and a B.S. from Bowling Green University. Professor O’Leary is the editor of the International Journal of Intelligent Systems in Accounting, Finance and Management, and is on the editorial boards of a number of journals including Expert Systems with Applications, Accounting, Management and Information Technologies, and Advances in Mathematical Programming and Financial Planning. Dr. O’Leary has published a number of papers in the areas of artificial intelligence and expert systems; decision sciences and operational research; and information systems. In particular, he has published papers in Decision Sciences, European Journal of Operational Research, IEEE Expert, International Journal of Expert Systems, International Journal of Intelligent Systems, and International Journal of Man–Machine Studies, among others.