The (Extensive) Implications of Evaluation on the Development of Knowledge-Based System (1995)
| Venue: | In Proceedings of the 9th AAAI-Sponsored Banff Knowledge Acquisition for Knowledge Based Systems |
| Citations: | 13 - 10 self |
BibTeX
@INPROCEEDINGS{Menzies95the(extensive),
author = {Tim Menzies and Paul Compton},
title = {The (Extensive) Implications of Evaluation on the Development of Knowledge-Based System},
booktitle = {In Proceedings of the 9th AAAI-Sponsored Banff Knowledge Acquisition for Knowledge Based Systems},
year = {1995}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
: We argue that adding a requirement of evaluation and testing fundamentally changes KBS practice. In particular: (i) a fundamental change to the symbol-level representation in KBS; (ii) a rejection of certain unnecessary knowledge-level distinctions; (iii) a fundamental change to the inference engine of KBS; and (iv) a basic computational limit to the size and internal complexity of the models we create via knowledge acquisition. 1. INTRODUCTION It would be convenient if KBS evaluation was neutral with respect to KBS practice. If an evaluation module was merely a post-hoc bolt-on, then its design could be deferred until after a system was developed. However, if evaluation adds extra requirements and restrictions to the KBS process, then the design of an evaluation module must be integrated with the system it will test. This paper argues for the inconvenient latter position. Models constructed in vague domains (defined below) are possibly inaccurate. Possibly inaccurate models must b...
