Objective measurement of test quality is one of the key issues in software testing. It has been a major research focus for the last two decades. Many test criteria have been proposed and studied for this purpose. Various kinds of rationales have been presented in support of one criterion or another. We survey the research work in

Based on the concept of user preference, we investigate the linear structure in information retrieval. We also discuss a practical procedure to determine the linear decision function and present an analysis of term weighting. Our experi-mental results seem to demonstrate that our model provides a useful framework for the design of an adaptive system. 1.

We identify and analyze basic principles which necessarily underlie software measures research. In the prevailing paradigm for the validation of software measures there is a fundamental assumption that the sets of measured documents are ordered, and that measures should report these orders. We describe mathematically the nature of such orders. Consideration of these orders suggests a hierarchy of software document measures, a methodology for developing new measures, and a general approach to the analytical evaluation of measures. We also point out the importance of units for any type of measurement and stress the perils of equating document structure complexity and psychological complexity. Keywords: software measures, abstractions of software documents, software structure, analytical evaluations of measures 1 Introduction This paper presents some underlying principles for software measures research. By "software measures" we mean measures which are obtainable directly from software d...

In this paper we investigate the problem of learning a preference relation from a given set of ranked documents. We show that the Bayes's optimal decision function, when applied to learning a preference relation, may violate transitivity. This is undesirable for information retrieval, because it is in conflict with a document ranking based on the user's preferences. To overcome this problem we present a vector space based method that performs a linear mapping from documents to scalar utility values and thus guarantees transitivity. The learning of the relation between documents is formulated as a classification problem on pairs of documents and is solved using the principle of structural risk minimization for good generalization. The approach is extended to polynomial utility functions by using the potential function method (the so called "kernel trick"), which allows to incorporate higher order correlations of features into the utility function at minimal computational costs. The resu...

This chapter presents a review of various interpretations of the fuzzy membership function together with ways of obtaining a membership function. We emphasize that different interpretations of the membership function call for different elicitation methods. We try to make this distinction clear using techniques from measurement theory.

Two different but related measurement problems are considered within the fuzzy set theory. The first problem is the membership measurement and the second is property ranking. These two measurement problems are combined and two axiomatizations of fuzzy set theory are obtained. In the first one, the indifference is transitive but in the second one this drawback is removed by utilizing interval orders.

Virtual reality (VR) involves an attempt to create an illusion that the user of the VR system is actually present in a synthetic (usually computer-generated) environment. Little is known about how various system parameters affect the illusion of presence in a virtual environment (VE). In particular, there seem to be very little quantitative data on which to base VR system design decisions. Also, while presence (or immersion) in VEs is a primary goal of VR, not much is known about how this variable affects task performance. The goal of this research was to provide a ratio-scale measure of perceived presence in a VE, to explore the effects of a number of environmental parameters on this measure and construct empirical models of these effects, and to relate perceived presence to user performance. This was done by manipulating eleven independent variables in a series of three experiments. The independent variables manipulated were scene update rate, visual display resolution, field of view, sound, textures, head-tracking, stereopsis, virtual personal risk, number of possible interactions, presence of a second user, and environmental detail. Participants performed a set of five tasks in the VE and rated perceived presence at the end of each set using the technique of freemodulus magnitude estimation. The amount of time spent in the VE was also recorded. The results

This review article attempts to highlight from my personal perspective some of the major developments in the representational theory of measurement during the past 50 years. Emphasis is placed on the ongoing interplay between the development of abstract theory and the attempts to apply it to empirically testable phenomena. The article has four major sections. The first concerns classical representational measurement, which was the successful attempt to formulate the major measurement methods of classical physics: extensive and additive conjoint structures, their distributive interlock in dimensional analysis, and intensive (averaging) structures. The second illustrates a nontrivial behavioral example using both extensive and conjoint measurement plus functional equations to arrive at rank- and sign-dependent utility (also called cumulative prospect) representations for decision making under risk. The third section, contemporary representational measurement, somewhat overlaps the classical one but includes new findings and approaches: representations of nonadditive concatenation and conjoint structures; a general theory of scale types; results for general, finitely unique, homogeneous structures; structures that are homogeneous between singular points; generalized distributive triples; and a generalization of dimensional analysis to include any ratio scalable attribute; and the concept of meaningfulness. The final section concerns applications of the latter ideas to psychophysical scaling and merging functions.] 1996 Academic Press, Inc. 1.

The problem of representing intersection and union in fuzzy set theory is considered. There are various proposals in the literature to model these concepts. The possibility of using continuous triangular norms and conorms (including min and max) are taken up in a measurement--theoretic setting. The conditions are laid out to arrive at cardinal scales on which addition and multiplication are meaningful and critically discussed. These conditions must either be accepted on normative grounds or must be empirically verified before the modeling process in order to see which operations are meaningful. It is emphasized that the Archimedean axiom and the existence of natural bounds are crucial in arriving at ratio and absolute scale representations. Keywords: Membership functions, measurement theory, operators, relations. 1 Introduction and Preview When Zadeh [45] introduced the concept of a fuzzy set he suggested to use the functions min and max to model set theoretic intersection an...

Summary. Many measures have been proposed and studied extensively in data mining for evaluating the interestingness (or usefulness) of discovered rules. They are usually defined based on structural characteristics or statistical information about the rules. The meaningfulness of each measure was interpreted based either on intuitive arguments or mathematical properties. There does not exist a framework in which one is able to represent the user judgment explicitly, precisely, and formally. Since the usefulness of discovered rules must be eventually judged by users, a framework that takes user preference or judgement into consideration will be very valuable. The objective of this paper is to propose such a framework based on the notion of user preference. The results are useful in establishing a measurementtheoretic foundation of rule interestingness evaluation.