In spite of many statistical methods for outlier detection and for robust analysis, there is little work on further analysis of outliers themselves to determine their origins. For example, there are “good ” outliers that provide useful information that can lead to the discovery of new knowledge, or “bad ” outliers that include noisy data points. Successfully distinguishing between different types of outliers is an important issue in many applications, including fraud detection, medical tests, process analysis and scientific discovery. It requires not only an understanding of the mathematical properties of data but also relevant knowledge in the domain context in which the outliers occur. This thesis presents a novel attempt in automating the use of domain knowledge in helping distinguish between different types of outliers. Two complementary knowledge-based outlier analysis strategies are proposed: one using knowledge regarding how “normal data ” should be distributed in a domain of interest in order to identify “good ” outliers, and the other using the understanding of “bad ” outliers. This kind of knowledge-based outlier analysis is a useful extension to existing work in both statistical and computing communities on outlier detection.

Intelligent data analysis (IDA) is an interdisci-plinary study concerned with the effective analysis of data. This paper will briefly look at some of the key issues in intelligent data analysis, discuss the opportu-nities for soft computing in this context, and present.several IDA case studies in which soft computing has played key roles. These studies are all concerned with complex real-world problem solving, including consis-tency checking between mass spectral data with pro-posed chemical structures, screening for glaucoma and other eye diseases, forecasting of visual field deteriora-tion, and diagnosis in an oil refinery involving multi-variate time series. Bayesian networks, evolutionary computation, neural networks, and machine learning in general are some of those soft computing techniques effectively used in these studies. 1.