Results 1 -
8 of
8
Machine learning approaches to network anomaly detection
- in Proceedings of the Second Workshop on Tackling Computer Systems Problems with Machine Learning (SysML
, 2007
"... Abstract — Networks of various kinds often experience anomalous behaviour. Examples include attacks or large data transfers in IP networks, presence of intruders in distributed video surveillance systems, and an automobile accident or an untimely congestion in a road network. Machine learning techni ..."
Abstract
-
Cited by 7 (0 self)
- Add to MetaCart
Abstract — Networks of various kinds often experience anomalous behaviour. Examples include attacks or large data transfers in IP networks, presence of intruders in distributed video surveillance systems, and an automobile accident or an untimely congestion in a road network. Machine learning techniques enable the development of anomaly detection algorithms that are non-parametric, adaptive to changes in the characteristics of normal behaviour in the relevant network, and portable across applications. In this paper we use two different datasets, pictures of a highway in Quebec taken by a network of webcams and IP traffic statistics from the Abilene network, as examples in demonstrating the applicability of two machine learning algorithms to network anomaly detection. We investigate the use of the block-based One-Class Neighbour Machine and the recursive Kernel-based Online Anomaly Detection algorithms. I.
Detecting Activities from Body-Worn Accelerometers via Instance-based Algorithms
"... The automatic and unobtrusive identification of user’s activities is one of the challenging goals of context-aware computing. This paper discusses and experimentally evaluates instance-based algorithms to infer user’s activities on the basis of data acquired from body-worn accelerometer sensors. We ..."
Abstract
-
Cited by 3 (3 self)
- Add to MetaCart
The automatic and unobtrusive identification of user’s activities is one of the challenging goals of context-aware computing. This paper discusses and experimentally evaluates instance-based algorithms to infer user’s activities on the basis of data acquired from body-worn accelerometer sensors. We show that instance-based algorithms can classify simple andspecificactivities with high accuracy. In addition, due to their low requirements, we show how they can be implemented on severely resource-constrained devices. Finally, we propose mechanisms to take advantage of the temporal dimension of the signal, and to identify novel activities at run time.
Outlier Detection with Globally Optimal Exemplar-Based GMM
"... Outlier detection has recently become an important problem in many data mining applications. In this paper, a novel unsupervised algorithm for outlier detection is proposed. First we apply a provably globally optimal Expectation Maximization (EM) algorithm to fit a Gaussian Mixture Model (GMM) to a ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
Outlier detection has recently become an important problem in many data mining applications. In this paper, a novel unsupervised algorithm for outlier detection is proposed. First we apply a provably globally optimal Expectation Maximization (EM) algorithm to fit a Gaussian Mixture Model (GMM) to a given data set. In our approach, a Gaussian is centered at each data point, and hence, the estimated mixture proportions can be interpreted as probabilities of being a cluster center for all data points. The outlier factor at each data point is then defined as a weighted sum of the mixture proportions with weights representing the similarities to other data points. The proposed outlier factor is thus based on global properties of the data set. This is in contrast to most existing approaches to outlier detection, which are strictly local. Our experiments performed on several simulated and real life data sets demonstrate superior performance of the proposed approach. Moreover, we also demonstrate the ability to detect unusual shapes. 1
DNIDS: A Dependable Network Intrusion Detection System Using the CSI-KNN Algorithm
, 2007
"... The dependability of an Intrusion Detection System (IDS) relies on two factors: abil-ity to detect intrusions and survivability in hostile environments. Machine learning-based anomaly detection approaches are gaining increasing attention in the network intrusion detection community because of their ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
The dependability of an Intrusion Detection System (IDS) relies on two factors: abil-ity to detect intrusions and survivability in hostile environments. Machine learning-based anomaly detection approaches are gaining increasing attention in the network intrusion detection community because of their intrinsic ability to discover novel at-tacks. This ability has become critical since the number of new attacks has kept growing in recent years. However, most of today’s anomaly-based IDSs generate high false positive rates and miss many attacks because of a deficiency in their ability to discriminate attacks from legitimate behaviors. These unreliable results damage the dependability of IDSs. In addition, even if the detection method is sound and effec-tive, the IDS might still be unable to deliver detection service when under attack. With the increasing importance of the IDS, some attackers attempt to disable the IDS before they launch a thorough attack. In this thesis, we propose a Dependable Network Intrusion Detection System (DNIDS) based on the Combined Strangeness and Isolation measure K-Nearest Neigh-
Dynamic Intrusion Detection Method for Mobile Ad Hoc Network Using CPDOD Algorithm
"... Abstract Mobile Ad hoc networks (MANETs) are susceptible to several types of attacks due to their open medium, lack of centralized monitoring and management point, dynamic topology and other features. Many of the intrusion detection techniques developed on wired networks cannot be directly applied t ..."
Abstract
-
Cited by 1 (1 self)
- Add to MetaCart
Abstract Mobile Ad hoc networks (MANETs) are susceptible to several types of attacks due to their open medium, lack of centralized monitoring and management point, dynamic topology and other features. Many of the intrusion detection techniques developed on wired networks cannot be directly applied to MANET due to special characteristics of the networks. However, all such intrusion detection techniques suffer from performance penalties and high false alarm rates. In this paper, we propose a novel intrusion detection method by combining two anomaly methods Conformal Predictor k-nearest neighbor and Distancebased Outlier Detection (CPDOD) algorithm. A series of experimental results demonstrate that the proposed method can effectively detect anomalies with low false positive rate, high detection rate and achieve higher detection accuracy.
Identifying Multi-instance Outliers
"... This paper studies a new data mining problem called multiinstance outlier identification. This problem arises in tasks where each sample consists of many alternative feature vectors (instances) that describe it. This paper defines the multi-instance outliers and analyzes the basic types of multiinst ..."
Abstract
- Add to MetaCart
This paper studies a new data mining problem called multiinstance outlier identification. This problem arises in tasks where each sample consists of many alternative feature vectors (instances) that describe it. This paper defines the multi-instance outliers and analyzes the basic types of multiinstance outliers. Two general identification approaches are proposed based on the state-of-the-art (single-instance) outlier detector LOF (local outlier factor). One approach utilizes the underlying mechanism of the kernel method and plunges the set distance into LOF to detect the multiinstance outliers. The other approach takes each instance’s neighborhood into account. Based on the two approaches, four concrete multi-instance outlier detectors are then introduced. We conductexperimentsover four syntheticdatacollections
The Guardian of the Republic: A conceptual system to detect outliers on Public Contracts
"... Abstract. The paper focuses on the processing of the information available in government portals. Nowadays, in an e-Government, common citizens can have access to various contents, such as government decisions, government acts, court decisions, legislation and other information displayed on the offi ..."
Abstract
- Add to MetaCart
Abstract. The paper focuses on the processing of the information available in government portals. Nowadays, in an e-Government, common citizens can have access to various contents, such as government decisions, government acts, court decisions, legislation and other information displayed on the official portals. However, the high volume of contents and the way the information is presented raises issues about their utility and validity to the community. The problem is how to process the available information and make it useful for citizens. In our work, we suggest an improvement of the present solutions by proposing a conceptual system to automate the processing of the information, analyze patterns, detect outliers, and send alerts about the deviations found. A preliminary analysis of the problem reveals that the type and the volume of the dataset are important factors to select the more appropriated algorithm in outlier detection.
A Review of Anomaly based Intrusion Detection Systems
"... With the advent of anomaly-based intrusion detection systems, many approaches and techniques have been developed to track novel attacks on the systems. High detection rate of 98 % at a low alarm rate of 1 % can be achieved by using these techniques. Though anomaly-based approaches are efficient, sig ..."
Abstract
- Add to MetaCart
With the advent of anomaly-based intrusion detection systems, many approaches and techniques have been developed to track novel attacks on the systems. High detection rate of 98 % at a low alarm rate of 1 % can be achieved by using these techniques. Though anomaly-based approaches are efficient, signature-based detection is preferred for mainstream implementation of intrusion detection systems. As a variety of anomaly detection techniques were suggested, it is difficult to compare the strengths, weaknesses of these methods. The reason why industries don‟t favor the anomaly-based intrusion detection methods can be well understood by validating the efficiencies of the all the methods. To investigate this issue, the current state of the experiment practice in the field of anomalybased intrusion detection is reviewed and survey recent studies in this. This paper contains summarization study and identification of the drawbacks of formerly surveyed works.

