Detecting Anomalies in Multivariate Data Sets with Switching Sequences and Continuous Streams
Shared by Nikunj Oza, updated on Apr 24, 2014
Summary
- Author(s) :
- Santanu Das, Bryan Matthews, Kanishka Bhaduri, Nikunj Oza, Ashok Srivastava
- Abstract
The world-wide aviation system is one of the most complex dynamical systems ever developed and is generating data at an extremely rapid rate. Most modern commercial aircraft record several hundred flight parameters including information from the guidance, navigation, and control systems, the
avionics and propulsion systems, and the pilot inputs into the aircraft. These parameters may be continuous measurements or binary or categorical measurements recorded in one second intervals for the duration of the flight. Currently, most approaches to aviation safety are reactive, meaning
that they are designed to react to an aviation safety incident or accident. Here, we discuss a novel approach based on the theory of multiple kernel learning to detect potential safety anomalies in very large data bases of discrete and continuous data from world-wide operations of commercial fleets. We pose a general anomaly detection problem which includes both discrete and continuous data streams,
where we assume that the discrete streams have a causal influence on the continuous streams. We also assume that atypical sequence of events in the discrete streams can lead to off-nominal system performance. We discuss the application domain, novel algorithms, and also briefly discuss results on
synthetic and real-world data sets. Our algorithm uncovers operationally significant events in high dimensional data streams in the aviation industry which are not detectable using state of the art methods.
- Publication Name
- N/A
- Publication Location
- N/A
- Year Published
- N/A
Files
Related Items
- MKAD Synthetic Data - A Dataset, Multiple Kernel Learning based Heterogeneous Algorithm (MKAD)
- Multiple Kernel Learning for Heterogeneous Anomaly Detection: Algorithm and Aviation Safety Case Study - A Publication, Multiple Kernel Learning based Heterogeneous Algorithm (MKAD)
- MKAD (Open Sourced Code) - An Algorithm, Multiple Kernel Learning based Heterogeneous Algorithm (MKAD)