Ashok Srivastava

Member since: Jan 05, 2014, Verizon

Anomaly Detection in Sequences

An algorithm shared by Ashok Srivastava, updated on Sep 09, 2010

Summary

resource_image

We present a set of novel algorithms which we call sequenceMiner, that detect and characterize anomalies in large sets of high-dimensional symbol sequences that arise from recordings of switch sensors in the cockpits of commercial airliners. While the algorithms we present are general and domain-independent, we focus on a specific
problem that is critical to determining system-wide health
of a fleet of aircraft. The approach taken uses unsupervised clustering of sequences using the normalized length of he longest common subsequence (nLCS) as a similarity measure, followed by a detailed analysis of outliers to detect anomalies. In this method, an outlier sequence is defined as a sequence that is far away from a cluster. We present new algorithms for outlier analysis that provide comprehensible indicators as to why a particular sequence is deemed to be an outlier. The algorithm provides a coherent description to an analyst of the anomalies in the sequence when compared to more normal sequences.

The final section of the paper demonstrates the effectiveness of sequenceMiner for anomaly detection on a real set of discrete sequence data from a fleet of commercial airliners.

We show that sequenceMiner discovers actionable and
operationally significant safety events. We also compare
our innovations with standard HiddenMarkov Models, and
show that our methods are superior

show more info
Operating System
N/A (edit)
License
N/A (edit)
Programming Language
N/A (edit)
Version
N/A (edit)

Source Files

DataMiningResults-ARMDSeminar.pdf
4.5 MB 179 downloads
Anomaly_Detection_in_Sequences.pdf
213.7 KB 106 downloads
Data_Mining_for_ISHM.pdf
329.1 KB 121 downloads
Anomaly_Detection-2008.pdf
253.9 KB 153 downloads
sequences.pdf
Discovering Atypical Flights in Sequences of Discrete Flight Parameters
5.9 MB 40 downloads

Support/Documentation (edit)

For any questions, contact this resource's administrator: ashok22

Discussions

Add New Comment

Ashok's Projects (16)

Need help?

Visit our help center