A Local Scalable Distributed Expectation Maximization Algorithm for Large Peer-to-Peer Networks
Shared by Kanishka Bhaduri, updated on Nov 17, 2010
Summary
- Author(s) :
- Kanishka Bhaduri, Ashok Srivastava
- Abstract
This paper describes a local and distributed expectation maximization algorithm for learning parameters of Gaussian mixture models (GMM) in large peer-to-peer (P2P)
environments. The algorithm can be used for a variety of well-known data mining tasks in distributed environments such as clustering, anomaly detection, target tracking, and
density estimation to name a few, necessary for many emerging P2P applications in bioinformatics, webmining and sensor networks. Centralizing all or some of the data to build global models is impractical in such P2P environments because of the large number of data sources, the asynchronous nature of the P2P networks, and dynamic nature of the data/network. The proposed algorithm takes a two-step approach. In the
monitoring phase, the algorithm checks if the model ‘quality’ is acceptable by using an efficient local algorithm. This is then
used as a feedback loop to sample data from the network and rebuild the GMM when it is outdated. We present thorough experimental results to verify our theoretical claims.
- Publication Name
- A Local Scalable Distributed Expectation Maximization Algorithm for Large Peer-to-Peer Networks
- Publication Location
- IEEE International Conference on Data Mining (ICDM'09), pp. 31-40
- Year Published
- 2009
Files
Discussions
Kanishka's Projects (4)
-
-
Aviation Safety Technology Portal ...
15 members
-
-
Need help?
Visit our help center