Image

Kanishka Bhaduri

Member since: Sep 24, 2010, Mission Critical Technologies Inc

A Local Scalable Distributed Expectation Maximization Algorithm for Large Peer-to-Peer Networks

Shared by Kanishka Bhaduri, updated on Nov 17, 2010

Summary

Author(s) :
Kanishka Bhaduri, Ashok Srivastava
Abstract

This paper describes a local and distributed expectation maximization algorithm for learning parameters of Gaussian mixture models (GMM) in large peer-to-peer (P2P)
environments. The algorithm can be used for a variety of well-known data mining tasks in distributed environments such as clustering, anomaly detection, target tracking, and
density estimation to name a few, necessary for many emerging P2P applications in bioinformatics, webmining and sensor networks. Centralizing all or some of the data to build global models is impractical in such P2P environments because of the large number of data sources, the asynchronous nature of the P2P networks, and dynamic nature of the data/network. The proposed algorithm takes a two-step approach. In the
monitoring phase, the algorithm checks if the model ‘quality’ is acceptable by using an efficient local algorithm. This is then
used as a feedback loop to sample data from the network and rebuild the GMM when it is outdated. We present thorough experimental results to verify our theoretical claims.

show more info
Publication Name
A Local Scalable Distributed Expectation Maximization Algorithm for Large Peer-to-Peer Networks
Publication Location
IEEE International Conference on Data Mining (ICDM'09), pp. 31-40
Year Published
2009

Files

P2P_EM.pdf
515.3 KB 379 downloads

Discussions

Add New Comment

Kanishka's Projects (4)

Need help?

Visit our help center