Journal of Applied Sciences1812-56541812-5662Asian Network for Scientific Information10.3923/jas.2009.854.864SafarinejadianB. MenhajM.B. KarrariM. 5200995In this study, a distributed expectation maximization
(DEM) algorithm is first introduced in a general form for estimating parameters
of a finite mixture of components. This algorithm is used for density
estimation and clustering of the data distributed over the nodes of a
network. Then, a distributed incremental EM algorithm (DIEM) with a higher
convergence rate is proposed. After a full derivation of distributed EM
algorithms, convergence of both DEM and DIEM algorithms is studied based
on the negative free energy concept. It is shown that these algorithms
increase the negative free energy incrementally at each node until reaching
the convergence. Finally, the proposed algorithms are applied to cluster
analysis of gene-expression data. Simulation results approve that DIEM
remarkably outperforms DEM.]]>Besag,1986Datta, S., K. Bhaduri, C. Giannella, R. Wolff and H. Kargupta,2006Fraley, C. and A.E. Raftery,1998Ghosh, D. and A.M. Chinnaiyan,2002Jiang, D., C. Tang and A. Zhang,2004Kowalczyk, W. and N. Vlassis,2005Kempe, D., A. Dobra and J. Gehrke,2003Lin, X., C. Clifton and M. Zhu,2005Ma, J., L. Xu and M.I. Jordan,2000McLachlan, G. and D. Peel,2000McLachlan, G.J. and T. Krishnan,1997McLachlan, G.J., R.W. Bean and D. Peel,2002Mehyar, M., D. Spanos, J. Pongsajapan, S.H. Low and R.M. Murray,2007Neal, R. and G. Hinton,1999Nowak, R.D.,2003Ordonez, C. and E. Omiecinski,2005Thiesson, B., C. Meek and D. Heckerman,2001Verbeek, J.J., N. Vlassis and J.R.J. Nunnink,2003Wolff, R. and A. Schuster,2004Xu, L. and M.I. Jordan,1996Yeung, K.Y., C. Fraley, A. Murua, A.E. Raftery and W.L. Ruzz,2001Chernyi, A.A., K.A. Trushkin, V.A. Bokovoy, A.K. Yanovski and N.V. Tverdokhlebov et al.,2004Dasgupta, S.,1999Stratowa, C.,2003