Journal of Applied Sciences1812-56541812-5662Asian Network for Scientific Information10.3923/jas.2013.133.139MohamadMumtazimahSamanMd Yazid MohdHitamMuhammad Suzuri12013131Artificial Neural Networks (ANN) are able to simplify recognition tasks and have been steadily improving both in accuracy and efficiency. Classical ANN, as a universal approximator, has been proven to be a more versatile and flexible method compared to modern, high-end algorithms. However, there are several issues that need to be addressed when constructing an ANN used for handling large-scaled data, especially those with a low accuracy score. Parallelism is considered as a practical solution to solve such large workload problems. A comprehensive understanding is needed to generate scalable neural networks in order to achieve an optimal training time for a large network. This study proposed several strategies for distributing data to several network processor structures to reduce the time required for recognition tasks without compromising the achieved accuracy. The initial results obtained indicate that the proposed strategies are able to improve the speed up performance for large scale neural networks while maintaining the accuracy.]]>Ahmad, Z. and J. Zhang,2005Alsmadi, M.K.S., K.B. Omar and S.A. Noah,2009Babii, S.,2007Bhagat, S. and D. Deodhare,2006Buyya, R.,1999Chronopoulos, A.T. and J. Sarangapani,2002Ciresan, D.C., U. Meier, L.M. Gambardella and J. Schmidhuber,2010Dahl, G., A. McAvinney and T. Newhall,2008Enachesu, C. and C.D. Miron,2010Yang, F. and F. Yang,2008Ganapathy, V. and K.L. Liew,2008Ganeshamoorty, K. and D.N. Ranasinghe,2008Grubb, A. and J.A. Bagnell,2010Hornik, K.,1991Kattan, A.R.M., R. Abdullah and R.A. Salam,2010Liu, C.L. and H. Fujisawa,2008De Llano, R.M. and J.L. Bosque,2010Lotric, U. and A. Dobnikar,2005Nakama, T.,2009Negnevitsky, M.,2002Park, S.S., W.G. Jung, Y.G. Shin and D.S. Jang,2008Parvin, H., H. Alinejad-Rokny and S. Parvin,2011Perwej, Y. and A. Chaturvedi,2011Rivero, D., J. Dorado, E. Fernandez-Blanco and A. Pazos,2009Suresh, S., S.N. Omkar and V. Mani,2005Tulunay, Y., E. Tulunay and E.T. Senalp,2004Turchenko, V.,2006Turchenko, V. and L. Grandinetti,2009Yang, S. and A. Browne,2004Rumelhart, D.E. and J.L. McClelland,1986