He Qinshu
Institute of Systems Engineering, CAEP, Mianyang, 621999, China
Liu Xinen
Institute of Systems Engineering, CAEP, Mianyang, 621999, China
Xiao Shifu
Institute of Systems Engineering, CAEP, Mianyang, 621999, China
ABSTRACT
Support Vector Machine (SVM) is a novel modeling method that is valuable in regression and classification. Kernel parameters setting in the SVM training process, along with the feature selection, significantly affects system identification accuracy. The objective of this study is to obtain the better algorithms for better prediction accuracy. This study develops Principle Component Analysis (PCA) for feature selection and a grid searching and k-fold cross validation (GSCV) approach for parameter optimization in the SVM. Numerical and engineering results indicate that SVM based on PCA can be used for identification of nonlinear functions with related input variables, while the SVM based on GSCV is useful for complex system identification with limited number with kinds of uncertainties.
PDF References Citation
How to cite this article
He Qinshu, Liu Xinen and Xiao Shifu, 2013. Comparison of PCA and Model Optimization Algorithms for System
Identification Using Limited Data. Journal of Applied Sciences, 13: 2082-2086.
DOI: 10.3923/jas.2013.2082.2086
URL: https://scialert.net/abstract/?doi=jas.2013.2082.2086
DOI: 10.3923/jas.2013.2082.2086
URL: https://scialert.net/abstract/?doi=jas.2013.2082.2086
REFERENCES
- Ayat, N.E., M. Cheriet and C.Y. Suen, 2005. Automatic model selection for the optimization of SVM kernels. Pattern Recognit., 38: 1733-1745.
CrossRefDirect Link - Cao, L.J. K.S. Chua, W.K. Chong, H.P. Lee and Q.M. Gu, 2003. A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing, 55: 321-336.
CrossRef - Chapelle, O., V. Vapnik, O. Bousquet and S. Mukherjee, 2002. Choosing multiple parameters for support vector machines. Mach. Learn., 46: 131-159.
CrossRefDirect Link - Lee, K. and V. Estivill-Castro, 2007. Feature extraction and gating techniques for ultrasonic shaft signal classification. Applied Soft Comput., 7: 156-165.
CrossRefDirect Link - Rocco, C.M. and J.A. Moreno, 2002. Fast monte carlo reliability evaluation using support vector machine. Reliab. Eng. Syst. Saf., 76: 237-243.
CrossRefDirect Link - Wang, J., X.D. Wu and C.Q. Zhang, 2005. Support vector machines based on k-means clustering for real-time business intelligence systems. Int. J. Bus. Intell. Data Min., 1: 54-64.
CrossRefDirect Link