Dong Wen
State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences. Beijing 100101, China
Gu Guo-min
Zhejiang University of Technology, Hangzhou, Zhejiang 310023, China
Wu Tian-jun
State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences. Beijing 100101, China
Yu Xin-ju
State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences. Beijing 100101, China
ABSTRACT
Global-scale meteorological observations and scientific research development has brought meteorological big data management and analysis bottlenecks. Aiming at this problem, this study focuses on the organization and management of meteorological sensor network collected big data in cloud computing environment based on the analysis of big data characteristics, application technology status and the main features and application requirements of meteorological sensor network data. And a meteorological sensor network big data organization and management framework based on the "storage-Calculation" integrated cluster environment is proposed. Particularly and focuses on the meteorological sensor network collected big data model in the cluster environment is put forward. The above framework and data model are put into practice in the meteorological data management and service system of Zhejiang province.
PDF References Citation
How to cite this article
Dong Wen, Gu Guo-min, Wu Tian-jun and Yu Xin-ju, 2013. Organization and Management of Meteorological Sensor Network Collected Big
Data. Information Technology Journal, 12: 6636-6640.
DOI: 10.3923/itj.2013.6636.6640
URL: https://scialert.net/abstract/?doi=itj.2013.6636.6640
DOI: 10.3923/itj.2013.6636.6640
URL: https://scialert.net/abstract/?doi=itj.2013.6636.6640
REFERENCES
- Ananthanarayanan, G., S. Agarwal, S. Kandula, A. Greenberg, I. Stoica, D. Harlan and E. Harris, 2011. Coping with skewed content popular-ity in MapReduce clusters. Proceedings of the 6th European Conference on Computer Systems, April 10-13, 2011, Salzburg, Austria, pp: 287-300.
CrossRef - Urbani, J., J. Maassen and H. Bal, 2010. Massive semantic web data compression with MapReduce. Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, June 21-25, 2010, Chicago, IL., USA., pp: 795-802.
CrossRef - Nicolae, B., D. Moise, G. Antoniu, L. Bouge and M. Dorier, 2010. BlobSeer: Bringing high throughput under heavy concurrency to hadoop map-reduce applications. Proceedings of the 24th IEEE International Parallel and Distributed Processing Symposium, April 19-23, 2010, Atlanta, GA., pp: 1-11.
CrossRef - Bu, Y., B. Howe, M. Balazinska and M.D. Ernst, 2010. Haloop: Efficient iterative data processing on large clusters. Proceedings of the VLDB Endowment, Volume 3, September, 2010, Seattle, WA., USA., pp: 285-296.
Direct Link